Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis

Analysis

Why This Paper Matters

Generative artificial intelligence, particularly large language models like ChatGPT, has rapidly permeated educational contexts, promising personalized learning, automated assessment, and intelligent tutoring. Yet, the field has lacked a systematic synthesis of its applications, ethical challenges, and research trajectories. This paper addresses that gap by conducting a comprehensive review of 207 research papers, guided by the PRISMA framework, to map the landscape of GAI in education. Published in Sustainability in August 2023, it arrives at a critical juncture when educators and policymakers are grappling with how to harness GAI responsibly.

The paper's significance is amplified by its dual analytical approach: content analysis and bibliometric analysis. The content analysis delves into specific educational domains, such as medical and engineering education, revealing GAI's transformative potential in assessment, personalized learning support, and intelligent tutoring systems. The bibliometric analysis quantifies research growth, identifies key tools (notably ChatGPT), and uncovers geographic and interdisciplinary collaboration patterns. This combination provides both depth and breadth, making the review a valuable resource for stakeholders across academia, industry, and policy.

Moreover, the paper emphasizes ethical considerations, including transparency, bias mitigation, and responsible technology use. By highlighting these issues alongside technological possibilities, it encourages a balanced discourse on GAI's role in education. The identification of future research directions, such as GAI-enhanced curriculum design and longitudinal studies, further underscores its forward-looking contribution.

Technical Contributions

• PRISMA-guided systematic review: The authors rigorously apply the PRISMA framework to select and analyze 207 papers, ensuring methodological transparency and reproducibility.
• Dual analysis approach: Combines content analysis of GAI applications in specific educational domains with bibliometric analysis of publication trends, tools, and collaboration networks.
• Domain-specific insights: Explores GAI's impact in medical and engineering education, highlighting tailored applications and challenges.
• Ethical framework: Discusses the need for transparent GAI models, bias mitigation, and responsible use, offering a foundation for ethical guidelines.
• Future research agenda: Proposes concrete directions, including GAI-enhanced curriculum design and longitudinal studies on learning outcomes.

Results

The bibliometric analysis reveals an exponential growth in GAI education research in 2023, with ChatGPT emerging as the dominant tool. The content analysis identifies versatile applications across assessment, personalized learning, and intelligent tutoring systems. The paper also notes geographic distribution and interdisciplinary collaboration patterns, though specific metrics are not detailed in the abstract. The synthesis of 207 papers provides a robust evidence base for the identified trends and gaps.

Significance

This review significantly advances the understanding of GAI in education by providing a structured overview of its applications, ethical considerations, and research trends. It serves as a foundational reference for researchers, educators, and policymakers, guiding responsible integration and future inquiry. By highlighting research gaps and proposing directions, it catalyzes further empirical studies, particularly longitudinal ones, to assess long-term impacts on learning outcomes. Ultimately, the paper contributes to shaping a thoughtful and evidence-based approach to leveraging GAI in educational settings.