Preprint
Machine Learning

Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performance

Yizhou Fan(Peking University), Luzhen Tang(Peking University), Huixiao Le(Peking University), Kejie Shen(Peking University), Shufang Tan(Peking University), Yueying Zhao(Peking University), Yüan Shen(Zhejiang Lab), Xinyu Li(Monash University), Dragan Gašević(Monash University)
December 10, 2024British Journal of Educational Technology657 citations

657

Citations

35

Influential Citations

British Journal of Educational Technology

Venue

2024

Year

Abstract

Abstract With the continuous development of technological and educational innovation, learners nowadays can obtain a variety of supports from agents such as teachers, peers, education technologies, and recently, generative artificial intelligence such as ChatGPT. In particular, there has been a surge of academic interest in human‐AI collaboration and hybrid intelligence in learning. The concept of hybrid intelligence is still at a nascent stage, and how learners can benefit from a symbiotic relationship with various agents such as AI, human experts and intelligent learning systems is still unknown. The emerging concept of hybrid intelligence also lacks deep insights and understanding of the mechanisms and consequences of hybrid human‐AI learning based on strong empirical research. In order to address this gap, we conducted a randomised experimental study and compared learners' motivations, self‐regulated learning processes and learning performances on a writing task among different groups who had support from different agents, that is, ChatGPT (also referred to as the AI group), chat with a human expert, writing analytics tools, and no extra tool. A total of 117 university students were recruited, and their multi‐channel learning, performance and motivation data were collected and analysed. The results revealed that: (1) learners who received different learning support showed no difference in post‐task intrinsic motivation; (2) there were significant differences in the frequency and sequences of the self‐regulated learning processes among groups; (3) ChatGPT group outperformed in the essay score improvement but their knowledge gain and transfer were not significantly different. Our research found that in the absence of differences in motivation, learners with different supports still exhibited different self‐regulated learning processes, ultimately leading to differentiated performance. What is particularly noteworthy is that AI technologies such as ChatGPT may promote learners' dependence on technology and potentially trigger “metacognitive laziness”. In conclusion, understanding and leveraging the respective strengths and weaknesses of different agents in learning is critical in the field of future hybrid intelligence. Practitioner notes What is already known about this topic Hybrid intelligence, combining human and machine intelligence, aims to augment human capabilities rather than replace them, creating opportunities for more effective lifelong learning and collaboration. Generative AI, such as ChatGPT, has shown potential in enhancing learning by providing immediate feedback, overcoming language barriers and facilitating personalised educational experiences. The effectiveness of AI in educational contexts varies, with some studies highlighting its benefits in improving academic performance and motivation, while others note limitations in its ability to replace human teachers entirely. What this paper adds We conducted a randomised experimental study in the lab setting and compared learners' motivations, self‐regulated learning processes and learning performances among different agent groups (AI, human expert and checklist tools). We found that AI technologies such as ChatGPT may promote learners' dependence on technology and potentially trigger metacognitive "laziness", which can potentially hinder their ability to self‐regulate and engage deeply in learning. We also found that ChatGPT can significantly improve short‐term task performance, but it may not boost intrinsic motivation and knowledge gain and transfer. Implications for practice and/or policy When using AI in learning, learners should focus on deepening their understanding of knowledge and actively engage in metacognitive processes such as evaluation, monitoring, and orientation, rather than blindly following ChatGPT's feedback solely to complete tasks efficiently. When using AI in teaching, teachers should think about which tasks are suitable for learners to complete with the assistance of AI, pay attention to stimulating learners' intrinsic motivations, and develop scaffolding to assist learners in active learning. Researcher should design multi‐task and cross‐context studies in the future to deepen our understanding of how learners could ethically and effectively learn, regulate, collaborate and evolve with AI.

Analysis

Why This Paper Matters

This paper addresses a critical gap in the emerging field of hybrid intelligence in education: the empirical understanding of how generative AI tools like ChatGPT affect learning processes and outcomes. While there is much enthusiasm about AI's potential to personalize learning and provide instant feedback, rigorous evidence on its impact on motivation, self-regulated learning, and knowledge transfer is scarce. By conducting a randomized controlled experiment, the authors provide causal insights that challenge the assumption that AI assistance automatically enhances learning.

The study is particularly significant because it introduces the concept of "metacognitive laziness"—a phenomenon where learners over-rely on AI, leading to superficial engagement and reduced self-regulation. This is a timely warning for educators and policymakers who are rapidly integrating AI tools into classrooms. The paper also contributes to the theoretical development of hybrid intelligence by empirically demonstrating that different support agents (AI, human, analytics) lead to distinct learning processes and outcomes, even when motivation is similar.

Technical Contributions

  • Randomized experimental design: The study randomly assigned 117 university students to four conditions: ChatGPT, human expert chat, writing analytics tools, and a control group with no extra tool. This allows for causal inference about the effects of different support types.
  • Multi-channel data collection: The researchers collected data on motivation (pre/post-task surveys), self-regulated learning processes (via trace data or observations), and performance (essay scores, knowledge gain, transfer). This comprehensive approach captures both process and outcome variables.
  • Process analysis: They analyzed the frequency and sequences of self-regulated learning processes, going beyond simple outcome comparisons to understand how learners engage with different supports.
  • Comparison of human vs. AI support: Including a human expert condition provides a benchmark to compare AI assistance against human interaction, which is rare in prior studies.
  • Focus on metacognition: The paper introduces and operationalizes the concept of metacognitive laziness, offering a new lens for evaluating AI's impact on learning.

Results

  • Motivation: No significant differences in post-task intrinsic motivation across groups, indicating that AI support does not inherently boost or reduce motivation.
  • Self-regulated learning processes: Significant differences were found in the frequency and sequences of processes. The ChatGPT group exhibited different patterns, likely indicating more passive or less metacognitive engagement.
  • Performance: The ChatGPT group showed significantly higher essay score improvement compared to other groups. However, knowledge gain and transfer tests showed no significant differences, suggesting that the performance boost was task-specific and not indicative of deeper learning.
  • Metacognitive laziness: The findings suggest that ChatGPT users may rely on the AI's output without critically evaluating or monitoring their own understanding, leading to superficial learning.

Significance

The paper has profound implications for the design of AI-based educational tools. It cautions that while generative AI can improve immediate task performance, it may undermine long-term learning if not used with appropriate scaffolding. The concept of metacognitive laziness provides a new metric for evaluating AI's educational impact, urging developers to build features that encourage reflection and self-regulation.

For educators, the findings suggest that AI should be used as a complement, not a replacement, for human guidance. Teachers need to design tasks that require active engagement with AI feedback and provide scaffolding to promote metacognitive processes. For researchers, the study opens avenues for multi-task and cross-context studies to further understand human-AI collaboration in learning.

Overall, this paper is a landmark empirical contribution to the field of AI in education, offering both theoretical insights and practical guidance for fostering effective hybrid intelligence.