6 January 2025 in Journal of Educational Computing Research
The rapid development of large language models (LLMs) presented opportunities for the transformation of science and STEM education. Research on LLMs was in the exploratory phase, characterized by discussions and observations rather than empirical investigations. This study presented a framework for incorporating LLMs into Science and Engineering Practice (SEP), utilizing a case study on submarine construction, followed by a four-week quasi-experimental validation. The research employed conditional cluster sampling, selecting two homogeneous natural classes from a middle school in China to serve as the experimental and control groups. The key experimental variable was the inclusion of LLMs in the SEP project. Various validated and self-developed assessment tools were used to measure students’ STEM learning outcomes. Statistical analyses, including pre- and post-test paired comparisons within classes and ANCOVA for between-class differences, were performed to evaluate the effects of LLM integration. The results showed that students participating in SEP integrated with LLMs significantly improved their mastery of scientific knowledge, attitudes towards science, perceived usefulness of technology, understanding of engineering, computational thinking skills, and problem-solving abilities. In contrast, students participating in traditional SEP exhibited weaker knowledge acquisition, differences in understanding engineering concepts, and lack of development in computational thinking and problem-solving skills. This study was a pioneering effort in integrating LLMs into science education and provided a framework and case reference for the deeper application of LLMs in the future.
20 January 2022 in Journal of Science Education and Technology
28 November 2023 in Research in Science & Technological Education
23 July 2025 in Computer Applications in Engineering Education
8 July 2024 in Interactive Learning Environments
6 October 2026 in International Journal of STEM Education
Background: Generative AI (GenAI) holds great potential for STEM education, especially in the context of problem-solving tasks, but unguided use often leads to metacognitive laziness, where students treat the technology as an answer machine rather than a collaborative partner. On the basis of Zimmerman’s self-regulated learning (SRL) framework and cognitive load theory (CLT), our randomized controlled trial (RCT; N = 95) investigated whether a structured, SRL-aligned scaffolding training session could improve students’ AI-assisted revision performance in electromagnetism problems. The experimental group ( n = 50) received the designed training, which emphasized the nature of GenAI, the SRL-aligned prompting strategy, and the remediation strategy for GenAI deficiencies. The control group ( n = 45) received problem-solving instruction without specific AI guidance. After completing the Conceptual Survey of Electricity and Magnetism (CSEM) independently, both groups subsequently conversed with the large language model Doubao to revise their responses. Results: Independent samples t tests revealed that the experimental group showed greater AI-assisted revision performance ( d = 0.81, p < 0.001) than did the control group. The experimental group reported comparable overall cognitive load, despite a marginal elevation in the intrinsic cognitive load. Robust linear models showed that training attenuated the predictive effect of prior GenAI experience on revision performance. Qualitative analysis revealed that trained participants employed more diverse higher-order strategies and deployed systematic error remediation upon identifying AI deficiencies. The trained students achieved an incorrect-to-correct revision rate of 69.3%, compared with 41.3% for the control group. Conclusion: Effective GenAI integration requires pedagogical scaffolding rather than mere access to the tool itself. The results suggest that training can enhance students’ revision performance and foster more strategic engagement with GenAI in the short term. These findings not only extend the theoretical applications of SRL and CLT in the human-AI context but also underscore the practical need for student development in AI literacy.