Generative artificial intelligence provides both opportunities and challenges for higher education. Existing literature has not properly investigated how this technology would impact assessment in higher education. This scoping review took a forward-thinking approach to investigate how generative artificial intelligence transforms assessment in higher education. We used the PRISMA extension for scoping reviews to select articles for review and report the results. In the screening, we retrieved 969 articles and selected 32 empirical studies for analysis. Most of the articles were published in 2023. We used three levels—students, teachers, and institutions—to analyze the articles. Our results suggested that assessment should be transformed to cultivate students’ self-regulated learning skills, responsible learning, and integrity. To successfully transform assessment in higher education, the review suggested that (i) teacher professional development activities for assessment, AI, and digital literacy should be provided, (ii) teachers’ beliefs about human and AI assessment should be strengthened, and (iii) teachers should be innovative and holistic in their teaching to reflect the assessment transformation. Educational institutions are recommended to review and rethink their assessment policies, as well as provide more inter-disciplinary programs and teaching.
The anthropomorphic characteristics of artificial intelligence (AI) can provide a positive environment for self‐regulated learning (SRL). The factors affecting adolescents' SRL through AI technologies remain unclear. Limited AI and disciplinary knowledge may affect the students' motivations, as explained by self‐determination theory (SDT). In this study, we examine the mediating effects of needs satisfaction in SDT on the relationship between students' previous technical (AI) and disciplinary (English) knowledge and SRL, using an AI conversational chatbot. Data were collected from 323 9th Grade students through a questionnaire and a test. The students completed an AI basic unit and then learned English with a conversational chatbot for 5 days. Confidence intervals were calculated to investigate the mediating effects. We found that students' previous knowledge of English but not their AI knowledge directly affected their SRL with the chatbot, and that satisfying the need for autonomy and competence mediated the relationships between both knowledge (AI and English) and SRL, but relatedness did not. The self‐directed nature of SRL requires heavy cognitive learning and satisfying the need for autonomy and competence may more effectively engage young children in this type of learning. The findings also revealed that current chatbot technologies may not benefit students with relatively lower levels of English proficiency. We suggest that teachers can use conversational chatbots for knowledge consolidation purposes, but not in SRL explorations. Practitioner notes: What is already known about this topic Artificial intelligence (AI) technologies can potentially support students' self‐regulated learning (SRL) of disciplinary knowledge through chatbots. Needs satisfaction in Self‐determination theory (SDT) can explain the directive process required for SRL. Technical and disciplinary knowledge would affect SRL with technologies. What this paper adds This study examines the mediating effects of needs satisfaction in SDT on the relationship between students' previous AI (technical) and English (disciplinary) knowledge and SRL, using an AI conversational chatbot. Students' previous knowledge of English but not their AI knowledge directly affected their SRL with the chatbot. Autonomy and competence were mediators, but relatedness was not. Implications for practice and/or policy Teachers should use chatbots for knowledge consolidation rather than exploration. Teachers should support students' competence and autonomy, as these were found to be the factors that directly predicted SRL. School leaders and teacher educators should include the mediating effects of needs satisfaction in professional development programmes for digital education.
Adaptive learning is an approach toward personalized learning and places the concept of “learner-centered education” into practice. With the rapid development of artificial intelligence and other technologies in recent years, there have been many breakthroughs in adaptive learning. Thus, it is important to gain insight into the evolution of related research and to track the research frontiers to further promote its development. This study used CiteSpace and VOSviewer to conduct a bibliometric analysis of 644 adaptive learning journal papers indexed in the WoS database from 2000 to 2022. This study presented a general view of the field of adaptive learning research over the last two decades using quantitative analysis. Currently, adaptive learning research is rapidly developing. In terms of the major research forces, a core group of authors including Qiao J. F., Han H. G. and Song Q has been formed; the major publishing country in this field is China; the core publishing journals include IEEE Transactions on Neural Networks and Learning Systems. Four major research topics in this field were identified using cluster analysis, namely the application of deep learning in educational data analysis, the development and application of adaptive learning model in AI education, the development and application of intelligent tutoring system in tutoring and teaching, cutting-edge modeling technology for feature modeling and knowledge tracing. Through evolution analyses, the logic of adaptive learning research’s development was determined; that is, technological changes have played a key role in the development of this field. Following the logic, we presented three frontiers of adaptive learning with burst terms: feature extraction, adaptation model and computational modeling. Adaptive learning is a core research topic for both computer science and educational technology disciplines, and it is also an important field where emerging technologies empowering education and teaching can play a part. The findings of the study clearly presented the current research status, evolutionary logic and research frontiers of this topic, which can provide references for the further development of this research field.
27 December 2022 in Education and Information Technologies