Reflective practice holds critical importance, for example, in higher education and teacher education, yet promoting students’ reflective skills has been a persistent challenge. The emergence of revolutionary artificial intelligence technologies, notably in machine learning and large language models, heralds potential breakthroughs in this domain. The current research on analyzing reflective writing hinges on sentence-level classification. Such an approach, however, may fall short of providing a holistic grasp of written reflection. Therefore, this study employs shallow machine learning algorithms and pre-trained language models, namely BERT, RoBERTa, BigBird, and Longformer, with the intention of enhancing the document-level classification accuracy of reflective writings. A dataset of 1,043 reflective writings was collected in a teacher education program at a German university (M = 251.38 words, SD = 143.08 words). Our findings indicated that BigBird and Longformer models significantly outperformed BERT and RoBERTa, achieving classification accuracies of 76.26% and 77.22%, respectively, with less than 60% accuracy observed in shallow machine learning models. The outcomes of this study contribute to refining document-level classification of reflective writings and have implications for augmenting automated feedback mechanisms in teacher education.

Reflective writing is a relevant aspect of pre-service teachers’ professionalization. Evaluating reflective writing in teacher education is demanding due to a shortage of resources. Hence, this study explores the practical possibilities of evaluating reflective writing using a mixed-methods approach to analyze reflective writing from 198 pre-service teachers at a German university. We used qualitative content analysis, computational linguistic approaches, and BERTopic. Results of qualitative content analysis results indicated primarily descriptive and low-level participants’ reflective writing. Next, computational linguistic analyses revealed that affective and cognitive terminology utilization differed across varying levels of reflection, with a higher frequency of such terms correlating with deeper levels of reflection. BERTopic results showed that reflective content mainly centered on learning materials and shifted toward affective and motivational themes related to higher levels of reflection. This study demonstrates that reflective writing can be evaluated across reflection levels and cognitive, affective, and thematic dimensions, combining qualitative content analysis, computational linguistic approaches, and BERTopic.

Reflection skills are a key but challenging element in teacher training. Feedback on reflective writing assignments can improve reflection skills, but it is affected by challenges (high variability in judgments and time investment). AI-generated feedback offers many options. Therefore, the aim of this study was to examine the potential of AI-generated feedback compared to that provided by lecturers for developing reflective skills. A total of 93 randomly selected pre-service teachers (70% female) in a course at a German university wrote two reflections and received feedback from either lecturers or ChatGPT 4.0 based on the same prompts. Pre-service teachers’ written reflections were assessed, and an online questionnaire based on standard instruments was applied. Control variables included metacognitive learning strategies and reflection-related dispositions. Based on a linear mixed model, the main effects on reflective skills were identified for time ($\widehat{\mathsf{\beta }}$ = 0.41, p = 0.003) and feedback condition ($\widehat{\mathsf{\beta }}$ = −0.42, p = 0.032). Both forms of feedback similarly fostered reflective skills over time, with academic self-efficacy emerging as a pertinent disposition ($\widehat{\mathsf{\beta }}$ = 0.25, p = 0.014). The limitations of this study and implications for teacher training are discussed.

Nowadays, “being digital” has been largely realized, especially in education. The continuous renewal of Information and Communication Technology (ICT) and artificial intelligence (AI) has led to an educational revolution. Therefore, teaching and learning activities are no longer restricted by time, space, CE, and humans. As a result, future qualified teachers with high self-regulation competence and strong digital competence are in great need. However, research studies reveal that many teachers directly replicate traditional classrooms and fail to conduct virtual activities with possible digital resources and the application of AI. Confronted with such challenges, future teachers do often not accept AI and feel unprepared for future teaching. This chapter provides an overview of research theories, assessment techniques, and support instruments in related research areas.