Artificial intelligence (AI) can potentially enhance cognitive assessment practices in maternal and child health nursing education. Objectives: To evaluate the reliability, accuracy and precision, and external validity of an AI-assisted answer assessment (4A) program for cognitive assessments in nursing education. Methods: This study is a validation study. Initially, 170 nursing students from northern Thailand participated, with 52 randomly selected for detailed testing. Agreement testing between the 4A program and human experts was conducted using the intraclass correlation coefficient (ICC). Accuracy and precision testing compared 4A scores with human expert assessments via the McNemar test. External validation involved 138 participants to compare the 4A program’s assessments against national examination outcomes using logistic regression. Results: Results indicated a high level of consistency between the 4A program and human experts (ICC = 0.886). With an accuracy of 0.808 and a precision of 0.913, compared to the human expert’s accuracy of 0.923 and precision of 1.000. The McNemar test (χ2 = 0.4, p = 0.527) showed no significant difference in evaluation performance between AI and human experts. Higher scores on the 4A program significantly predicted success in the national nursing examination (OR: 1.124, p = 0.031). Conclusions: The 4A program demonstrates potential in reliably assessing nursing students’ cognitive abilities and predicting exam success. This study advocates for the continued integration of AI in educational assessments and the importance of refining AI systems to better align with traditional assessment methods.
Background: Nursing education faces challenges in developing critical thinking and digital literacy among Generation Z students, particularly in maternal–newborn care contexts where evidence-based practice is essential. Objectives: To evaluate the effectiveness of an AI-assisted podcasting intervention on critical thinking and digital literacy among nursing students and explore their experiences. Methods: A convergent mixed-methods design included 48 third-year nursing students who created educational podcasts using AI tools (Sci Space for literature search, Notebook LM for synthesis). Quantitative data were analyzed using paired t-tests; qualitative data from three focus groups (n = 15) underwent thematic analysis. Results: Critical thinking scores increased significantly from 89.71 (SD = 13.43) to 117.29 (SD = 9.94), (t = −13.332, p < 0.001). Digital literacy scores improved from 37.98 (SD = 5.84) to 46.94 (SD = 4.11), (t = −9.407, p < 0.001). Four themes emerged: transformation from anxiety to empowerment, AI as scaffold, distinct tool utility, and future clinical application. Conclusions: These findings suggest that AI-assisted podcasting has the potential to significantly enhance critical thinking and digital literacy among nursing students; however, results should be interpreted with caution given the pre–post design, single-institution sample, and use of researcher-developed instruments.