Gonzalo Pandelet

Gonzalo Pandelet

Auto-generated profile, based on publicly available information

Gonzalo Pandelet


Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 November 2025 in JMIR Medical Education
Verified
Journal Article
Open access
Alberto Nogales NogalesAlberto Nogales Nogales
Alberto Nogales Nogales
SASophia Denizon Arranz
Sophia Denizon Arranz
AMAlonso Mateos
Alonso Mateos
JCJavier Cervera
Javier Cervera
GPGonzalo Pandelet
Gonzalo Pandelet
ECEmilio Cervera-Barba
Emilio Cervera-Barba
Background: Large language models in artificial intelligence have been among the tools with a significant and real impact on people’s daily lives. In this regard, they serve as an aid in specific fields, such as education, helping educators with cumbersome tasks such as periodic evaluations. Objective: This study focused on analyzing the benefits of large language models, particularly the chain-of-thought (CoT) strategy, for the task of evaluating students’ Spanish-language medical record writing. The aim was 2-fold: first, we attempted to save time and resources, and second, we used the reasoning of the CoT strategy to evaluate the rubrics and their interpretations. Methods: The proposed solution assessed the application of 2 models—Llama 3.1 and Claude 3.5—in combination with one-shot and CoT to evaluate how medical students write medical records in Spanish. First, machine learning metrics were applied to measure the performance of the solutions. Then, different statistical analyses were performed at the clinical record and item levels. Finally, differences between the proposed models and evaluators were studied in depth. Results: A maximum of 3807 items were evaluated. Claude obtained the best accuracy with slight differences between one-shot and CoT (86.4% and 85.0%, respectively). However, Claude with CoT outperformed the rest of the combinations on all complementary metrics, initially achieving a sensitivity of 94.2%, specificity of 59.5%, precision of 85.8%, and F 1 -score of 89.6%. Expert review of CoT reasoning determined that 63.8% of the discrepancies were model hits, raising Claude’s final accuracy to 94.6% (SD 4.3%). In the final phase, sensitivity was 98.0% (SD 2.3%), specificity improved to 83.3% (SD 14.3%), and F 1 -score reached 96.2% (SD 3.3%). Sectional analysis showed greater difficulties in the “History of present illness” section (n=125 discordances). Conclusions: CoT demonstrated strong potential for supporting the evaluation of clinical records written in Spanish by medical students and providing feedback to them. More importantly, it showed significant promise in assisting professors by assessing the quality of their rubrics and identifying possible errors.

28 November 2025 in JMIR Preprints
Verified
Preprint
Open access
Alberto Nogales NogalesAlberto Nogales Nogales
Alberto Nogales Nogales
SASophia Denizon Arranz
Sophia Denizon Arranz
AMAlonso Mateos
Alonso Mateos
JCJavier Cervera
Javier Cervera
GPGonzalo Pandelet
Gonzalo Pandelet
ECEmilio Cervera-Barba
Emilio Cervera-Barba
BACKGROUND Large Language Models from the field of Artificial Intelligence have been one of the tools that have a great and real impact on the daily lives of people. In this regard, they emerge as an aid in specific fields such as education helping educators in cumbersome tasks such as periodical evaluations. OBJECTIVE This paper is focused in analyzing the benefits of Large Language Models and in particular Chain of Thought strategy for the task of evaluating the writing in Spanish of medical records by students. The aim is two-fold: first we try to save time and re-sources and second, we use the reasonings of the Chain of Thought to evaluate the ru-brics and its interpretations. METHODS The proposed solution studies the application of two models such as Llama 3.1 and Claude 3.5 in combination with two strategies One-Shot and Chain of Thought to evaluate how medicine students write medical records in Spanish. First, machine learn-ing metrics are applied to measure the performance of the solutions. Then, different statistical analysis is obtained at clinical record and item level. Finally, the differences between proposed models and evaluators are studied in-depth. RESULTS Machine learning metrics indicate that, at first, Claude got an Accuracy over 86% and no substantial differences among them. However, an in-depth analysis high-lights the potential of Chain of Thought both for identifying evaluator errors and for addressing issues in the rubrics. Applying this analysis, we have found 317 human errors which, after a correction, have set the Accuracy in 94.6%. CONCLUSIONS Chain of Thought demonstrates strong potential for supporting the evalua-tion of clinical records written in Spanish by medical students and providing feedback to them. More importantly, it shows significant promise in assisting professors by as-sessing the quality of their rubrics and identifying possible errors.