Manuel Carpio Salmerón

Manuel Carpio Salmerón

Auto-generated profile, based on publicly available information

Manuel Carpio Salmerón

Department of Endocrinology and Nutrition, Santa Lucía University General Hospital, Cartagena, Spain

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 January 2026 in JMIR Medical Education
Verified
Journal Article
Open access
PBPau Benito
Pau Benito
MIMikel Isla-Jover
Mikel Isla-Jover
PGPablo González-Castro
Pablo González-Castro
PEPedro José Fernández Esparcia
Pedro José Fernández Esparcia
MCManuel Carpio
Manuel Carpio
CCCarlos Carazo-Casas
Carlos Carazo-Casas
Background: In recent years, generative artificial intelligence and large language models (LLMs) have rapidly advanced, offering significant potential to transform medical education. Several studies have evaluated the performance of chatbots on multiple-choice medical examinations. Objective: The study aims to assess the performance of two LLMs—GPT-4o and OpenAI o1—on the Médico Interno Residente (MIR) 2024 examination, the Spanish national medical test that determines eligibility for competitive medical specialist training positions. Methods: A total of 176 questions from the MIR 2024 examination were analyzed. Each question was presented individually to the chatbots to ensure independence and prevent memory retention bias. No additional prompts were introduced to minimize potential bias. For each LLM, response consistency under verification prompting was assessed by systematically asking, “Are you sure?” after each response. Accuracy was defined as the percentage of correct responses compared to the official answers provided by the Spanish Ministry of Health. It was assessed for GPT-4o, OpenAI o1, and, as a benchmark, for a consensus of medical specialists and for the average MIR candidate. Subanalyses included performance across different medical subjects, question difficulty (quintiles based on the percentage of examinees correctly answering each question), and question types (clinical cases vs theoretical questions; positive vs negative questions). Results: Overall accuracy was 89.8% (158/176) for GPT-4o and 90% (160/176) after verification prompting, 92.6% (163/176) for OpenAI o1 and 93.2% (164/176) after verification prompting, 94.3% (166/176) for the consensus of medical specialists, and 56.6% (100/176) for the average MIR candidate. Both LLMs and the consensus of medical specialists outperformed the average MIR candidate across all 20 medical subjects analyzed, with ≥80% LLMs’ accuracy in most domains. A performance gradient was observed: LLMs’ accuracy gradually declined as question difficulty increased. Slightly higher accuracy was observed for clinical cases compared to theoretical questions, as well as for positive questions compared to negative ones. Both models demonstrated high response consistency, with near-perfect agreement between initial responses and those after the verification prompting. Conclusions: These findings highlight the excellent performance of GPT-4o and OpenAI o1 on the MIR 2024 examination, demonstrating consistent accuracy across medical subjects and question types. The integration of LLMs into medical education presents promising opportunities and is likely to reshape how students prepare for licensing examinations and change our understanding of medical education. Further research should explore how the wording, language, prompting techniques, and image-based questions can influence LLMs’ accuracy, as well as evaluate the performance of emerging artificial intelligence models in similar assessments.

1 June 2026 in Revista Española de Educación Médica
Verified
Journal Article
Open access
PDF file
MSManuel Carpio Salmerón
Manuel Carpio Salmerón
CCCarlos Carazo-Casas
Carlos Carazo-Casas
PBPau Benito
Pau Benito
CGClemente Garcia
Clemente Garcia
JAJesús Alonso-Carrillo
Jesús Alonso-Carrillo
PGPablo González-Castro
Pablo González-Castro
Introduction: Large language model-based AI systems are increasingly used in medical education, but their educational value in multilingual, high-stakes examination settings remains insufficiently defined. Objective: To assess the accuracy of latest-generation AI systems on the official 2026 Spanish Médico Interno Residente (MIR) examination and compare their performance with the Healthcademia chatbot, AMIR faculty experts, and average candidates. Materials and Methods: A cross-sectional quantitative evaluation analyzed all 200 valid questions from the official MIR 2026 Version 0 booklet. Performance was assessed using automated pipelines for text-only items and manual multimodal input for the 24 image-associated questions. Two instruction conditions, neutral and expert-role, were tested, with additional effort-level stratification for GPT-5.2. Accuracy was measured against the final official answer key. Human comparison groups included AMIR faculty experts and the average MIR candidate. Results: Several latest-generation AI systems showed very high accuracy on the MIR 2026 examination. The highest-performing configuration, GPT-5.2 high effort without expert-role instruction, achieved 199/200 correct answers (99.5%). Gemini 3 Flash with expert-role instruction achieved 198/200 (99.0%). AMIR faculty experts achieved 194/200 (97.0%), whereas the average candidate achieved 131/200 (65.7%). On image-associated questions, several multimodal configurations achieved 24/24 correct answers when the corresponding image was provided. Conclusions: Under the conditions evaluated in this study, several AI configurations achieved near-perfect accuracy on a complete, high-stakes national medical licensing examination. These findings support licensing-style examinations as benchmarks for educational AI and suggest potential use in supervised feedback and self-assessment. Performance on multiple-choice items should not be interpreted as evidence of autonomous clinical reasoning.

29 September 2025 in Pan African Medical Journal
Verified
Journal Article
Open access
MSManuel Carpio Salmerón
Manuel Carpio Salmerón
ACAdrian Heredia Carrillo
Adrian Heredia Carrillo
LMLuis Marin Martinez
Luis Marin Martinez
GKGeorgios Kyriakos
Georgios Kyriakos
Severe asthma is a chronic condition that often requires oral corticosteroid (OCS) therapy, which, when prolonged, may lead to significant adverse effects, including secondary adrenal insufficiency. Advances in biologic therapies have allowed many patients to reduce or discontinue OCS. We describe the clinical course and outcomes of six patients with severe corticosteroid-dependent asthma who underwent a structured OCS tapering protocol under endocrinological supervision. All patients had a history of prolonged OCS use (mean duration >10 years), high-dose inhaled corticosteroids (ICS), and biologic therapy. Adrenal insufficiency was confirmed in three patients (50%), who required continued hydrocortisone replacement due to persistent hypothalamic-pituitary-adrenal (HPA) axis suppression. The other three patients successfully discontinued corticosteroids and demonstrated HPA axis recovery. Notably, no asthma exacerbations occurred during the tapering process. A structured, multidisciplinary corticosteroid tapering protocol is both feasible and safe in patients with severe asthma, particularly when guided by endocrine assessment. ICS exposure may contribute to adrenal suppression, highlighting the need for comprehensive hormonal evaluation in this population.

29 October 2026 in JMIR Medical Education
Verified
Journal Article
Open access
CGClemente García-Hidalgo
Clemente García-Hidalgo
MCManuel Carpio-Salmerón
Manuel Carpio-Salmerón
PBPau Benito
Pau Benito
CCCarlos Carazo-Casas
Carlos Carazo-Casas
BCBeatriz Carratalá
Beatriz Carratalá
JPJaime Campos Pavón
Jaime Campos Pavón
Background: Large language models (LLMs) achieve high scores on health-professions examinations. Whether these scores support the same interpretations as human scores remains uncertain. Spain uses parallel multiple-choice examinations for entry to specialty training in medicine (Médico Interno Residente [MIR]), nursing (Enfermero Interno Residente [EIR]), psychology (Psicólogo Interno Residente [PIR]), and pharmacy (Farmacéutico Interno Residente [FIR]). Objective: Using the January 2026 MIR, EIR, PIR, and FIR examinations, this study aimed to quantify the correspondence between human and LLM item facility and to describe model accuracy, distractor selection, and performance associated with measured surface features. Methods: We evaluated 839 valid items using 12 configurations: GPT-5.2 at 3 reasoning efforts and Claude Opus, Sonnet, and Haiku 4.5 (Anthropic), each under neutral and expert prompts, with one run per configuration. The primary measure was the Spearman correlation (ρ) between human and machine facility on 828 complete paired items. We examined sensitivity to panel composition, scoring, pooling, and assumed reliability; compared distractor choices with a post hoc plausibility-weighted baseline; and evaluated a surface-feature classifier. Image analyses distinguished supplied from withheld images. An exploratory LLM-judge audit assessed generated explanations. Bootstrap CIs resample items or, for distractor concordance, error events; they exclude run-to-run uncertainty. Results: The highest pooled accuracy was 94.8% (795/839); all 12 configurations answered 668 of 828 paired items correctly (80.7%). Scores clustered near the ceiling among the strongest configurations. Human and machine facility correlated at 0.40 (95% CI 0.34-0.45), with estimates of 0.31 to 0.40 across panel definitions and 0.39 (95% CI 0.33-0.45) after exam-stratified pooling. The observed correlation was lower than predicted by a specified one-axis simulation with a uniform model advantage (0.63; predictive interval 0.59 to 0.66; P <.001). Among 672 model errors, dominant human-distractor selection differed from the plausibility-weighted baseline by –1.25 percentage points (95% CI –4.53 to 2.19), compatible with no difference. Surface-feature accuracy was 34.4% (289/839), similar to selecting the longest option (34.6%, 290/839). The adjusted association with model correctness was uncertain (odds ratio [OR] 0.87, 95% CI 0.72-1.04). Image-associated accuracy was lower both when images were supplied (OR 0.33, 95% CI 0.21-0.53) and when withheld (OR 0.11, 95% CI 0.08-0.16). Conclusions: In this single 2026 cohort, high LLM scores coexisted with limited separation among the strongest configurations and moderate correspondence with human item difficulty. These findings caution against interpreting model scores as equivalent evidence of human competence. They do not establish clinical performance or invalidate the examinations for human candidates.