Minseong Kim

Minseong Kim

Auto-generated profile, based on publicly available information

Minseong Kim

Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 February 2026 in medRxiv
Verified
Preprint
Open access
PDF file
JSJi Woo Song
Ji Woo Song
MKMinseong Kim
Minseong Kim
CHChanhee Hong
Chanhee Hong
YKYoung Sam Kim
Young Sam Kim
JCJunho Cho
Junho Cho
CPChaeryoung PARK
Chaeryoung PARK
Background: Objective Structured Clinical Examination (OSCE; Clinical Performance Examination [CPX] in South Korea) is a high-stakes assessment of clinical performance, communication, and reasoning during time-limited patient encounters. As AI-enabled virtual standardized patient (VSP) simulation and automated scoring are introduced for OSCE-like training, prospective evidence is needed on how such systems perform and are perceived when embedded in real educational workflows. Methods: We developed CPX with Medical students’ Assistant for Training and Evaluation (CPX-MATE), a web-based platform integrating (1) CPX with Virtual Standardized Patient (CPX-VSP), real-time voice dialogue with a VSP using speech-to-speech (STS) models, and (2) CPX with Real-Time Evaluator (CPX-RTE), automated transcription, checklist-based scoring, and feedback from encounter audio using a Speech-to-Text model and a large language model. During an emergency medicine clerkship (Nov 2025-Jan 2026), 60 senior medical students completed two 12-min CPX encounters (VSP with acute pancreatitis; HSP with ureteral stone) with immediate CPX-RTE feedback. For CPX-VSP, students were assigned to either a full-capacity or a resource-limited STS configuration (n=30 each). Dialogue fidelity was evaluated by turn-by-turn analysis of student–VSP exchanges, classifying responses into clinically meaningful error types (tangential, oversharing, role-breaking, off-script). CPX-RTE performance was assessed by agreement (Gwet’s AC1) with professor real-time and resident video-based ratings using a 45-item checklist. Usability of CPX-VSP and CPX-RTE, with overall system usability scale (SUS), were surveyed, and mean per-session costs for CPX-VSP and CPX-RTE were calculated. Results: Across 3,282 dialogue turns, overall error rates were 1.77% versus 9.43% for full-capacity versus resource-limited STS configurations (p<0.001), driven by fewer tangential and oversharing responses; no off-script errors were observed. The mean per-session cost was $0.12 for resource-limited configuration and $0.78 for full-capacity configuration. CPX-RTE showed high agreement with human ratings (AC1=0.916 vs professor; 0.916 vs resident), with slightly different levels of agreement across four sections, and high usability across all domains (mean scores, 4.65–4.92), with a per-session cost of $0.17. CPX-MATE demonstrated good overall usability (median [IQR] of 77.5 [70.0-85.0]). Conclusions: Embedded within a prospective clinical clerkship, CPX-MATE demonstrated operational fidelity and human-level checklist agreement as an end-to-end, voice-based AI-assisted OSCE platform. This real-world deployment supports its scalable integration as a complementary assessment tool while highlighting the importance of systematic validation and context-aware implementation in medical education.

14 March 2026 in medRxiv
Verified
Preprint
Open access
PDF file
HKHanjae Kim
Hanjae Kim
MKMinseong Kim
Minseong Kim
SKSeonji Kim
Seonji Kim
SYSeng Chan You
Seng Chan You
Introduction: Implementing target trial emulation (TTE) study methods as end-to-end executable analytic code is technically demanding, and producing standardized, reproducible scripts consistently across research teams remains a persistent challenge. We aimed to develop a framework that translates free-text study descriptions into standardized analytic specifications and executable Strategus R scripts for the Observational Health Data Sciences and Informatics (OHDSI) ecosystem. Methods: We developed THESEUS (Text-guided Health-study Estimation and Specification Engine Using Strategus), which operates through two sequential steps. Large language models (LLMs) first map descriptions of the study into a constrained JavaScript Object Notation (JSON) schema (standardization step), after which the structured specifications are converted into R scripts with a self-auditing loop for error correction (code generation step). We evaluated eight proprietary LLMs using texts extracted from the methods section of 15 OHDSI-based TTE studies, and externally validated the framework on texts from 5 non-OHDSI studies, across three input settings: primary analysis text only, full analyses text, and full methods sections. Standardization was evaluated at the study-level (whether all parameters in a study were correctly extracted) and at the field-level (sensitivity and false positive rate per individual parameter) with field-level evaluation applied to the full analyses text and full methods sections input settings. Code generation was assessed by executability of the produced R scripts before and after self-auditing. Results: In the standardization step, study-level accuracy across models ranged from 0.91 to 0.98 for primary analysis, 0.67 to 0.87 for full analyses, and 0.67 to 0.85 for full methods sections in OHDSI studies, whereas the corresponding ranges were 0.73 to 0.93, 0.60 to 0.87, and 0.27 to 0.47 in non-OHDSI studies. At the field-level, sensitivity across models under the full analyses text input setting ranged from 0.73 to 0.90 with 0.27 to 0.67 false positives per study in OHDSI studies, and from 0.71 to 0.90 with 0.20 to 1.00 false positives per study in non-OHDSI studies, depending on input setting. For code generation, first-run executability ranged from 0.80 to 1.00 for OHDSI studies and improved to 0.93 to 1.00 after self-auditing. In non-OHDSI studies, first-run executability ranged from 0.60 to 1.00, improving to 1.00 after self-auditing. Discussion: THESEUS demonstrates that pairing a standardized data model with a structured analysis framework enables reliable LLM-powered automation of the coding step in observational research. THESEUS supports the reliable translation of natural-language study descriptions into executable, shareable code in standardized observational research settings. This approach has the potential to lower the technical barriers to participation in observational research for a broader range of investigators.

25 June 2026 in Journal of Biomedical Informatics
Verified
Journal Article
Open access
SLSumin Lee
Sumin Lee
KJKyulee Jeon
Kyulee Jeon
JLJoon Seok Lim
Joon Seok Lim
YPYiju Park
Yiju Park
MKMin Seong Kim
Min Seong Kim
SYSeng Chan You
Seng Chan You
To develop an ontology-driven framework that standardizes heterogeneous local radiology procedure names by decomposing them into semantic components and aligning them to LOINC/RSNA Radiology Playbook codes using constrained large language model (LLM)-based parsing and selection. Radiology procedure names from two tertiary hospitals in Korea were parsed into semantic components using LLM prompting with retrieval-augmented generation, aligned with the LOINC/RSNA Radiology Playbook (version 2.80). Ontology-based similarity scoring quantify correspondence between parsed components and Playbook candidates' attributes, and retrieve the Top 10 candidates, followed by LLM-based selection within this candidate set. Performance was evaluated against direct Playbook code name-based mapping and conventional similarity metrics using a radiologist-curated gold reference. A total of 3,326 local procedure names were analyzed. Ontology-based mapping approach substantially outperformed direct Playbook code name mapping across all evaluation metrics. At the candidate retrieval stage, ontology-based attribute matching achieved recall@5 of up to 0.78 (internal) and 0.89 (external), compared with 0.51 and 0.47 for direct mapping. After LLM-based selection, the ontology-based approach achieved a final selection recall@1 of up to 0.70 (internal) and 0.81 (external), exceeding direct mapping (0.48 and 0.50) more than 20 percentage points in both settings (p < 0.001). Decomposing procedure names into ontology-grounded semantic components enables robust handling of heterogeneous local terminology, while constraining LLM reasoning to structured selection tasks mitigates hallucination and preserves semantic fidelity. Ontology-driven knowledge encoding provides a scalable and reliable approach to standardizing radiology procedure names, supporting cross-institutional interoperability and secondary data use of imaging research.