Recai Yilmaz

Recai Yilmaz

Auto-generated profile, based on publicly available information

Recai Yilmaz

Division of Neurosurgery and Pediatrics, Children’s National Medical Center, Washington, DC, USA

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 February 2020 in PLOS ONE
Verified
Journal Article
Open access
PDF file
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
RYRecai Yilmaz
Recai Yilmaz
NLNicole Ledwos
Nicole Ledwos
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RMRolando F Del Maestro
Rolando F Del Maestro
Simulation-based training is increasingly being used for assessment and training of psychomotor skills involved in medicine. The application of artificial intelligence and machine learning technologies has provided new methodologies to utilize large amounts of data for educational purposes. A significant criticism of the use of artificial intelligence in education has been a lack of transparency in the algorithms’ decision-making processes. This study aims to 1) introduce a new framework using explainable artificial intelligence for simulation-based training in surgery, and 2) validate the framework by creating the Virtual Operative Assistant, an automated educational feedback platform. Twenty-eight skilled participants (14 staff neurosurgeons, 4 fellows, 10 PGY 4–6 residents) and 22 novice participants (10 PGY 1–3 residents, 12 medical students) took part in this study. Participants performed a virtual reality subpial brain tumor resection task on the NeuroVR simulator using a simulated ultrasonic aspirator and bipolar. Metrics of performance were developed, and leave-one-out cross validation was employed to train and validate a support vector machine in Matlab. The classifier was combined with a unique educational system to build the Virtual Operative Assistant which provides users with automated feedback on their metric performance with regards to expert proficiency performance benchmarks. The Virtual Operative Assistant successfully classified skilled and novice participants using 4 metrics with an accuracy, specificity and sensitivity of 92, 82 and 100%, respectively. A 2-step feedback system was developed to provide participants with an immediate visual representation of their standing related to expert proficiency performance benchmarks. The educational system outlined establishes a basis for the potential role of integrating artificial intelligence and virtual reality simulation into surgical educational teaching. The potential of linking expertise classification, objective feedback based on proficiency benchmarks, and instructor input creates a novel educational tool by integrating these three components into a formative educational paradigm.

1 November 2019 in Journal of Surgical Education
Verified
Journal Article
Closed access
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
VBVincent Bissonnette
Vincent Bissonnette
NMNykan Mirchi
Nykan Mirchi
NPNirros Ponnudurai
Nirros Ponnudurai
RYRecai Yilmaz
Recai Yilmaz
RMRolando F. Del Maestro
Rolando F. Del Maestro

2 August 2019 in JAMA Network Open
Verified
Journal Article
Open access
PDF file
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RYRecai Yilmaz
Recai Yilmaz
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
NLNicole Ledwos
Nicole Ledwos
RMRolando Del Maestro
Rolando Del Maestro
Despite technological advances in artificial intelligence and machine learning, delivery of health care is mediated largely by direct interaction between physician and patient. This scenario is particularly true for surgical interventions, which carry substantive patient risks and increased costs to health care systems.1 As a consequence, the burgeoning field of surgical data science represents efforts to improve interventional health care through increased data collection, quantification, and analysis.2 Similarly, the use of virtual reality simulators has been explored as a means of providing objective assessment of technical ability in medicine, with the added benefit of retaining realism, pathology, and active bleeding states in a controlled laboratory setting. These systems generate vast data sets that quickly challenge traditional statistical methods. Artificial intelligence and machine learning systems lend themselves well to the analysis of large data sets generated in surgical procedures in 2 important ways: first, by uncovering previously unrecognized patterns, they can expand the understanding of the composites of technical expertise and surgical error, and second, by grouping participants according to technical ability, they offer novel avenues for training and feedback in health care.

2 July 2024 in Scientific Reports
Verified
Journal Article
Open access
PDF file
RYRecai Yilmaz
Recai Yilmaz
MBMohamad Bakhaidar
Mohamad Bakhaidar
AAAhmad Alsayegh
Ahmad Alsayegh
NHNour Abou Hamdan
Nour Abou Hamdan
AFAli M. Fazlollahi
Ali M. Fazlollahi
RMRolando F. Del Maestro
Rolando F. Del Maestro
Trainees develop surgical technical skills by learning from experts who provide context for successful task completion, identify potential risks, and guide correct instrument handling. This expert-guided training faces significant limitations in objectively assessing skills in real-time and tracking learning. It is unknown whether AI systems can effectively replicate nuanced real-time feedback, risk identification, and guidance in mastering surgical technical skills that expert instructors offer. This randomized controlled trial compared real-time AI feedback to in-person expert instruction. Ninety-seven medical trainees completed a 90-min simulation training with five practice tumor resections followed by a realistic brain tumor resection. They were randomly assigned into 1-real-time AI feedback, 2-in-person expert instruction, and 3-no real-time feedback. Performance was assessed using a composite-score and Objective Structured Assessment of Technical Skills rating, rated by blinded experts. Training with real-time AI feedback (n = 33) resulted in significantly better performance outcomes compared to no real-time feedback (n = 32) and in-person instruction (n = 32), .266, [95% CI .107 .425], p < .001; .332, [95% CI .173 .491], p = .005, respectively. Learning from AI resulted in similar OSATS ratings (4.30 vs 4.11, p = 1) compared to in-person training with expert instruction. Intelligent systems may refine the way operating skills are taught, providing tailored, quantifiable feedback and actionable instructions in real-time.

13 December 2019 in Operative Neurosurgery
Verified
Journal Article
Closed access
PDF file
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
NLNicole Ledwos
Nicole Ledwos
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RYRecai Yilmaz
Recai Yilmaz
RMRolando F Del Maestro
Rolando F Del Maestro
BACKGROUND: Virtual reality surgical simulators provide a safe environment for trainees to practice specific surgical scenarios and allow for self-guided learning. Artificial intelligence technology, including artificial neural networks, offers the potential to manipulate large datasets from simulators to gain insight into the importance of specific performance metrics during simulated operative tasks. OBJECTIVE: To distinguish performance in a virtual reality-simulated anterior cervical discectomy scenario, uncover novel performance metrics, and gain insight into the relative importance of each metric using artificial neural networks. METHODS: Twenty-one participants performed a simulated anterior cervical discectomy on the novel virtual reality Sim-Ortho simulator. Participants were divided into 3 groups, including 9 post-resident, 5 senior, and 7 junior participants. This study focused on the discectomy portion of the task. Data were recorded and manipulated to calculate metrics of performance for each participant. Neural networks were trained and tested and the relative importance of each metric was calculated. RESULTS: A total of 369 metrics spanning 4 categories (safety, efficiency, motion, and cognition) were generated. An artificial neural network was trained on 16 selected metrics and tested, achieving a training accuracy of 100% and a testing accuracy of 83.3%. Network analysis identified safety metrics, including the number of contacts on spinal dura, as highly important. CONCLUSION: Artificial neural networks classified 3 groups of participants based on expertise allowing insight into the relative importance of specific metrics of performance. This novel methodology aids in the understanding of which components of surgical performance predominantly contribute to expertise.

26 April 2022 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
RYRecai Yilmaz
Recai Yilmaz
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
NMNykan Mirchi
Nykan Mirchi
ARAiden Reich
Aiden Reich
SCSommer Christie
Sommer Christie
RMRolando Del Maestro
Rolando Del Maestro
In procedural-based medicine, the technical ability can be a critical determinant of patient outcomes. Psychomotor performance occurs in real-time, hence a continuous assessment is necessary to provide action-oriented feedback and error avoidance guidance. We outline a deep learning application, the Intelligent Continuous Expertise Monitoring System (ICEMS), to assess surgical bimanual performance at 0.2-s intervals. A long-short term memory network was built using neurosurgeon and student performance in 156 virtually simulated tumor resection tasks. Algorithm predictive ability was tested separately on 144 procedures by scoring the performance of neurosurgical trainees who are at different training stages. The ICEMS successfully differentiated between neurosurgeons, senior trainees, junior trainees, and students. Trainee average performance score correlated with the year of training in neurosurgery. Furthermore, coaching and risk assessment for critical metrics were demonstrated. This work presents a comprehensive technical skill monitoring system with predictive validation throughout surgical residency training, with the ability to detect errors.