Nicole Ledwos

Nicole Ledwos

Auto-generated profile, based on publicly available information

Nicole Ledwos

Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 February 2020 in PLOS ONE
Verified
Journal Article
Open access
PDF file
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
RYRecai Yilmaz
Recai Yilmaz
NLNicole Ledwos
Nicole Ledwos
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RMRolando F Del Maestro
Rolando F Del Maestro
Simulation-based training is increasingly being used for assessment and training of psychomotor skills involved in medicine. The application of artificial intelligence and machine learning technologies has provided new methodologies to utilize large amounts of data for educational purposes. A significant criticism of the use of artificial intelligence in education has been a lack of transparency in the algorithms’ decision-making processes. This study aims to 1) introduce a new framework using explainable artificial intelligence for simulation-based training in surgery, and 2) validate the framework by creating the Virtual Operative Assistant, an automated educational feedback platform. Twenty-eight skilled participants (14 staff neurosurgeons, 4 fellows, 10 PGY 4–6 residents) and 22 novice participants (10 PGY 1–3 residents, 12 medical students) took part in this study. Participants performed a virtual reality subpial brain tumor resection task on the NeuroVR simulator using a simulated ultrasonic aspirator and bipolar. Metrics of performance were developed, and leave-one-out cross validation was employed to train and validate a support vector machine in Matlab. The classifier was combined with a unique educational system to build the Virtual Operative Assistant which provides users with automated feedback on their metric performance with regards to expert proficiency performance benchmarks. The Virtual Operative Assistant successfully classified skilled and novice participants using 4 metrics with an accuracy, specificity and sensitivity of 92, 82 and 100%, respectively. A 2-step feedback system was developed to provide participants with an immediate visual representation of their standing related to expert proficiency performance benchmarks. The educational system outlined establishes a basis for the potential role of integrating artificial intelligence and virtual reality simulation into surgical educational teaching. The potential of linking expertise classification, objective feedback based on proficiency benchmarks, and instructor input creates a novel educational tool by integrating these three components into a formative educational paradigm.

1 November 2019 in Journal of Surgical Education
Verified
Journal Article
Closed access
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
VBVincent Bissonnette
Vincent Bissonnette
NMNykan Mirchi
Nykan Mirchi
NPNirros Ponnudurai
Nirros Ponnudurai
RYRecai Yilmaz
Recai Yilmaz
RMRolando F. Del Maestro
Rolando F. Del Maestro

2 August 2019 in JAMA Network Open
Verified
Journal Article
Open access
PDF file
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RYRecai Yilmaz
Recai Yilmaz
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
NLNicole Ledwos
Nicole Ledwos
RMRolando Del Maestro
Rolando Del Maestro
Despite technological advances in artificial intelligence and machine learning, delivery of health care is mediated largely by direct interaction between physician and patient. This scenario is particularly true for surgical interventions, which carry substantive patient risks and increased costs to health care systems.1 As a consequence, the burgeoning field of surgical data science represents efforts to improve interventional health care through increased data collection, quantification, and analysis.2 Similarly, the use of virtual reality simulators has been explored as a means of providing objective assessment of technical ability in medicine, with the added benefit of retaining realism, pathology, and active bleeding states in a controlled laboratory setting. These systems generate vast data sets that quickly challenge traditional statistical methods. Artificial intelligence and machine learning systems lend themselves well to the analysis of large data sets generated in surgical procedures in 2 important ways: first, by uncovering previously unrecognized patterns, they can expand the understanding of the composites of technical expertise and surgical error, and second, by grouping participants according to technical ability, they offer novel avenues for training and feedback in health care.

20 September 2019 in Journal of Bone and Joint Surgery
Verified
Journal Article
Open access
VBVincent Bissonnette
Vincent Bissonnette
NMNykan Mirchi
Nykan Mirchi
NLNicole Ledwos
Nicole Ledwos
GAGhusn Alsidieri
Ghusn Alsidieri
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
OCOn Behalf Of The Neurosurgical Simulation & Artificial Intelligence Learning Centre
On Behalf Of The Neurosurgical Simulation & Artificial Intelligence Learning Centre
Background: With the emergence of competency-based training, the current evaluation scheme of surgical skills is evolving to include newer methods of assessment and training. Artificial intelligence through machine learning algorithms can utilize extensive data sets to analyze operator performance. This study aimed to address 3 questions: (1) Can artificial intelligence uncover novel metrics of surgical performance? (2) Can support vector machine algorithms be trained to differentiate “senior” and “junior” participants who are executing a virtual reality hemilaminectomy? (3) Can other algorithms achieve a good classification performance? Methods: Participants from 4 Canadian universities were divided into 2 groups according to their training level (senior and junior) and were asked to perform a virtual reality hemilaminectomy. The position, angle, and force application of the simulated burr and suction instruments, along with tissue volumes that were removed, were recorded at 20-ms intervals. Raw data were manipulated to create metrics to train machine learning algorithms. Five algorithms, including a support vector machine, were trained to predict whether the task was performed by a senior or junior participant. The accuracy of each algorithm was assessed through leave-one-out cross-validation. Results: Forty-one individuals were enrolled (22 senior and 19 junior participants). Twelve metrics related to safety of the procedure, efficiency, motion of the tools, and coordination were selected. Following cross-validation, the support vector machine achieved a 97.6% accuracy. The other algorithms achieved accuracy of 92.7%, 87.8%, 70.7%, and 65.9%, respectively. Conclusions: Artificial intelligence defined novel metrics of surgical performance and outlined training levels in a virtual reality spinal simulation procedure. Clinical Relevance: The significance of these results lies in the potential of artificial intelligence to complement current educational paradigms and better prepare residents for surgical procedures.

13 December 2019 in Operative Neurosurgery
Verified
Journal Article
Closed access
PDF file
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
NLNicole Ledwos
Nicole Ledwos
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RYRecai Yilmaz
Recai Yilmaz
RMRolando F Del Maestro
Rolando F Del Maestro
BACKGROUND: Virtual reality surgical simulators provide a safe environment for trainees to practice specific surgical scenarios and allow for self-guided learning. Artificial intelligence technology, including artificial neural networks, offers the potential to manipulate large datasets from simulators to gain insight into the importance of specific performance metrics during simulated operative tasks. OBJECTIVE: To distinguish performance in a virtual reality-simulated anterior cervical discectomy scenario, uncover novel performance metrics, and gain insight into the relative importance of each metric using artificial neural networks. METHODS: Twenty-one participants performed a simulated anterior cervical discectomy on the novel virtual reality Sim-Ortho simulator. Participants were divided into 3 groups, including 9 post-resident, 5 senior, and 7 junior participants. This study focused on the discectomy portion of the task. Data were recorded and manipulated to calculate metrics of performance for each participant. Neural networks were trained and tested and the relative importance of each metric was calculated. RESULTS: A total of 369 metrics spanning 4 categories (safety, efficiency, motion, and cognition) were generated. An artificial neural network was trained on 16 selected metrics and tested, achieving a training accuracy of 100% and a testing accuracy of 83.3%. Network analysis identified safety metrics, including the number of contacts on spinal dura, as highly important. CONCLUSION: Artificial neural networks classified 3 groups of participants based on expertise allowing insight into the relative importance of specific metrics of performance. This novel methodology aids in the understanding of which components of surgical performance predominantly contribute to expertise.

24 September 2020 in Operative Neurosurgery
Verified
Journal Article
Closed access
PDF file
NLNicole Ledwos
Nicole Ledwos
NMNykan Mirchi
Nykan Mirchi
VBVincent Bissonnette
Vincent Bissonnette
AWAlexander Winkler-Schwartz
Alexander Winkler-Schwartz
RYRecai Yilmaz
Recai Yilmaz
RMRolando F Del Maestro
Rolando F Del Maestro
BACKGROUND: Virtual reality spine simulators are emerging as potential educational tools to assess and train surgical procedures in safe environments. Analysis of validity is important in determining the educational utility of these systems. OBJECTIVE: To assess face, content, and construct validity of a C4-C5 anterior cervical discectomy and fusion simulation on the Sim-Ortho virtual reality platform, developed by OSSimTech TM (Montreal, Canada) and the AO Foundation (Davos, Switzerland). METHODS: Spine surgeons, spine fellows, along with neurosurgical and orthopedic residents, performed a simulated C4-C5 anterior cervical discectomy and fusion on the Sim-Ortho system. Participants were separated into 3 categories: post-residents (spine surgeons and spine fellows), senior residents, and junior residents. A Likert scale was used to assess face and content validity. Construct validity was evaluated by investigating differences between the 3 groups on metrics derived from simulator data. The Kruskal-Wallis test was employed to compare groups and a post-hoc Dunn's test with a Bonferroni correction was utilized to investigate differences between groups on significant metrics. RESULTS: A total of 21 individuals were included: 9 post-residents, 5 senior residents, and 7 junior residents. The post-resident group rated face and content validity, median ≥4, for the overall procedure and at least 1 tool in each of the 4 steps. Significant differences ( P < .05) were found between the post-resident group and senior and/or junior residents on at least 1 metric for each component of the simulation. CONCLUSION: The C4-C5 anterior cervical discectomy and fusion simulation on the Sim-Ortho platform demonstrated face, content, and construct validity suggesting its utility as a formative educational tool.