Steven Labkoff

Steven Labkoff

Auto-generated profile, based on publicly available information

Steven Labkoff

Division of Clinical Informatics, Beth Israel Deaconess Medical Center, 133 Brookline Avenue, HVMA Annex, Suite 2200, Boston, MA, 02215, United States, 1 617-278-8162

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 September 2024 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
SLSteven Labkoff
Steven Labkoff
BOBilikis Oladimeji
Bilikis Oladimeji
JKJoseph Kannry
Joseph Kannry
ASAnthony Solomonides
Anthony Solomonides
RLRussell Leftwich
Russell Leftwich
YQYuri Quintana
Yuri Quintana
Background: Integrating artificial intelligence (AI) in healthcare settings has the potential to benefit clinical decision-making. Addressing challenges such as ensuring trustworthiness, mitigating bias, and maintaining safety is paramount. The lack of established methodologies for pre- and post-deployment evaluation of AI tools regarding crucial attributes such as transparency, performance monitoring, and adverse event reporting makes this situation challenging. Objectives: This paper aims to make practical suggestions for creating methods, rules, and guidelines to ensure that the development, testing, supervision, and use of AI in clinical decision support (CDS) systems are done well and safely for patients. Materials and Methods: In May 2023, the Division of Clinical Informatics at Beth Israel Deaconess Medical Center and the American Medical Informatics Association co-sponsored a working group on AI in healthcare. In August 2023, there were 4 webinars on AI topics and a 2-day workshop in September 2023 for consensus-building. The event included over 200 industry stakeholders, including clinicians, software developers, academics, ethicists, attorneys, government policy experts, scientists, and patients. The goal was to identify challenges associated with the trusted use of AI-enabled CDS in medical practice. Key issues were identified, and solutions were proposed through qualitative analysis and a 4-month iterative consensus process. Results: Our work culminated in several key recommendations: (1) building safe and trustworthy systems; (2) developing validation, verification, and certification processes for AI-CDS systems; (3) providing a means of safety monitoring and reporting at the national level; and (4) ensuring that appropriate documentation and end-user training are provided. Discussion: AI-enabled Clinical Decision Support (AI-CDS) systems promise to revolutionize healthcare decision-making, necessitating a comprehensive framework for their development, implementation, and regulation that emphasizes trustworthiness, transparency, and safety. This framework encompasses various aspects including model training, explainability, validation, certification, monitoring, and continuous evaluation, while also addressing challenges such as data privacy, fairness, and the need for regulatory oversight to ensure responsible integration of AI into clinical workflow. Conclusions: Achieving responsible AI-CDS systems requires a collective effort from many healthcare stakeholders. This involves implementing robust safety, monitoring, and transparency measures while fostering innovation. Future steps include testing and piloting proposed trust mechanisms, such as safety reporting protocols, and establishing best practice guidelines.

19 June 2025 in International Journal of Medical Informatics
Verified
Journal Article
Open access
LRLeon Rozenblit
Leon Rozenblit
APAmy Price
Amy Price
ASAnthony Solomonides
Anthony Solomonides
AJAmanda L. Joseph
Amanda L. Joseph
EKEileen Koski
Eileen Koski
YQYuri Quintana
Yuri Quintana
The rapid integration of artificial intelligence (AI) into healthcare presents significant governance challenges, requiring balanced approaches that safeguard safety, efficacy, equity, and trust (SEET). This study proposes a cognitive framework to guide AI governance, addressing tradeoffs between speed, scope, and capability. To develop a structured governance model that harmonizes stakeholder perspectives, focusing on multi-dimensional challenges and ethical principles essential for AI in healthcare. A multidisciplinary team convened at the Blueprints for Trust conference, organized by the American Medical Informatics Association (AMIA), and the Division of Clinical Informatics at Beth Israel Deaconess Medical Center. Following extensive discussions with 190 participants across sectors, three governance models were identified to address specific domains: (1) Clinical Decision Support (CDS), (2) Real-World Evidence (RWE), (3) Consumer Health (CH). Three governance models emerged, tailored to CDS, RWE, and CH domains. Key recommendations include establishing a Health AI Consumer Consortium for patient-centered oversight, initiating voluntary accreditation and certification frameworks, and piloting risk-level-based standards. These models balance rapid adaptation with SEET-focused safeguards through transparency, inclusivity, and ongoing learning. A proactive, constraint-based governance framework is critical for responsible AI integration in healthcare. This structured, multi-stakeholder approach provides a roadmap for ethical, transparent governance that can evolve with technological advancements, enhancing trust and safety in healthcare AI applications.

22 November 2024 in International Journal of Medical Informatics
Verified
Journal Article
Closed access
LRLeon Rozenblit
Leon Rozenblit
APAmy Price
Amy Price
ASAnthony Solomonides
Anthony Solomonides
AJAmanda L. Joseph
Amanda L. Joseph
GSGyana Srivastava
Gyana Srivastava
YQYuri Quintana
Yuri Quintana

23 February 2024 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
SLSteven E Labkoff
Steven E Labkoff
YQYuri Quintana
Yuri Quintana
LRLeon Rozenblit
Leon Rozenblit
Objective: The increasing demands for curated, high-quality research data are driving the emergence of a novel registry type. The need to assemble, curate, and export this data grows, and the conventional simplicity of registry models is driving the need for advanced, multimodal data registries—the dawn of the next-generation registry. Materials and methods: The article provides an outline of the technology roles and responsibilities needed for successful implementations of next-generation registries. Results: We propose a framework for the planning, construction, maintenance, and sustainability of this new registry type. Discussion: A rubric of organizational, computational, and human resource needs is discussed in detail, backed by over 40 years of combined in-the-field experiences by the authors. Conclusions: A novel field, registry science, within the clinical research informatics domain, has arisen to offer its insights into conceiving, structuring, and sustaining this new breed of tools.

26 September 2025 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
EKEileen Koski
Eileen Koski
ADAmar Das
Amar Das
PHPei-Yun Sabrina Hsueh
Pei-Yun Sabrina Hsueh
ASAnthony Solomonides
Anthony Solomonides
AJAmanda L. Joseph
Amanda L. Joseph
YQYuri Quintana
Yuri Quintana
Background: The use of real-world data (RWD) in artificial intelligence (AI) applications for healthcare offers unique opportunities but also poses complex challenges related to interpretability, transparency, safety, efficacy, bias, equity, privacy, ethics, accountability, and stakeholder engagement. Methods: A multi-stakeholder expert panel comprising healthcare professionals, AI developers, policymakers, and other stakeholders was assembled. Their task was to identify critical issues and formulate consensus recommendations, focusing on the responsible use of RWD in healthcare AI. The panel’s work involved an in-person conference and workshop and extensive deliberations over several months. Results: The panel’s findings revealed several critical challenges, including the necessity for data literacy and documentation, the identification and mitigation of bias, privacy and ethics considerations, and the absence of an accountability structure for stakeholder management. To address these, the panel proposed a series of recommendations, such as the adoption of metadata standards for RWD sources, the development of transparency frameworks and instructional labels likened to “nutrition labels” for AI applications, the provision of cross-disciplinary training materials, the implementation of bias detection and mitigation strategies, and the establishment of ongoing monitoring and update processes. Conclusion: Guidelines and resources focused on the responsible use of RWD in healthcare AI are essential for developing safe, effective, equitable, and trustworthy applications. The proposed recommendations provide a foundation for a comprehensive framework addressing the entire lifecycle of healthcare AI, emphasizing the importance of documentation, training, transparency, accountability, and multi-stakeholder engagement.

5 November 2020 in Blood
Verified
Journal Article
Open access
SMShaadi Mehr
Shaadi Mehr
DADaniel Auclair
Daniel Auclair
MHMark Hamilton
Mark Hamilton
LRLeon Rozenblit
Leon Rozenblit
HCHearn Jay Cho
Hearn Jay Cho
SMSergey Miron
Sergey Miron
Title: Architecture of sample preparation and data governance of Immuno-genomic data collected from bone marrow and peripheral blood samples obtained from multiple myeloma patients In multiple myeloma (MM), the interactions between malignant plasma cells and the bone marrow microenvironment is crucial to fully understand tumor development, disease progression, and response to therapy. The core challenge in understanding those interactions has been the establishment of a standard process and a standard model for handling the data quality workflow and the underlying data models. Here we present the Platform (Figure 1), an integrated data flow architecture designed to create data inventory and process tracking protocols for multi-dimensional and multi-technology immune data files. This system has been designed to inventory and track peripheral blood and bone marrow samples from multiple myeloma subjects submitted for immune analysis under the MMRF Immune Atlas initiative (figure 2), and the processing and storage of Single Cell RNA-seq (scRNA-seq) and Mass Cytometry time-of-flight (CyTOF) data files derived from these immune analyses. While these methods have been previously applied on both tumor and immune populations in MM [2,3], this level of multi-institutional and multi-technology is unique. The Cloud Immune-Precision platform contains standardized protocols and bioinformatics workflows for the identification and categorization of immune cell populations and functional states based upon scRNA-seq gene signatures (ref: Bioinformatics manuscript in submission) and CyTOF protein signatures. Upon further expansion, it will contain high dimensional scRNAseq and CyTOF immune data from both bone marrow and peripheral blood samples from myeloma patients enrolled in the Multiple Myeloma Research Foundation (MMRF) CoMMpass study (NCT01454297) [1] (Figure 3). The architecture covers the automation of data governance protocols, data transformation and ETL model developments that will create an immune proteomic and profiling database and its integration into clinical and genomics databases: e.g. the MMRF CoMMpass clinical trial. This large-scale data integration will establish a cutting-edge Immune-Precision central platform supporting large scale, immune-focused advanced analytics in multiple myeloma patients. This platform will allow researchers to interrogate the relationships between immune transcriptomic and proteomic signatures and tumor genomic features, and their impact on clinical outcomes, to aid in the optimization of therapy and therapeutic sequencing. Furthermore, this platform also promotes the potential to (further) elucidate the mechanisms-of-action of approved and experimental myeloma therapies, drive biomarker discovery, and identify new targets for drug discovery. Figure 1: Cloud Immune-Precision Platform (Integrated data flow architecture designed to create data inventory and process tracking protocols for multi-dimensional and multi-technology immune data files) Figure 2: Sample tracking process architecture Figure 3: Data file creation and repository process tracking References: 1- Settino, Marzia et al. "MMRF-CoMMpass Data Integration and Analysis for Identifying Prognostic Markers." Computational Science - ICCS 2020: 20th International Conference, Amsterdam, The Netherlands, June 3-5, 2020, Proceedings, Part III vol. 12139 564-571. 22 May. 2020, doi:10.1007/978-3-030-50420-5_42 2- Ledergor, Guy et al. "Single cell dissection of plasma cell heterogeneity in symptomatic and asymptomatic myeloma." Nature medicine vol. 24,12 (2018): 1867-1876. doi:10.1038/s41591-018-0269-2 3- Hansmann, Leo et al. "Mass cytometry analysis shows that a novel memory phenotype B cell is expanded in multiple myeloma." Cancer immunology research vol. 3,6 (2015): 650-60. doi:10.1158/2326-6066.CIR-14-0236-T Figure 1 Disclosures Bhasin: Canomiiks Inc: Current equity holder in private company, Other: Co-Founder. Dhodapkar:Amgen: Membership on an entity's Board of Directors or advisory committees, Other; Celgene/BMS: Membership on an entity's Board of Directors or advisory committees, Other; Janssen: Membership on an entity's Board of Directors or advisory committees, Other; Roche/Genentech: Membership on an entity's Board of Directors or advisory committees, Other; Lava Therapeutics: Membership on an entity's Board of Directors or advisory committees, Other; Kite: Membership on an entity's Board of Directors or advisory committees, Other.