Flow cytometric (FC) immunophenotyping is critical but time-consuming in diagnosing minimal residual disease (MRD). We evaluated whether human-in-the-loop artificial intelligence (AI) could improve the efficiency of clinical laboratories in detecting MRD in chronic lymphocytic leukemia (CLL). We developed deep neural networks (DNN) that were trained on a 10-color CLL MRD panel from treated CLL patients, including DNN trained on the full cohort of 202 patients (F-DNN) and DNN trained on 138 patients with low-event cases (MRD < 1000 events) (L-DNN). A hybrid DNN approach was utilized, with F-DNN and L-DNN applied sequentially to cases. “Ground truth” classification of CLL MRD was confirmed by expert analysis. The hybrid DNN approach demonstrated an overall accuracy of 97.1% (95% CI: 84.7–99.9%) in an independent cohort of 34 unknown samples. When CLL cells were reported as a percentage of total white blood cells, there was excellent correlation between the DNN and expert analysis [r > 0.999; Passing–Bablok slope = 0.997 (95% CI: 0.988–0.999) and intercept = 0.001 (95% CI: 0.000–0.001)]. Gating time was dramatically reduced to 12 s/case by DNN from 15 min/case by the manual process. The proposed DNN demonstrated high accuracy in CLL MRD detection and significantly improved workflow efficiency. Additional clinical validation is needed before it can be fully integrated into the existing clinical laboratory practice.

Background: Flow cytometric detection of minimal residual disease (MRD) in chronic lymphocytic leukemia (CLL) is complex, time-consuming, and subject to inter-operator variability. Deep neural networks (DNNs) offer potential for standardization and efficiency improvement, but require rigorous validation and monitoring for safe clinical implementation. Methods: We evaluated a DNN-assisted human-in-the-loop approach for CLL MRD detection. Initial validation included method comparison against manual analysis (n = 240), precision studies, and analytical sensitivity verification. Post-implementation monitoring comprised four components: daily electronic quality control, input data drift detection, error analysis, and attribute acceptance sampling. Laboratory efficiency was assessed through a timing study of 161 cases analyzed by five technologists. Results: Method comparison demonstrated 97.5% concordance with manual analysis for qualitative classification (sensitivity 100%, specificity 95%) and excellent correlation for quantitative assessment (r = 0.99, Deming slope = 0.99). Precision studies confirmed high repeatability and within-laboratory precision across multiple operators. Analytical sensitivity was verified at 0.002% MRD. Post-implementation monitoring identified 2.97% of cases (26/874) with input data drift, primarily high-burden CLL and non-CLL neoplasms. Error analysis showed the DNN alone achieved 97% sensitivity compared to human-in-the-loop-reviewed results, with 13 missed cases (1.5%) showing atypical immunophenotypes. Attribute acceptance sampling confirmed 98.8% of reported negative cases were true negatives. The DNN-assisted workflow reduced average analysis time by 60.3% compared to manual analysis (4.2 ± 2.3 vs. 10.5 ± 5.8 min). Conclusions: The implementation of a DNN-assisted approach for CLL MRD detection in a clinical laboratory provides diagnostic performance equivalent to expert manual analysis while substantially reducing analysis time. Comprehensive performance monitoring ensures ongoing safety and effectiveness in routine clinical practice. This approach provides a model for responsible AI integration in clinical laboratories, balancing automation benefits with expert oversight.

Background/Objectives: Acute myeloid leukemia (AML) is a biologically heterogeneous malignancy with a variable prognosis. Despite many patients achieving complete remission, relapse remains common, underscoring the need for effective prognostic markers. Measurable residual disease (MRD) has emerged as a critical prognostic indicator, associated with higher relapse risk and shorter survival. This study reports on our initial experience of MRD detection by flow cytometry in 385 bone marrow samples from 126 AML patients. Methods: The flow cytometry MRD assay, validated according to stringent consensus recommendations, consists of a 3-tube, 10-color panel incorporating a broad spectrum of lineage differentiation markers. Analytical specificity, sensitivity, precision, and reproducibility were evaluated, demonstrating the assay’s robustness. Results: The results reveal distinct immunophenotypic aberrancies in all AML cases, with consistent identification of aberrant immunophenotypes in follow-up specimens. AML MRD was detected in 32 out of 126 patients (25%) and in 77 out of 385 analyses (20%), with a median aberrant blast percentage of 1.87% (range, 0.01–12). A change in immunophenotype was documented in 21% of the MRD-positive cases. MRD positivity detected in the first sample studied was associated with reduced overall survival (HR: 5.153; p < 0.0001). Conclusions: Our findings support the integration of flow cytometric MRD analysis into routine clinical practice to enhance risk stratification and treatment planning for AML patients, as currently recommended by professional guidelines.