The Medical Device Regulation (MDR) in Europe aims to improve patient safety by increasing requirements, particularly for the clinical evaluation of medical devices. Before the clinical evaluation is initiated, a first literature review of existing clinical knowledge is necessary to decide how to proceed. However, small and medium-sized enterprises (SMEs) lacking the required expertise and funds may disappear from the market. Automating searches for the first literature review is both possible and necessary to accelerate the process and reduce the required resources. As a contribution to the prevention of the disappearance of SMEs and respective medical devices, we developed and tested two automated search methods with two SMEs, leveraging Medical Subject Headings (MeSH) terms and Bidirectional Encoder Representations from Transformers (BERT). Both methods were tailored to the SMEs and evaluated through a newly developed workflow that incorporated feedback resource-efficiently. Via a second evaluation with the established CLEF 2018 eHealth TAR dataset, the more general suitability of the search methods for retrieving relevant data was tested. In the real-world use case setting, the BERT-based method performed better with an average precision of 73.3%, while in the CLEF 2018 eHealth TAR evaluation, the MeSH-based search method performed better with a recall of 86.4%. Results indicate the potential of automated searches to provide device-specific relevant data from multiple databases while screening fewer documents than in manual literature searches.
Diagnosis of heart failure is complex but crucial for patient outcomes and often hindered by the untapped potential of unstructured clinical notes. We introduce a novel end-to-end pipeline for heart failure diagnosis, leveraging electronic health records (EHR) and German clinical notes from 846 patients. Our pipeline synthesizes abbreviation disambiguation, translation of German clinical notes to English, medical entity linking to SNOMED-CT, and subsequent classification. The classification was performed using a Support Vector Machine (SVM) and compared against a fine-tuned medBERT.de neural baseline. We reduced the reliance on training data with zero-shot learning to address limitations with abbreviation disambiguation and entity linking approaches. Validation against benchmark datasets and cardiologists demonstrates high accuracy for real clinical use. Abbreviation disambiguation achieved an accuracy of up to 96.1%. Entity linking achieved competitive performance compared to state-of-the-art approaches on selected evaluation datasets. The SVM classification approach utilizing SNOMED-CT concepts and EHR data achieved an F1-score of 65.3%, on par with the medBERT.de neural baseline using clinical notes and EHR data. Despite challenges regarding limited language-specific resources and reference dataset availability for SNOMED-CT annotations in German, our pipeline demonstrates high potential for real-world clinical use and clinical decision support grounded in the standardized SNOMED-CT ontology.
21 May 2026 in BMC Medical Informatics and Decision Making
Background: Reproducibility of computational algorithms is a challenging but crucial requirement for medical research and an important component of trustworthy training and application of AI algorithms. Federated Learning (FL) is commonly used to enable privacy-preserving AI in medical research. One prerequisite of reproducibility is traceability. A majority of publications on traceable FL platforms leverage blockchain technology to achieve traceable FL. In healthcare settings, resource-efficient alternatives to blockchains are possible; however, their traceability features require separate design considerations. Methods: To meet the growing demand for reproducible AI, as outlined in guidelines published by governing bodies such as the European Commission, we propose a novel concept TrainTracks. TrainTracks extends the established Personal Health Train (PHT) Platform for Analytics and Distributed Machine Learning for Enterprises (PADME) to support reproducible and traceable federated learning in medical research. PADME already partially supports tracing the FL and changes to the analysis algorithms used in the FL projects. We extend PADME by adding privacy-preserving change tracing of the data, metadata, and computational experiment execution through integrating it with the tools specialized in distributed data management (DataLad and MetaLad). Finally, we evaluate the proposed concept against the detailed list of requirements to analyze the advantages of the TrainTracks and the need for further design improvements. Results: Evaluation of the TrainTracks concepts’ compliance with a checklist for reproducible AI showed that TrainTracks improves the original PADME platform in 15 points out of 47 points applicable to FL. The greatest improvement was in data reproducibility, improving 10 of 12 points from no support to full support for automatic information extraction. No improvements were made to method reproducibility, aside from introducing a dedicated reproducibility repository. Experiment reproducibility saw upgrades in 5 of 30 applicable points, mainly through workflow and code traceability. Conclusions: Our concept of combining FL technology with a data versioning tool provides a structured, automated workflow that traces the FL algorithm itself, delivered algorithms, and the used data. TrainTracks demonstrated high compliance with recommendations for reproducible AI experiments, methods, and data. Our work emphasizes the importance of complete FL process traceability, as all considered aspects individually contribute to the reproducibility of the medical research. Tracking dataset versions in FL is crucial for dynamic application areas, such as medical research, where new data, e.g. electronic health records, are continuously recorded and added.
Federated learning (FL) enables privacy-preserving analytics on distributed healthcare data, but achieving transparency remains a critical challenge for trust and accountability. This scoping review focuses on traceability as a core component of transparency and systematically assesses traceability in FL within healthcare. Following the PRISMA-ScR methodology, we screened 125 articles across four databases, of which 53 met our inclusion criteria. Preliminary results show that 77.36% of articles rely on blockchain to support traceability, while only a small subset addresses healthcare applications, and comprehensive evaluation frameworks regarding traceability are largely lacking. Future research should explore the integration of blockchain in federated learning platforms in healthcare for traceability to enhance trust, auditability and accountability in clinical practice.