2 March 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Automated Machine Learning (AutoML) systems have been shown to efficiently build good models for new datasets. However, it is often not clear how well they can adapt when the data evolves over time. The main goal of this study is to understand the effect of concept drift on the performance of AutoML methods, and which adaptation strategies can be employed to make them more robust to changes in the underlying data. To that end, we propose 6 concept drift adaptation strategies and evaluate their effectiveness on a variety of AutoML approaches for building machine learning pipelines, including Bayesian optimization, genetic programming, and random search with automated stacking. These are evaluated empirically on real-world and synthetic data streams with different types of concept drift. Based on this analysis, we propose ways to develop more sophisticated and robust AutoML techniques.
6 December 2022 in Machine Learning
29 December 2014 in Expert Systems with Applications
17 October 2026 in npj Digital Medicine
Large Language Models (LLMs) may support clinicians by facilitating information management, but their usability in real-world oncology practice remains understudied. This study evaluated the workflow performance of Artificial Intelligence-based First Consultation Preparation (AI-FCP), generating structured summaries from unstructured clinical documentation, co-created with end users. In a prospective single‑group pre‑post design, nine clinicians completed a person-level baseline, followed by 33 consultations with AI-FCP. Case numbers varied by clinic scheduling and enrollment timing, potentially introducing survivorship bias. Usability was evaluated using validated questionnaires and study-specific instruments. Post AI-FCP, overall perceived workload (NASA-TLX) was 28.9% lower than baseline (Hodges-Lehmann estimate difference −12.3; 95% CI –21.7 to –3.3), with self-reported average time savings of 3.26 min (SD = 2.65) per case. Preparation succeeded in 84.9% of consultations; 63.6% of summaries were complete. These exploratory findings suggest clinicians perceived lower workload and reported improved workflow efficiency with AI-FCP. Further research is needed to determine generalizability.