30 April 2024 in Expert Systems with Applications
Building a prediction model based on both real data and expert knowledge can be challenging. We experienced this difficulty in our context of predicting fall risk factors in the elderly, where two sources of data were available: hand-reported information from medical consultations and expert information from human specialists. As is often the case, the real data were incomplete and imbalanced, and the participation of medical experts required the selection of a kind of model they can understand. This article describes the steps followed in the construction and evaluation of the model, structured as a new framework. The proposed model is a Bayesian network (BN) built from expert knowledge and learning from a real data set, guided by both the understandability of the BN graph and the performance of the model to predict risk factors. The resulting Bayesian network model includes 90 variables to evaluate 10 actionable target risk factors. It demonstrated its potential compared to other classifiers in terms of prediction performance, whilst offering a higher degree of interpretability.
23 February 2025 in arXiv
Machine learning algorithms are used in diverse domains, many of which face significant challenges due to data imbalance. Studies have explored various approaches to address the issue, like data preprocessing, cost-sensitive learning, and ensemble methods. Generative Adversarial Networks (GANs) showed immense potential as a data preprocessing technique that generates good quality synthetic data. This study employs a systematic mapping methodology to analyze 3041 papers on GAN-based sampling techniques for imbalanced data sourced from four digital libraries. A filtering process identified 100 key studies spanning domains such as healthcare, finance, and cybersecurity. Through comprehensive quantitative analysis, this research introduces three categorization mappings as application domains, GAN techniques, and GAN variants used to handle the imbalanced nature of the data. GAN-based over-sampling emerges as an effective preprocessing method. Advanced architectures and tailored frameworks helped GANs to improve further in the case of data imbalance. GAN variants like vanilla GAN, CTGAN, and CGAN show great adaptability in structured imbalanced data cases. Interest in GANs for imbalanced data has grown tremendously, touching a peak in recent years, with journals and conferences playing crucial roles in transmitting foundational theories and practical applications. While with these advances, none of the reviewed studies explicitly explore hybridized GAN frameworks with diffusion models or reinforcement learning techniques. This gap leads to a future research idea develop innovative approaches for effectively handling data imbalance.