13 December 2022 in Granular Computing
19 April 2023 in IEEE Access
Electroencephalography (EEG)-based emotion recognition is gaining increasing importance due to its potential applications in various scientific fields, ranging from psychophysiology to neuromarketing. A number of approaches have been proposed that use machine learning (ML) technology to achieve high recognition performance, which relies on engineering features from brain activity dynamics. Since ML performance can be improved by utilizing 2D feature representation that exploits the spatial relationships among the features, here we propose a novel input representation that involves re-arranging EEG features as an image that reflects the top view of the subject’s scalp. This approach enables emotion recognition through image-based ML methods such as pre-trained deep neural networks or "trained-from-scratch" convolutional neural networks. We have employed both of these techniques in our study to demonstrate the effectiveness of our proposed input representation. We also compare the recognition performance of these methods against state-of-the-art tabular data analysis approaches, which do not utilize the spatial relationships between the sensors. We test our proposed approach using two publicly available benchmark datasets for EEG-based emotion recognition tasks, namely DEAP and MAHNOB-HCI. Our results show that the "trained-from-scratch" convolutional neural network outperforms the best approaches in the literature, achieving 97.8% and 98.3% accuracy in valence and arousal classification on MAHNOB-HCI, and 91% and 90.4% on DEAP, respectively.
10 February 2025 in Physiological Measurement
Objective. Sleep staging is a crucial task in clinical and research contexts for diagnosing and understanding sleep disorders. This work introduces PhysioEx (Physiological Signal Explainer), a Python library designed to support the analysis of sleep stages using deep learning (DL) and Explainable AI (XAI). Approach. PhysioEx provides an extensible and modular API for standardizing and automating the sleep staging pipeline, covering data preprocessing, model training, testing, fine-tuning, and explainability. It supports both low-resource devices and high-performance computing clusters and includes pretrained models based on the Sleep Heart Health Study dataset. These models support single-channel EEG and multichannel EEG-EOG-EMG configurations and are easily adaptable to custom datasets. PhysioEx also features a command-line interface toolbox allowing users to streamline the model development and deployment. The library offers a range of XAI post-hoc methods to explain model decisions and align them with expert knowledge. Main results. PhysioEx benchmark state-of-the-art sleep staging models in a standard pipeline. Enabling a fair comparison between them both on the training source and out-of-domain sources. Its XAI techniques provide insights into DL-based sleep staging by linking model decisions to human-understandable concepts, such as American Academy of Sleep Medicine-defined rules. Significance. PhysioEx addresses the need for a standardized and accessible platform for sleep staging analysis, combining DL and XAI. By supporting modular workflows and explainable insights, it bridges the gap between machine learning models and clinical expertise. PhysioEx is publicly available and installable via pip6 6 https://pypi.org/project/physioex/. , making it a valuable tool for researchers and practitioners in sleep medicine.
29 March 2024 in SN Computer Science
Utilizing machine learning technologies to monitor assets’ health conditions can improve the effectiveness of maintenance activities. However, accurately recognizing the current health degradation stages of industrial assets requires a time-consuming manual feature extraction due to the wide range of observable measures (e.g., temperature, vibration) and behaviors characterizing assets’ degradation. To address this issue, feature learning technology can transform minimally processed time series into informative features, i.e., able to simplify the classification task (e.g., recognizing degradation stages) regardless of the specific machine learning classifier employed. In this work, minimally preprocessed time series of vibration and temperature of industrial bearings are exploited by an autoencoder-based architecture to extract degradation-representative features to be used for recognizing their degradation stages. Different autoencoder architectures are employed to compare their data fusion strategies. The effectiveness of the proposed approach is evaluated in terms of recognition performance and the quality of the learned features by using a publicly available real-world dataset and comparing the proposed approach against a state-of-the-art feature learning technology. We tested three different multimodal autoencoder-based feature learning approaches, i.e., shared-input autoencoder (SAE), multimodal autoencoder (MMAE), and partition-based autoencoder (PAE). All the AE-based architecture results in classification performances greater or comparable with the state-of-the-art feature learning technology, despite being trained in an unsupervised fashion. Also, the features provided via PAE correspond to the greatest performances in recognizing bearings’ degradation stage, providing high-quality features both from a classification and clustering perspective. Unsupervised feature learning methodologies based on multimodal autoencoders are capable of learning high-quality features. These result in greater degradation stages recognition performances when compared to supervised state-of-the-art feature learning technology. Also, this enables the correct representation of the expected progressive degradation of the bearing.
10 November 2025 in Machine Learning
AI-based emotion recognition approaches may benefit from the integration of multimodal data, but their explainability and validation is still a critical challenge. Indeed, the limited neurophysiological understanding of novel multimodal features, e.g. brain-heart interaction, can be insufficient to assess whether the AI-extracted physiological insights (i.e., the model explanations) accurately reflect the real underlying physiological processes. To validate the explanations obtained by an AI-based model in this context, we introduce a novel framework that autonomously identifies the optimal explanations for a black-box model used in emotion recognition. Our approach leverages a convolutional neural network to process BHI features, which are derived from EEG and HRV data and rearranged as images. A model-agnostic methodology is employed to extract local explanations, which are then dynamically evaluated to select the most accurate for representing specific emotional states. The effectiveness of the proposed framework is evaluated across multiple classification tasks, including up to 9-level arousal and valence emotion classification, as well as nine discrete emotions classification, using the MAHNOB-HCI and DEAP datasets. The system achieved remarkable accuracy levels, consistently reaching approximately 97–98% across all tasks. Furthermore, our dynamic selection framework revealed that Integrated Gradients outperformed other state-of-the-art explainable AI approaches in reliably capturing global explanations.