Emotional awareness is vital for advanced interactions between humans and computer systems. This paper introduces a new multimodal dataset called MERTI-Apps based on Asian physiological signals and proposes a genetic algorithm (GA)—long short-term memory (LSTM) deep learning model to derive the active feature groups for emotion recognition. This study developed an annotation labeling program for observers to tag the emotions of subjects by their arousal and valence during dataset creation. In the learning phase, a GA was used to select effective LSTM model parameters and determine the active feature group from 37 features and 25 brain lateralization features extracted from the electroencephalogram (EEG) time, frequency, and time–frequency domains. The proposed model achieved a root-mean-square error (RMSE) of 0.0156 in terms of the valence regression performance in the MAHNOB-HCI dataset, and RMSE performances of 0.0579 and 0.0287 in terms of valence and arousal regression performance, and 65.7% and 88.3% in terms of valence and arousal accuracy in the in-house MERTI-Apps dataset, which uses Asian-population-specific 12-channel EEG data and adds an additional brain lateralization (BL) feature. The results revealed 91.3% and 94.8% accuracy in the valence and arousal domain in the DEAP dataset owing to the effective model selection of a GA.
Currently, the existing vehicle-centric semi-autonomous driving modules do not consider the driver’s situation and emotions. In an autonomous driving environment, when changing to manual driving, human–machine interface and advanced driver assistance systems (ADAS) are essential to assist vehicle driving. This study proposes a human–machine interface that considers the driver’s situation and emotions to enhance the ADAS. A 1D convolutional neural network model based on multimodal bio-signals is used and applied to control semi-autonomous vehicles. The possibility of semi-autonomous driving is confirmed by classifying four driving scenarios and controlling the speed of the vehicle. In the experiment, by using a driving simulator and hardware-in-the-loop simulation equipment, we confirm that the response speed of the driving assistance system is 351.75 ms and the system recognizes four scenarios and eight emotions through bio-signal data.
This paper proposes a unified deep-learning framework for fault and performance prediction in communication equipment by utilizing spatiotemporal geometric features. The core methodology, Spatio-Temporal Slope Feature Extraction (STSFE), transforms irregular time-series data into slope-, area-, and volume-based representations, capturing both temporal dynamics and spatial correlations. We develop three distinct yet structurally aligned prediction models: 1) passive MUX fault classification, 2) SFP port-level fault detection, and 3) regression-based forecasting of Rx signal degradation. All models employ a multi-branch neural architecture that integrates MLP, CNN, and attention mechanisms, along with customized loss functions designed to enhance sensitivity to tail-zone deviations. To evaluate the generalization capability of the proposed framework, we conduct a comparative analysis using the NASA Battery dataset, which is reshaped via STSFE to emulate industrial signal characteristics. Experimental results demonstrate that our models outperform existing approaches in terms of classification accuracy, mean absolute error, and tail prediction performance. This research provides a flexible and robust methodology for predictive maintenance across diverse time-series domains in industrial communication networks.
About Me
I am a graduate student attending Inha University.
I am a graduate student attending Inha University.