In this paper, we present a multimodal dataset for affective computing research acquired in a human-computer interaction (HCI) setting. An experimental mobile and interactive scenario was designed and implemented based on a gamified generic paradigm for the induction of dialog-based HCI relevant emotional and cognitive load states. It consists of six experimental sequences, inducing Interest, Overload, Normal, Easy, Underload, and Frustration. Each sequence is followed by subjective feedbacks to validate the induction, a respiration baseline to level off the physiological reactions, and a summary of results. Further, prior to the experiment, three questionnaires related to emotion regulation (ERQ), emotional control (TEIQue-SF), and personality traits (TIPI) were collected from each subject to evaluate the stability of the induction paradigm. Based on this HCI scenario, the University of Ulm Multimodal Affective Corpus (uulmMAC), consisting of two homogenous samples of 60 participants and 100 recording sessions was generated. We recorded 16 sensor modalities including 4 × video, 3 × audio, and 7 × biophysiological, depth, and pose streams. Further, additional labels and annotations were also collected. After recording, all data were post-processed and checked for technical and signal quality, resulting in the final uulmMAC dataset of 57 subjects and 95 recording sessions. The evaluation of the reported subjective feedbacks shows significant differences between the sequences, well consistent with the induced states, and the analysis of the questionnaires shows stable results. In summary, our uulmMAC database is a valuable contribution for the field of affective computing and multimodal data analysis: Acquired in a mobile interactive scenario close to real HCI, it consists of a large number of subjects and allows transtemporal investigations. Validated via subjective feedbacks and checked for quality issues, it can be used for affective computing and machine learning applications.

Mental health promotion of economically disadvantaged youths is a popular issue in current China. Economically disadvantaged youths are at greater risk of depression. Ostracism may be an important predictor of depression for them. However, no consensus has been reached on the underlying mechanism between ostracism and depression. A total of 1207 economically disadvantaged youths were recruited from six universities in China. These youths were asked to complete questionnaires measuring depression, ostracism, psychological capital, and perceived social support. A moderated mediation model was examined by using IBM SPSS STATISTICS 27macro program PROCESS version 3.5, in which psychological capital was a mediating variable, and perceived social support was a moderating variable. Lack of causal inferences and self-report bias due to the cross-sectional and self-report survey need to be considered when interpreting results. The results revealed that ostracism was positively associated with depression among economically disadvantaged youths. Psychological capital partially mediated the association. Perceived social support moderated the indirect association between ostracism and depression via psychological capital among economically disadvantaged females. Training and intentional practice of psychological capital could be the core to develop the depression interventions targeting economically disadvantaged youths with experience of ostracism. Gender and perceived social support need to be considered in developing the interventions.

Affective computing and stress recognition from biosignals have a high potential in various medical applications such as early intervention, stress management and risk prevention, as well as monitoring individuals’ mental health. This paper presents an automated processing workflow for the psychophysiological recognition of emotion and stress states. Our proposed workflow allows the processing of biosignals in their raw state as obtained from wearable sensors. It consists of five stages: (1) Biosignal Preprocessing—raw data conversion and physiological data triggering, relevant information selection, artifact and noise filtering; (2) Feature Extraction—using different mathematical groups including amplitude, frequency, linearity, stationarity, entropy and variability, as well as cardiovascular-specific characteristics; (3) Feature Selection—dimension reduction and computation optimization using Forward Selection, Backward Elimination and Brute Force methods; (4) Affect Classification—machine learning using Support Vector Machine, Random Forest and k-Nearest Neighbor algorithms; (5) Model Validation—performance matrix computation using k-Cross, Leave-One-Subject-Out and Split Validations. All workflow stages are integrated into embedded functions and operators, allowing an automated execution of the recognition process. The next steps include further development of the algorithms and the integration of the developed tools into an easy-to-use system, thereby satisfying the needs of medical and psychological staff. Our automated workflow was evaluated using our uulmMAC database, previously developed for affective computing and machine learning applications in human–computer interaction.

In the area of affective computing, machine learning is used to recognize patterns in datasets based on extracted features. Feature selection is used to select the most relevant features from the large number of extracted features. Conventional feature selection methods are associated with a high computational cost depending on the classifier used. This paper presents a feature selection approach based on evolutionary algorithms using techniques inspired by natural evolution to optimize the computational process. Our method is implemented using an Optimize Selection operator from RapidMiner and is integrated within our previously developed workflow for affective computing and stress recognition from biosignals. The performance is evaluated based on the random forests classifier and a cross validation using our uulmMAC database for machine learning applications. Our proposed approach is faster than the forward selection method at similar recognition rates and does not stop at a local optimum, allowing a promising feature selection alternative in the field of affective computing.