Stretchable, wireless health monitoring patches to evaluate heart rate, blood oximetry, UV exposure, and skin coloration.

Objective . Brain–computer interface (BCI) refers to procedures that link the central nervous system to a device. BCI was historically performed using electroencephalography (EEG). In the last years, encouraging results were obtained by combining EEG with other neuroimaging technologies, such as functional near infrared spectroscopy (fNIRS). A crucial step of BCI is brain state classification from recorded signal features. Deep artificial neural networks (DNNs) recently reached unprecedented complex classification outcomes. These performances were achieved through increased computational power, efficient learning algorithms, valuable activation functions, and restricted or back-fed neurons connections. By expecting significant overall BCI performances, we investigated the capabilities of combining EEG and fNIRS recordings with state-of-the-art deep learning procedures. Approach . We performed a guided left and right hand motor imagery task on 15 subjects with a fixed classification response time of 1 s and overall experiment length of 10 min. Left versus right classification accuracy of a DNN in the multi-modal recording modality was estimated and it was compared to standalone EEG and fNIRS and other classifiers. Main results . At a group level we obtained significant increase in performance when considering multi-modal recordings and DNN classifier with synergistic effect. Significance . BCI performances can be significantly improved by employing multi-modal recordings that provide electrical and hemodynamic brain activity information, in combination with advanced non-linear deep learning classification procedures.

Multimodal monitoring has become particularly common in the study of human brain function. In this context, combined, synchronous measurements of functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) are getting increased interest. Because of the absence of electro-optical interference, it is quite simple to integrate these two noninvasive recording procedures of brain activity. fNIRS and EEG are both scalp-located procedures. fNIRS estimates brain hemodynamic fluctuations relying on spectroscopic measurements, whereas EEG captures the macroscopic temporal dynamics of brain electrical activity through passive voltages evaluations. The “orthogonal” neurophysiological information provided by the two technologies and the increasing interest in the neurovascular coupling phenomenon further encourage their integration. This review provides, together with an introduction regarding the principles and future directions of the two technologies, an evaluation of major clinical and nonclinical applications of this flexible, low-cost combination of neuroimaging modalities. fNIRS–EEG systems exploit the ability of the two technologies to be conducted in an environment or experimental setting and/or on subjects that are generally not suited for other neuroimaging modalities, such as functional magnetic resonance imaging, positron emission tomography, and magnetoencephalography. fNIRS–EEG brain monitoring settles itself as a useful multimodal tool for brain electrical and hemodynamic activity investigation.

Over recent years, robots are increasingly being employed in several aspects of modern society. Among others, social robots have the potential to benefit education, healthcare, and tourism. To achieve this purpose, robots should be able to engage humans, recognize users’ emotions, and to some extent properly react and "behave" in a natural interaction. Most robotics applications primarily use visual information for emotion recognition, which is often based on facial expressions. However, the display of emotional states through facial expression is inherently a voluntary controlled process that is typical of human–human interaction. In fact, humans have not yet learned to use this channel when communicating with a robotic technology. Hence, there is an urgent need to exploit emotion information channels not directly controlled by humans, such as those that can be ascribed to physiological modulations. Thermal infrared imaging-based affective computing has the potential to be the solution to such an issue. It is a validated technology that allows the non-obtrusive monitoring of physiological parameters and from which it might be possible to infer affective states. This review is aimed to outline the advantages and the current research challenges of thermal imaging-based affective computing for human–robot interaction.