In this study, an analysis of brain, cardiovascular and respiratory dynamics was conducted combining information-theoretic measures with the Network Physiology paradigm during different levels of mental stress. Starting from low invasive recordings of electroencephalographic, electrocardiographic, respiratory, and blood volume pulse signals, the dynamical activity of seven physiological systems was probed with one-second time resolution measuring the time series of the $\delta$ , $\theta$ , $\alpha$ and $\beta$ brain wave amplitudes, the cardiac period (RR interval), the respiratory amplitude, and the duration of blood pressure wave propagation (pulse arrival time, PAT). Synchronous 5-min windows of these time series, obtained from 18 subjects during resting wakefulness (REST), mental stress induced by mental arithmetic (MA) and sustained attention induced by serious game (SG), were taken to describe the dynamics of the nodes composing the observed physiological network. Network activity and connectivity were then assessed in the framework of information dynamics computing the new information generated by each node, the information dynamically stored in it, and the information transferred to it from the other network nodes. Moreover, the network topology was investigated using directed measures of conditional information transfer and assessing their statistical significance. We found that all network nodes dynamically produce and store significant amounts of information, with the new information being prevalent in the brain systems and the information storage being prevalent in the peripheral systems. The transition from REST to MA was associated with an increase of the new information produced by the respiratory signal time series (RESP), and that from MA to SG with a decrease of the new information produced by PAT. Each network node received a significant amount of information from the other nodes, with the highest amount transferred to RR and the lowest transferred to $\delta$ , $\theta$ , $\alpha$ and $\beta$ . The topology of the physiological network underlying such information transfer was node- and state-dependent, with the peripheral subnetwork showing interactions from RR to PAT and between RESP and RR, PAT consistently across states, the brain subnetwork resulting more connected during MA, and the subnetwork of brain–peripheral interactions involving different brain rhythms in the three states and resulting primarily activated during MA. These results have both physiological relevance as regards the interpretation of central and autonomic effects on cardiovascular and respiratory variability, and practical relevance as regards the identification of features useful for the automatic distinction of different mental states.

This paper presents the validation of a marker-less motion capture system used to evaluate the upper limb stress of subjects using exoskeletons for locomotion. The system fuses the human skeletonization provided by commercial 3D cameras with forces exchanged by the user to the ground through upper limbs utilizing instrumented crutches. The aim is to provide a low cost, accurate, and reliable technology useful to provide the trainer a quantitative evaluation of the impact of assisted gait on the subject without the need to use an instrumented gait lab. The reaction forces at the upper limbs’ joints are measured to provide a validation focused on clinically relevant quantities for this application. The system was used simultaneously with a reference motion capture system inside a clinical gait analysis lab. An expert user performed 20 walking tests using instrumented crutches and force platforms inside the observed volume. The mechanical model was applied to data from the system and the reference motion capture, and numerical simulations were performed to assess the internal joint reaction of the subject’s upper limbs. A comparison between the two results shows a root mean square error of less than 2% of the subject’s body weight.

Intelligent Assistive Technologies (IAT) spectrum is rapidly expanding and embody smart systems supporting assistive tasks in ambient assisted living. In this field, it has been developed a virtual assistant to help mild cognitive impaired subjects to carry out elementary food preparation. The system is composed of several modules that manage supportive animations and user actions recognition to develop a personalized assistant able to interact with him considering the user status and the environmental context. Main results are: action recognition among the reach, move, mix, tilt and grasp gestures of 85%; the development of sensor fusion module able to estimate the objects accuracies in real time taking into account the quality of fit; the development of contextualized animations that take into account objects location on the kitchen plane.

Any severe motor disability is a condition that limits the ability to interact with the environment, even the domestic one, caused by the loss of control over one’s mobility. This work presents RoboEYE, a power wheelchair designed to allow users to move easily and autonomously within their homes. To achieve this goal, an innovative, cost-effective and user-friendly control system was designed, in which a non-invasive eye tracker, a monitor, and a 3D camera represent some of the core elements. RoboEYE integrates functionalities from the mobile robotics field into a standard power wheelchair, with the main advantage of providing the user with two driving options and comfortable navigation. The most intuitive and direct modality foresees the continuous control of frontal and angular wheelchair velocities by gazing at different areas of the monitor. The second, semi-autonomous modality allows navigation toward a selected point in the environment by just pointing and activating the wished destination while the system autonomously plans and follows the trajectory that brings the wheelchair to that point. The purpose of this work was to develop the control structure and driving interface designs of the aforementioned driving modalities taking into account also uncertainties in gaze detection and other sources of uncertainty related to the components to ensure user safety. Furthermore, the driving modalities, in particular the semi-autonomous one, were modeled and qualified through numerical simulations and experimental verification by testing volunteers, who are regular users of standard electric wheelchairs, to verify the efficiency, reliability and safety of the proposed system for domestic use. RoboEYE resulted suitable for environments with narrow passages wider than 1 m, which is comparable with a standard domestic door and due to its properties with large commercialization potential.