This paper presents an automatic ECG-based emotion recognition algorithm for human emotion recognition. First, we adopt a musical induction method to induce participants' real emotional states and collect their ECG signals without any deliberate laboratory setting. Afterward, we develop an automatic ECG-based emotion recognition algorithm to recognize human emotions elicited by listening to music. Physiological ECG features extracted from the time-, and frequency-domain, and nonlinear analyses of ECG signals are used to find emotion-relevant features and to correlate them with emotional states. Subsequently, we develop a sequential forward floating selection-kernel-based class separability-based (SFFS-KBCS-based) feature selection algorithm and utilize the generalized discriminant analysis (GDA) to effectively select significant ECG features associated with emotions and to reduce the dimensions of the selected features, respectively. Positive/negative valence, high/low arousal, and four types of emotions (joy, tension, sadness, and peacefulness) are recognized using least squares support vector machine (LS-SVM) recognizers. The results show that the correct classification rates for positive/negative valence, high/low arousal, and four types of emotion classification tasks are 82.78%, 72.91%, and 61.52%, respectively.

This paper presents a wearable inertial sensor network and its associated activity recognition algorithm for accurately recognizing human daily and sport activities. The proposed wearable inertial sensor network is composed of two wearable inertial sensing devices, which comprise a microcontroller, a triaxial accelerometer, a triaxial gyroscope, an RF wireless transmission module, and a power supply circuit. The activity recognition algorithm, consisting of procedures of motion signal acquisition, signal preprocessing, dynamic human motion detection, signal normalization, feature extraction, feature normalization, feature reduction, and activity recognition, has been developed to recognize human daily and sport activities by using accelerations and angular velocities. In order to reduce the computational complexity and improve the recognition rate simultaneously, we have utilized the nonparametric weighted feature extraction (NWFE) algorithm with the principal component analysis (PCA) method for reducing the feature dimensions of inertial signals. All 23 participants wore the wearable sensor network on their wrist and ankle to execute 10 common domestic activities in human daily lives and 11 sport activities in a laboratory environment, and their activity recordings were collected to validate the effectiveness of the proposed wearable inertial sensor network and activity recognition algorithm. Experimental results showed that our approach could achieve recognition rates for the 10 common domestic activities of 98.23% and 11 sport activities of 99.55% by the 10-fold cross-validation strategy, which have successfully validated the effectiveness of the proposed wearable inertial sensor network and its activity recognition algorithm.

Water is one of the most precious resources. However, industrial development has made water pollution a critical problem today and thus water quality monitoring and surface cleaning are essential for water resource protection. In this study, we have used the sensor fusion technology as a basis to develop a multi-function unmanned surface vehicle (MF-USV) for obstacle avoidance, water-quality monitoring, and water surface cleaning. The MF-USV comprises a USV control unit, a locomotion module, a positioning module, an obstacle avoidance module, a water quality monitoring system, a water surface cleaning system, a communication module, a power module, and a remote human–machine interface. We equip the MF-USV with the following functions: (1) autonomous obstacle detection, avoidance, and navigation positioning, (2) water quality monitoring, sampling, and positioning, (3) water surface detection and cleaning, and (4) remote navigation control and real-time information display. The experimental results verified that when the floating garbage located in the visual angle ranged from −30° to 30° on the front of the MF-USV and the distances between the floating garbage and the MF-USV were 40 and 70 cm, the success rates of floating garbage detection are all 100%. When the distance between the floating garbage and the MF-USV was 130 cm and the floating garbage was located on the left side (15°~30°), left front side (0°~15°), front side (0°), right front side (0°~15°), and the right side (15°~30°), the success rates of the floating garbage collection were 70%, 92%, 95%, 95%, and 75%, respectively. Finally, the experimental results also verified that the applications of the MF-USV and relevant algorithms to obstacle avoidance, water quality monitoring, and water surface cleaning were effective.

This paper presents a wearable inertial measurement system and its associated spatiotemporal gait analysis algorithm to obtain quantitative measurements and explore clinical indicators from the spatiotemporal gait patterns for patients with stroke or Parkinson's disease. The wearable system is composed of a microcontroller, a triaxial accelerometer, a triaxial gyroscope, and an RF wireless transmission module. The spatiotemporal gait analysis algorithm, consisting of procedures of inertial signal acquisition, signal preprocessing, gait phase detection, and ankle range of motion estimation, has been developed for extracting gait features from accelerations and angular velocities. In order to estimate accurate ankle range of motion, we have integrated accelerations and angular velocities into a complementary filter for reducing the accumulation of integration error of inertial signals. All 24 participants mounted the system on their foot to walk along a straight line of 10 m at normal speed and their walking recordings were collected to validate the effectiveness of the proposed system and algorithm. Experimental results show that the proposed inertial measurement system with the designed spatiotemporal gait analysis algorithm is a promising tool for automatically analyzing spatiotemporal gait information, serving as clinical indicators for monitoring therapeutic efficacy for diagnosis of stroke or Parkinson's disease.

This paper aims to develop a multisensor data fusion technology-based smart home system by integrating wearable intelligent technology, artificial intelligence, and sensor fusion technology. We have developed the following three systems to create an intelligent smart home environment: (1) a wearable motion sensing device to be placed on residents’ wrists and its corresponding 3D gesture recognition algorithm to implement a convenient automated household appliance control system; (2) a wearable motion sensing device mounted on a resident’s feet and its indoor positioning algorithm to realize an effective indoor pedestrian navigation system for smart energy management; (3) a multisensor circuit module and an intelligent fire detection and alarm algorithm to realize a home safety and fire detection system. In addition, an intelligent monitoring interface is developed to provide in real-time information about the smart home system, such as environmental temperatures, CO concentrations, communicative environmental alarms, household appliance status, human motion signals, and the results of gesture recognition and indoor positioning. Furthermore, an experimental testbed for validating the effectiveness and feasibility of the smart home system was built and verified experimentally. The results showed that the 3D gesture recognition algorithm could achieve recognition rates for automated household appliance control of 92.0%, 94.8%, 95.3%, and 87.7% by the 2-fold cross-validation, 5-fold cross-validation, 10-fold cross-validation, and leave-one-subject-out cross-validation strategies. For indoor positioning and smart energy management, the distance accuracy and positioning accuracy were around 0.22% and 3.36% of the total traveled distance in the indoor environment. For home safety and fire detection, the classification rate achieved 98.81% accuracy for determining the conditions of the indoor living environment.

This paper develops a wearable sport activity classification system and its associated deep learning-based sport activity classification algorithm for accurately recognizing sport activities. The proposed wearable system used two wearable inertial sensing modules worn on athletes’ wrist and ankle to collect sport motion signals and utilized a deep convolutional neural network (CNN) to extract the inherent features from the spectrograms of the short-term Fourier transform (STFT) of the sport motion signals. The wearable inertial sensing module is composed of a microcontroller, a triaxial accelerometer, a triaxial gyroscope, an RF wireless transmission module, and a power supply circuit. All ten participants wore the two wearable inertial sensing modules on their wrist and ankle to collect motion signals generated by sport activities. Subsequently, we developed a deep learning-based sport activity classification algorithm composed of sport motion signal collection, signal preprocessing, sport motion segmentation, signal normalization, spectrogram generation, image mergence/resizing, and CNN-based classification to recognize ten types of sport activities. The CNN classifier consisting of two convolutional layers, two pooling layers, a fully-connected layer, and a softmax layer can be used to divide the sport activities into table tennis, tennis, badminton, golf, batting baseball, shooting basketball, volleyball, dribbling basketball, running, and bicycling, respectively. Finally, the experimental results show that the proposed wearable sport activity classification system and its deep learning-based sport activity classification algorithm can recognize 10 sport activities with the classification rate of 99.30%.