Human activity recognition (HAR) is becoming increasingly important, especially with the growing number of elderly people living at home. However, most sensors, such as cameras, do not perform well in low-light environments. To address this issue, we designed a HAR system that combines a camera and a millimeter wave radar, taking advantage of each sensor and a fusion algorithm to distinguish between confusing human activities and to improve accuracy in low-light settings. To extract the spatial and temporal features contained in the multisensor fusion data, we designed an improved CNN-LSTM model. In addition, three data fusion algorithms were studied and investigated. Compared to camera data in low-light environments, the fusion data significantly improved the HAR accuracy by at least 26.68%, 19.87%, and 21.92% under the data level fusion algorithm, feature level fusion algorithm, and decision level fusion algorithm, respectively. Moreover, the data level fusion algorithm also resulted in a reduction of the best misclassification rate to 2%~6%. These findings suggest that the proposed system has the potential to enhance the accuracy of HAR in low-light environments and to decrease human activity misclassification rates.
Noise is a common problem in wearable electrocardiogram (ECG) monitoring systems because the presence of noise can corrupt the ECG waveform causing inaccurate signal interpretation. By comparison with electromagnetic interference and its minimization, the reduction of motion artifact is more difficult and challenging because its time-frequency characteristics are unpredictable. Based on the characteristics of motion artifacts, this work uses adaptive filtering, a specially designed ECG device, and an Impedance Pneumography (IP) data acquisition system to combat motion artifacts. The newly designed ECG-IP acquisition system maximizes signal correlation by measuring both ECG and IP signals simultaneously using the same pair of electrodes. Signal comparison investigations between ECG and IP signals under five different body motions were carried out, and the Pearson Correlation Coefficient |r| was higher than 0.6 in all cases, indicating a good correlation. To optimize the performance of adaptive motion artifact reduction, the IP signal was filtered to a 5 Hz low-pass filter and then fed into a Recursive Least Squares (RLS) adaptive filter as a reference input signal. The performance of the proposed motion artifact reduction method was evaluated subjectively and objectively, and the results proved that the method could suppress the motion artifacts and achieve minimal distortion to the denoised ECG signal.
Human activity recognition (HAR) can effectively improve the safety of the elderly at home. However, non-contact millimeter-wave radar data on the activities of the elderly is often challenging to collect, making it difficult to effectively improve the accuracy of neural networks for HAR. We addressed this problem by proposing a method that combines the improved principal component analysis (PCA) and the improved VGG16 model (a pre-trained 16-layer neural network model) to enhance the accuracy of HAR under small-scale datasets. This method used the improved PCA to enhance features of the extracted components and reduce the dimensionality of the data. The VGG16 model was improved by deleting the complex Fully-Connected layers and adding a Dropout layer between them to prevent the loss of useful information. The experimental results show that the accuracy of our proposed method on HAR is 96.34%, which is 4.27% higher after improvement, and the training time of each round is 10.88 s, which is 12.8% shorter than before.
Cardiopulmonary diseases, including cardiovascular disease (CVD) and chronic obstructive pulmonary disorder (COPD), are prevalent in the elderly population. Early identification, long‐term health monitoring, and health management of cardiopulmonary disease are crucial for reversing organ damage and preventing further injury. However, most home health monitoring (HHM) devices need to be paired with a specific smartphone application, which leads to the complexity of monitoring multiple health indicators and hinders the feasibility of comprehensive multi‐indicator analysis. Therefore, this paper designed a human cardiopulmonary health monitoring system based on an intelligent gateway to reduce the dependence of HHM on smartphones, achieve synchronous monitoring of multiple health indicators, and improve usability to better serve the elderly population. The proposed system can simultaneously monitor electrocardiogram (ECG), pulmonary function, blood pressure, and blood oxygen level (SpO2); process and analyze the data in real‐time through the intelligent gateway’s edge computing power; and display the cardiopulmonary health status in real‐time. The intelligent gateway embedded a specially designed CNN‐LSTM artificial intelligence model on the STM32F429 microcontroller to realize real‐time identification of ECG signals at the edge. The accuracy of the pretrained CNN‐LSTM model for ECG signal identification is 99.49%, and the model has good performance in terms of complexity and RAM space occupied. According to the evaluation test, the system can achieve the purpose of monitoring human cardiopulmonary health, has a wide range of application scenarios, and has great value in promotion and application.