A fall is one of the most devastating events that aging people can experience. Fall-related physical injuries, hospital admission, or even mortality among the elderly are all critical health issues. As the population continues to age worldwide, there is an imperative need to develop fall detection systems. We propose a system for the recognition and verification of falls based on a chest-worn wearable device, which can be used for elderly health institutions or home care. The wearable device utilizes a built-in three-axis accelerometer and gyroscope in the nine-axis inertial sensor to determine the user’s postures, such as standing, sitting, and lying down. The resultant force was obtained by calculation with three-axis acceleration. Integration of three-axis acceleration and a three-axis gyroscope can obtain a pitch angle through the gradient descent algorithm. The height value was converted from a barometer. Integration of the pitch angle with the height value can determine the behavior state including sitting down, standing up, walking, lying down, and falling. In our study, we can clearly determine the direction of the fall. Acceleration changes during the fall can determine the force of the impact. Furthermore, with the IoT (Internet of Things) and smart speakers, we can verify whether the user has fallen by asking from smart speakers. In this study, posture determination is operated directly on the wearable device through the state machine. The ability to recognize and report a fall event in real-time can help to lessen the response time of a caregiver. The family members or care provider monitor, in real-time, the user’s current posture via a mobile device app or internet webpage. All collected data supports subsequent medical evaluation and further intervention.
In recent years, the use of reinforcement learning and imitation learning to complete robot control tasks have become more popular. Demonstration and learning by experts have always been the goal of researchers. However, the lack of action data has been a significant limitation to learning by human demonstration. We propose an architecture based on a new 3D keypoint tracking model and generative adversarial imitation learning to learn from expert demonstrations. We used 3D keypoint tracking to make up for the lack of action data in simple images and then used image-to-image conversion to convert human hand demonstrations into robot images, which enabled subsequent generative adversarial imitation learning to learn smoothly. The estimation time of the 3D keypoint tracking model and the calculation time of the subsequent optimization algorithm was 30 ms. The coordinate errors of the model projected to the real 3D key point under correct detection were all within 1.8 cm. The tracking of key points did not require any sensors on the body; the operator did not need vision-related knowledge to correct the accuracy of the camera. By merely setting up a generic depth camera to track the mapping changes of key points after behavior clone training, the robot could learn human tasks by watching, including picking and placing an object and pouring water. We used pybullet to build an experimental environment to confirm our concept of the simplest behavioral cloning imitation to attest the success of the learning. The effectiveness of the proposed method was accomplished by a satisfactory performance requiring a sample efficiency of 20 sets for pick and place and 30 sets for pouring water.