As a senile chronic, progressive and currently incurable disease, dementia has an enormous impact on society and life quality of the elderly. The development of teleoperation technology has changed the traditional way of care delivery and brought a variety of novel applications for dementia care. In this paper, a telerobotic system is presented which gives the caregivers the capability of assisting dementia elderly remotely. The proposed system is composed of a dual-arm collaborative robot (YuMi) and a wearable motion capture device. The communication architecture is achieved by the robot operation system (ROS). The position-orientation data of the operator’s hand are obtained and used to control the YuMi robot. Besides, a path-constrained mapping method is designed for motion trajectory tracking between the robot and the operator in the progress of teleoperation. Meanwhile, corresponding experiments are conducted to verify the performance of the trajectory tracking using the path-constrained mapping method. Results show that the position tracking deviation between the trajectory of the operator and the robot measured by dynamic time warping distance is 1.05 mm at the sampling frequency of 7.5 Hz. Moreover, the practicability of the proposed system was verified by teleoperating the YuMi robot to pick up a medicine bottle and further demonstrated by assisting an elderly woman in picking up a cup remotely. The proposed telerobotic system has potential utility for improving the life quality of dementia elderly and the care effect of their caregivers.

With the paradigm shift from hospital-centric healthcare to home-centric healthcare in Healthcare 4.0, healthcare robotics has become one of the fastest growing fields of robotics. The combination of robot capabilities with human intelligence, for example, telerobotics for home care, is gradually showing promising potentials. In this paper, the Home-TeleBot system, a generalized IoT-enabled telerobotic architecture designed to support home-centric healthcare system, is proposed. In particular, the implementation of it is realized by integrating human-motion-capture subsystem with robot-control subsystem. The dual-arm cooperative robot, YuMi, imitates human motion captured by a set of wearable inertial motion capture devices to complete tasks. The proposed approach using workspace mapping and path planning of robot manipulators, facilitates telerobot to execute tasks in a natural and human-like way. Based on the constant of proportionality calculated by comparing the human original workspace with the robot original workspace, the workspace mapping is achieved by making assumptions of the distance between end-effectors (human hands, robot's grippers) and shoulders. Additionally, robot manipulators' path is planned by setting virtual obstacles to constrain robot motion, which aims to improve the performance of robot's human-like motion. As a specific example of application, we apply the proposed architecture to a fetching task based on dual-arm motion capture and mapping for telerobotics in home care.

Following the rule of human-centricity, Human Motion Digital Twin (HMDT) attempts to apply human motion data to ensure the development and well-being of human beings. Particularly, perception and estimation of human motion play fundamental roles in realizing HMDT. This work proposes an inertial motion capture system for human motion digital twin (InMoDT). The designed motion capture device is made up of a hub node and inertial measurement units attached to the human body. The proposed algorithm framework supported by sensor fusion and pose calibration algorithms, enables to acquire orientations of sensors and body segments. With the deployment of algorithms, InMoDT achieves an average root mean square error of 4.7 $^{\circ}$ in estimating orientations when compared with an optical motion capture system. Experimental results show a great correlation ( $92.5\%$ ) and agreement ( $97.8\%$ ) between InMoDT and the optical system. The abilities of InMoDT are spotted in terms of human-centric applications based on the integration of human, cyber system, and physical system, such as motion monitoring and estimation, and human-robot teleoperation. Note to Practitioners —This paper is motivated by the problem of inadequate attention on humans in Cyber-Physical System (CPS) while the roles of operators have a significant effect on industry. With the popular applications of digital twins in CPS, HMDT is expected to monitor, analyze, and assess motion data for facilitating the Human-Cyber-Physical System (HCPS) In this research work, the authors present a system for whole-body motion capture. The proposed system based on a wearable inertial sensor-based device provides a solution to construct HMDT. Moreover, a novel algorithm framework is employed, which consists of the sensor fusion algorithm and the kinematic constraints-based pose calibration algorithm. Experimental results demonstrate the system’s effectiveness in motion sensing accuracy, correlation, and agreement in comparison with the gold standard. The validated applications of the system lie in motion monitoring and estimation, and human-robot teleoperation, showing the potential for enhancing HMDT.

The rising attention to human-centricity, a core value of Industry 5.0, makes researchers propose various methods to place humans in the center of production, such as the Human Digital Twin (HDT) and gait identity recognition. However, previous HDT applications in the Industry 5.0 era have less consideration of identity recognition, the vital way to link physical signals to personal archives in cyber systems. Herein GaitFormer, a Two-Stream Transformer gait recognition method is proposed for application with the wearable inertial measurement unit (IMU) motion capture system. GaitFormer consists of Temporal and Channel Modules enclosing Gaussian Range Encoding, multi-head Auto-Correlation mechanism, and multi-scale as convolutional neural network (CNN) layers. It outperforms state-of-the-art architectures with extensive experiments over publicly available IMU-based datasets respectively: whuGait and OU-ISIR. Then the study intends to combine the motion capture system and gait identity recognition algorithm to propose an application of personal monitoring in the Human-Cyber-Physical-System (HCPS), which uses GaitFormer to recognize the identity of the user with motion capture system and show their corresponding customized HDT. This work may contribute to making a connection between gait identity recognition and HDT, constructing personal working profiles in the environment of Industry 5.0.