Advanced driver assistance systems (ADAS) have been developed to enhance driving safety by issuing timely warnings to drivers. However, current ADAS do not take into account the driver's cognitive state when delivering warnings, which can result in false alarms and impact the driver's trust in the system. To address this issue, we propose a Cognitive-digital-twin-based Driving Assistance System (CDAS) that issues warnings tailored to the driver's perception of the driving environment and driving style. In this letter, we present a model of the driver's decision-making process that explicitly captures their perception of the driving environment, their utility evaluation of predicted future environments, and their driving style in terms of minimum acceptable risk. The cognitive digital twin of the driver is then created and updated by minimizing the discrepancy between the predicted and actual behaviors of the driver. With the cognitive digital twin, the CDAS warns the driver when there is a significant discrepancy between the predicted driving strategy based on partial observation and that based on full observation. This approach can more accurately identify risks that the driver is not aware of and provide warnings only when necessary. We conducted human and simulated experiments in a virtual driving environment, and our results demonstrate that our proposed CDAS has a similar perception of risky behaviors compared to humans. Furthermore, the digital twin learning framework can identify the driving styles of human participants and accurately predict their driving strategies. Additionally, our proposed cognitive driving assistance system provides fewer false warnings and avoids more collisions compared to state-of-the-art ADAS algorithms. Our research shows that incorporating the driver's cognitive state and driving style can enhance the effectiveness and safety of driving assistance systems.
Individuals who experience motor impairment after stroke are able to partially restore motor control through rehabilitation, which achieves long-term recovery through repeated short-term adaptation. The customization of rehabilitation tasks is crucial for enhancing the effectiveness of rehabilitation by promoting the patient's awareness of motor impairments and reducing compensatory behaviors, which is currently dependent on the expertise of physiotherapists. The development of rehabilitation robots aims to alleviate the workload of physiotherapists and has the potential to offer accurate assessments of both short-term adaptation and long-term recovery in stroke patients. In this paper, we propose a framework for automated patient evaluation and task planning during robotic rehabilitation. A motor control model was proposed to capture the patient's motor control process. By adjusting its state and parameters, a digital twin of the patient can be generated and updated, providing insight into the level of adaptation and rehabilitation progress. The digital twin is then utilized to plan customized rehabilitation tasks, which can effectively reduce uncertainty and ambiguities during patient evaluation, and improves patient's adaptation during rehabilitation. The digital twin framework and the task planning algorithms were validated using human subject and simulation experiments.
1 February 2024 in Expert Systems with Applications