The last decade saw the emergence of highly autonomous, flexible, re-configurable Cyber-Physical Systems. Research in this domain has been enhanced by the use of high-fidelity simulations, including Digital Twins, which are virtual representations connected to real assets. Digital Twins have been used for process supervision, prediction, or interaction with physical assets. Interaction with Digital Twins is enhanced by Virtual Reality and Augmented Reality, and Industry 5.0-focused research is evolving with the involvement of the human aspect in Digital Twins. This paper aims to review recent research on Human-Centric Digital Twins (HCDTs) and their enabling technologies. A systematic literature review is performed using the VOSviewer keyword mapping technique. Current technologies such as motion sensors, biological sensors, computational intelligence, simulation, and visualization tools are studied for the development of HCDTs in promising application areas. Domain-specific frameworks and guidelines are formed for different HCDT applications that highlight the workflow and desired outcomes, such as the training of AI models, the optimization of ergonomics, the security policy, task allocation, etc. A guideline and comparative analysis for the effective development of HCDTs are created based on the criteria of Machine Learning requirements, sensors, interfaces, and Human Digital Twin inputs.
Exponentially growing technologies such as intelligent robots in the context of Industry 4.0 are radically changing traditional manufacturing to intelligent manufacturing with increased productivity and flexibility. Workspaces are being transformed into fully shared spaces for performing tasks during human–robot collaboration (HRC), increasing the possibility of accidents as compared to the fully restricted and partially shared workspaces. The next technological epoch of Industry 5.0 has a heavy focus on human well-being, with humans and robots operating in synergy. However, the reluctance to adopt heavy-payload-capacity robots due to safety concerns is a major hurdle. Therefore, the importance of analyzing the level of injury after impact can never be neglected for the safety of workers and for designing a collaborative environment. In this study, quasi-static and dynamic analyses of accidental scenarios during HRC are performed for medium- and low-payload-capacity robots according to the conditions given in ISO TS 15066 to assess the threshold level of injury and pain, and is subsequently extended for high speeds and heavy payloads for collaborative robots. For this purpose, accidental scenarios are simulated in ANSYS using a 3D finite element model of an adult human index finger and hand, composed of cortical bone and soft tissue. Stresses and strains in the bone and tissue, and contact forces and energy transfer during impact are studied, and contact speed limit values are estimated. It is observed that heavy-payload-capacity robots must be restricted to 80% of the speed limit of low-payload-capacity robots. Biomechanical modeling of accident scenarios offers insights and, therefore, gives confidence in the adoption of heavy-payload robots in factories of the future. The analysis allows for prediction and assessment of different hypothetical accidental scenarios in HRC involving high speeds and heavy-payload-capacity robots.
In manufacturing settings where humans and machines collaborate, understanding and predicting human intention is crucial for enabling the seamless execution of tasks. This knowledge is the basis for creating an intelligent, symbiotic, and collaborative environment. However, current foundation models often fall short in directly anticipating complex tasks and producing contextually appropriate motion. This paper proposes a modular framework that investigates strategies for structuring task knowledge and engineering context-rich prompts to guide Vision–Language Models in understanding and predicting human intention in semi-structured environments. Our evaluation, conducted across three use cases of varying complexity, reveals a critical tradeoff between prediction accuracy and latency. We demonstrate that a Rolling Context Window strategy, which uses a history of frames and the previously predicted state, achieves a strong balance of performance and efficiency. This approach significantly outperforms single-image inputs and computationally expensive in-context learning methods. Furthermore, incorporating egocentric video views yields a substantial 10.7% performance increase in complex tasks. For short-term motion forecasting, we show that the accuracy of joint position estimates is enhanced by using historical pose, gaze data, and in-context examples.
Proactive robotic assistance in human–robot collaboration (HRC) requires systems that can perceive evolving task contexts, anticipate user needs, and intervene appropriately without disrupting human workflow. We present the Agentic Unified Robotic Assistance (AURA) Framework, which couples Large Language Model (LLM) reasoning grounded by Standard Operating Procedures (SOPs) with a modular layer of specialized Intent, Motion, Perception, Sound, Affordance, and Performance Monitors that supply structured context to a central decision-making module, making the framework reconfigurable and auditable without retraining or re-prompting. We introduce a human-in-the-loop teleoperation data collection methodology and an offline evaluation scheme with an Appropriateness Score (A-Score) tailored to proactive intervention timing, and release a benchmark dataset of annotated multimodal HRC episodes containing workspace and robot wrist camera videos, robot joint states, and labeled intervention events. Across three tasks of varying complexity, we observe progressive gains in intent prediction and decision-making as the modules are supplied with richer grounded context (prior-state memory and tracked object locations), with Combined F1 rising by over 20 points between context-poor and context-rich conditions. The structured grounding allows lightweight multimodal backbones such as Gemini 3.1 Flash Lite to perform on par with heavier reasoning-tier models at roughly one-fifth the inference latency. Together, these contributions establish a scalable framework, benchmark, and evaluation methodology for advancing proactive robotic assistance in collaborative environments.