With the intent to further increase production efficiency while making human the centre of the processes, human-centric manufacturing focuses on concepts such as digital twins and human–machine collaboration. This paper presents enabling technologies and methods to facilitate the creation of human-centric applications powered by digital twins, also from the perspective of Industry 5.0. It analyses and reviews the state of relevant information resources about digital twins for human–machine applications with an emphasis on the human perspective, but also on their collaborated relationship and the possibilities of their applications. Finally, it presents the results of the review and expected future works of research in this area.
Recent advances in multimodal large language models (MLLMs)—particularly vision– language models (VLMs)—introduce new possibilities for integrating visual perception with natural-language understanding in human–machine collaboration (HMC). Unmanned aerial vehicles (UAVs) are increasingly deployed in dynamic environments, where adaptive autonomy and intuitive interaction are essential. Traditional UAV autonomy has relied mainly on visual perception or preprogrammed planning, offering limited adaptability and explainability. This study introduces a novel reference architecture, the multimodal AI–HMC system, based on which a dedicated UAV use case architecture was instantiated and experimentally validated in a controlled laboratory environment. The architecture integrates VLM-powered reasoning, real-time depth estimation, and natural-language interfaces, enabling UAVs to perform context-aware actions while providing transparent explanations. Unlike prior approaches, the system generates navigation commands while also communicating the underlying rationale and associated confidence levels, thereby enhancing situational awareness and fostering user trust. The architecture was implemented in a real-time UAV navigation platform and evaluated through laboratory trials. Quantitative results showed a 70% task success rate in single-obstacle navigation and 50% in a cluttered scenario, with safe obstacle avoidance at flight speeds of up to 0.6 m/s. Users approved 90% of the generated instructions and rated explanations as significantly clearer and more informative when confidence visualization was included. These findings demonstrate the novelty and feasibility of embedding VLMs into UAV systems, advancing explainable, human-centric autonomy and establishing a foundation for future multimodal AI applications in HMC, including robotics.
Computed tomography scans are among the most used medical imaging modalities. With increased popularity and usage, the need for maintenance also increases. In this work, the problem is tackled using machine learning methods to create a predictive maintenance system for the classification of faulty X-ray tubes. Data for 137 different CT machines were collected, with 128 deemed to fulfil the quality criteria of the study. Of these, 66 have had X-ray tubes subsequently replaced. Afterwards, auto-regressive model coefficients and wavelet coefficients, as standard features in the area, are extracted. For classification, a set of different classical machine learning approaches is used alongside two different architectures of neural networks—1D VGG-style CNN and LSTM RNN. In total, seven different machine learning models are investigated. The best-performing model proved to be an LSTM trained on trimmed and normalised input data, with an accuracy of 87% and a recall of 100% for the faulty class. The developed model has the potential to maximise the uptime of CT machines and help mitigate the adverse effects of machine breakdowns.
1 September 2024 in Acta Electrotechnica et Informatica
This article deals with ensuring and increasing the safety of mobile robotic systems in human-machine collaboration. The goal of the research was to design and implement an artificial intelligence application that recognizes obstacles, including humans, and increases safety. The resulting mobile Android application uses a MiDaS model to generate a depth map of the environment from the drone’s camera to approximate the distance from all obstacles to avoid the drone’s collision. Besides, this work introduced us to DJI Mobile SDK and neural network optimizations for their use on smartphones.
1 June 2025 in Acta Electrotechnica et Informatica
This paper presents a system for autonomous indoor navigation of the DJI Mini 3 drone by combining an Android-based control application with ultra-wideband (UWB) technology for precise localization. The development process involved two main phases: (1) enabling drone control and sensor access through the DJI Mobile SDK and (2) integrating UWB-based positioning data for reliable indoor navigation. Three autonomous navigation methods were designed and evaluated, each leveraging UWB data to a different extent. The results demonstrate that incorporating UWB significantly improves positioning accuracy for our solution compared to relying solely on the drone’s built-in sensors. Overall, this work highlights the potential of UWB technology to enhance drone operations in environments where GPS is unavailable, paving the way for advanced applications in indoor logistics, monitoring, and other industrial or service-oriented scenarios.