The problem: Single-incision surgery is a complex procedure in which any additional information automatically collected from the operating field can be of significance. While the use of robotic devices has greatly improved surgical outcomes, there are still many unresolved issues. One of the major surgical complications, with higher occurrence in cancer patients, is intraoperative hemorrhages, which if detected early, can be more efficiently controlled. Aim: This paper proposes a hazard detection system which incorporates the advantages of both Artificial Intelligence (AI) and Augmented Reality (AR) agents, capable of identifying, in real-time, intraoperative bleedings, which are subsequently displayed on a Hololens 2 device. Methods: The authors explored the different techniques for real-time processing and determined, based on a critical analysis, that YOLOv5 is one of the most promising solutions. An innovative, real-time, bleeding detection system, developed using the YOLOv5 algorithm and the Hololens 2 device, was evaluated on different surgical procedures and tested in multiple configurations to obtain the optimal prediction time and accuracy. Results: The detection system was able to identify the bleeding occurrence in multiple surgical procedures with a high rate of accuracy. Once detected, the area of interest was marked with a bounding box and displayed on the Hololens 2 device. During the tests, the system was able to differentiate between bleeding occurrence and intraoperative irrigation; thus, reducing the risk of false-negative and false-positive results. Conclusion: The current level of AI and AR technologies enables the development of real-time hazard detection systems as efficient assistance tools for surgeons, especially in high-risk interventions.

Stroke, amyotrophic lateral sclerosis (ALS), and Parkinson’s disease are some of the conditions that can lead to neuromotor disabilities requiring rehabilitation. To address the socio-economic burden that is amplified by the rapidly increasing elderly population, traditional rehabilitation techniques have recently been complemented by technological advancements, particularly Robot-Assisted Therapy (RAT). RAT enhances motor learning by improving both accuracy and consistency. This study proposes an innovative rehabilitation system that combines serious gaming and augmented reality (AR) with the LegUp parallel robot, developed for the spatial rehabilitation of the hip, knee, and ankle in bed-ridden patients. The system aims to improve patient outcomes and actively involve patients in their therapy. Electro-goniometers and a HoloLens 2 device are used to provide immediate feedback about the position of the patient’s joints, forming the basis of an interactive game in which the patient moves their leg to reach various targets. Two game modes were developed, each targeting different aspects of neuromotor rehabilitation, such as coordination, strength, and flexibility. Preliminary findings suggest that combining RAT with augmented reality-based serious gaming can increase patient motivation and engagement. Furthermore, the personalized and interactive nature of the therapy holds the potential to improve rehabilitation outcomes by fostering sustained engagement and effort.

Robot-assisted minimally invasive surgery offers advantages over traditional laparoscopic surgery, including precision and improved patient outcomes. However, its complexity requires extensive training, leading to the development of simulators that still face challenges such as limited feedback and lack of realism. This study presents an augmented reality-based surgical simulator tailored for minimally invasive pancreatic surgery, integrating an innovative parallel robot, real-time AI-driven force estimation, and haptic feedback. Using Unity and the HoloLens 2, the simulator offers a realistic augmented environment, enhancing spatial awareness and planning in surgical scenarios. A convolutional neural network (CNN) model predicts forces without physical sensors, achieving a mean absolute error of 0.0244 N. Tests indicate a strong correlation between applied and predicted forces, with a haptic feedback latency of 65 ms, suitable for real-time applications. Its modularity makes the simulator accessible for training and preoperative planning, addressing gaps in current robotic surgery training tools while setting the stage for future improvements and broader integration.

(1) Background: Most robotic MIS platforms lack native haptic feedback, leaving surgeons to infer tissue loads from vision alone—an especially risky limitation in esophageal procedures. (2) Methods: We develop a sensorless, image-only force-estimation pipeline that maps endoscopic video to tool–tissue forces using a lightweight EfficientNetV2B0 CNN. The model is trained on 9691 labeled frames from in vitro esophageal experiments and validated against an FT300 load cell. For intraoperative feasibility, the system is deployed as a plug-in on PARA-SILSROB, consuming the existing laparoscope feed and driving a commercial haptic device. The runtime processes every 10th frame of a 60 FPS stream (≈6 Hz updates) with ~15–20 ms per-prediction latency. (3) Results: On held-out tests, the model achieves MAE = 0.017 N and MSE = 0.0004 N², outperforming a recurrent CNN baseline while maintaining real-time performance on commodity hardware. Integrated evaluations confirm stable operation at the deployed update rate and low latency compatible with closed-loop haptics. (4) Conclusions: By avoiding distal force sensors and preserving sterile workflow, the approach is readily translatable and retrofit-friendly for current robotic platforms. The results support the practical feasibility of real-time, sensorless force feedback for robotic esophagectomy and related MIS tasks, with potential to reduce tissue trauma and enhance operative safety.

Neurological diseases leading to motor deficits constitute significant challenges to healthcare systems. Despite technological advancements in data acquisition, sensor development, data processing, and virtual reality (VR), a suitable framework for patient-centered neuromotor robot-assisted rehabilitation using collective sensor information does not exist. An extensive literature review was achieved based on 124 scientific publications regarding different types of sensors and the usage of the bio-signals they measure for neuromotor robot-assisted rehabilitation. A comprehensive classification of sensors was proposed, distinguishing between specific and non-specific parameters. The classification criteria address essential factors such as the type of sensors, the data they measure, their usability, ergonomics, and their overall impact on personalized treatment. In addition, a framework designed to collect and utilize relevant data for the optimal rehabilitation process efficiently is proposed. The proposed classifications aim to identify a set of key variables that can be used as a building block for a dynamic framework tailored for personalized treatments, thereby enhancing the effectiveness of patient-centered procedures in rehabilitation.