Robot-Assisted Minimally Invasive Surgery (RAMIS) marks a paradigm shift in surgical procedures, enhancing precision and ergonomics. Concurrently it introduces complex stress dynamics and ergonomic challenges regarding the human–robot interface and interaction. This study explores the stress-related aspects of RAMIS, using the da Vinci XI Surgical System and the Sea Spikes model as a standard skill training phantom to establish a link between technological advancement and human factors in RAMIS environments. By employing different physiological and kinematic sensors for heart rate variability, hand movement tracking, and posture analysis, this research aims to develop a framework for quantifying the stress and ergonomic loads applied to surgeons. Preliminary findings reveal significant correlations between stress levels and several of the skill-related metrics measured by external sensors or the SURG-TLX questionnaire. Furthermore, early analysis of this preliminary dataset suggests the potential benefits of applying machine learning for surgeon skill classification and stress analysis. This paper presents the initial findings, identified correlations, and the lessons learned from the clinical setup, aiming to lay down the cornerstones for wider studies in the fields of clinical situation awareness and attention computing.
Grasping and object manipulation have been considered key domains of Cyber-Physical Systems (CPS) since the beginning of automation, as they are the most common interactions between systems, or a system and its environment. As the demand for automation is spreading to increasingly complex fields of industry, smart tools with sensors and internal decision-making become necessities. CPS, such as robots and smart autonomous machinery, have been introduced in the meat industry in recent decades; however, the natural diversity of animals, potential anatomical disorders and soft, slippery animal tissues require the use of a wide range of sensors, software and intelligent tools. This paper presents the development of a smart robotic gripper for deployment in the meat industry. A comprehensive review of the available robotic grippers employed in the sector is presented along with the relevant recent research projects. Based on the identified needs, a new mechatronic design and early development process of the smart gripper is described. The integrated force sensing method based on strain measurement and magnetic encoders is described, including the adjacent laboratory and on-site tests. Furthermore, a combined slip detection system is presented, which relies on an optical flow-based image processing algorithm using the video feed of a built-in endoscopic camera. Basic user tests and application assessments are presented.
Robot-Assisted Minimally Invasive Surgery (RAMIS) changes the perceptual and fine-motor requirements towards surgeons, but current training evaluation still relies primarily on technical performance outcomes and subjective assessment. This study investigates whether physiological stress estimation and gaze behavior can provide additional, objective insight into the surgeon's state during RAMIS and laparoscopic training. 14 novice users participated in the study and performed standardized ring-transfer and hot-wire tasks using the da Vinci Surgical System and a laparoscopic trainer for an extended time to assess stress and fatigue effects. Multimodal workload sensing was performed, Baevsky Stress Index (BSI) was calculated from heart rate variability measurements, and eye-tracking glasses were employed to derive fixation-saccade ratio, blink dynamics, and visual-motor stability. Robotic execution significantly reduced physiological strain and precision errors compared to laparoscopy, despite similar task scores. Strong correlations were observed between gaze efficiency and execution quality, while blink-based fatigue markers aligned with degraded performance. BSI and blink metrics also demonstrated meaningful relationships with self-reported SURG-TLX metrics, confirming their construct validity as workload indicators. Overall, combining biosensing with performance assessment enables deeper insights into RAMIS training and reveals latent cognitive strain not captured through task success rates alone.