Brain structure segmentation on magnetic resonance (MR) images is important for various clinical applications. It has been automatically performed by using fully convolutional networks. However, it suffers from the class imbalance problem. To address this problem, we investigated how loss weighting strategies work for brain structure segmentation tasks with different class imbalance situations on MR images. In this study, we adopted segmentation tasks of the cerebrum, cerebellum, brainstem, and blood vessels from MR cisternography and angiography images as the target segmentation tasks. We used a U-net architecture with cross-entropy and Dice loss functions as a baseline and evaluated the effect of the following loss weighting strategies: inverse frequency weighting, median inverse frequency weighting, focal weighting, distance map-based weighting, and distance penalty term-based weighting. In the experiments, the Dice loss function with focal weighting showed the best performance and had a high average Dice score of 92.8% in the binary-class segmentation tasks, while the cross-entropy loss functions with distance map-based weighting achieved the Dice score of up to 93.1% in the multi-class segmentation tasks. The results suggested that the distance map-based and the focal weightings could boost the performance of cross-entropy and Dice loss functions in class imbalanced segmentation tasks, respectively.
This paper presents a novel liver manipulator featuring suction fixing, stiffness tuning, and pneumatic actuation. In a liver-manipulation process, the manipulator begins in a low-stiffness state and is then pneumatically actuated to fit suction pads to the liver surface. At this point, the manipulator vacuums external air through the suction pads to adhere to the liver surface and then turns to a high-stiffness state to hold the liver tenaciously. Stiffness tuning is achieved with two cloth-rubber beams, which are contained within a closed elastic tube. Sucking the air between the beams increases the stiffness by 4.2 times. Experimental results demonstrate liver manipulation improvement in terms of holding stability and being less invasive.
Augmented reality technologies provide transformative solutions in various surgical fields. Our research focuses on the use of an advanced augmented reality system that projects 3D holographic images directly into surgical footage, potentially improving the surgeon’s orientation to the surgical field and lowering the cognitive load. We created a novel system that combines exoscopic surgical footage from the “ORBEYE” and displays both the surgical field and 3D holograms on a single screen. This setup enables surgeons to use the system without using head-mounted displays, instead viewing the integrated images on a 3D monitor. Thirteen surgeons and surgical assistants completed tasks with 2D and 3D graphical surgical guides. The NASA Task Load Index was used to assess mental, physical, and temporal demands. The use of 3D graphical surgical guides significantly improved performance metrics in cochlear implant surgeries by lowering mental, physical, temporal, and frustration levels. However, for Bonebridge implantation, the 2D graphical surgical guide performed better overall (p = 0.045). Participants found the augmented reality system’s video latency to be imperceptible, measuring 0.13 ± 0.01 s. This advanced augmented reality system significantly improves the efficiency and precision of cochlear implant surgeries by lowering cognitive load and improving spatial orientation.
A gait training method that can adjust the target leg load is required to meet the varied demands of trainees. In this study, we propose a running training method using a soft gait-assistive suit—a power-assistive device that adds an external force to the leg of a trainee by actuating a pneumatic artificial muscle (PAM). Herein, the assisting force is applied to the leg of the trainee so that muscle activity is reduced throughout the gait cycle. We detected the terminal stance phase as an appropriate assist timing from the pressure information, and the detected timing was used for the PAM control. We conducted a verification experiment of the PAM pressure variation. In a running mode of 7.0 to 10.0 km/h, all data showed that the PAM at the calf front has better detectability than that at the calf back, which is used in conventional detection methods. The experimental results confirmed that the PAM for gait phase detection should be positioned at the calf front during running. The effectiveness of the proposed running training method was verified through experiments on four trainees using a treadmill. The leg electromyogram of the trainees was measured and changes observed. Accordingly, 14 out of 16 channels of the four trainees showed a significant difference, and the electromyograms decreased by the suit assistance in the range of −1.4 to − 80.3% maximum voluntary contraction. Thus, the experimental results quantitatively confirmed that the proposed running assistance method is effective in reducing muscular activity.
This paper reports the precision of shape-from-focus (SFF) imaging according to the texture frequencies and window sizes of a focus measure. SFF is one of various depth measurement techniques for optical imaging, such as microscopy and endoscopy. SFF measures the depth of an object according to focus measure, which is generally computed with a fixed window. The window size affects the performance of SFF and should be adjusted for the texture of an object. In this study, we investigated the precision difference of SFF in texture frequencies and by window size. Two experiments were performed: precision validation in texture frequencies with a fixed window size, and precision validation in various window sizes related to pixel-cycle lengths. The first experimental results showed that a smaller window size could not provide a correct focus measure, and the second results showed that a window size that is approximately equal to a pixel-cycle length of the texture could provide better precision. These findings could potentially contribute to determining the appropriate window size of focus measure operation in shape-from-focus reconstruction.