We present anl omnidirectional 3D autostereoscopic aerial display with continuous parallax. Integral photography (IP) combined with polyhedron-shaped aerial imaging plates (AIPs) is utilized to achieve an extended view angle of 3D aerial images. With optical theoretical analysis and an aerial in situ rotation design, a 3D aerial display with an enlarged viewing angle is realized. In particular, the proposed 3D aerial display can realize any assigned angle within 360 deg. We also optimize the aerial display with artifact image removal and floating image brightness analysis. Experiments are performed to prove the 3D aerial display with full-motion parallax, continuous viewpoints, and multiplayer interaction. The proposed system is an attractive prospect of non-contact interaction and multi-person collaboration.
8 December 2022 in IEEE Transactions on Learning Technologies
Trunk anatomy education is critical in the training of surgeon. Most trunk anatomy education systems use a personal or synthetic anatomical model. It remains difficult to obtain appropriate population anatomy information and create individualized anatomy customization based on a quantity of diverse data. Furthermore, the naked-eye virtual reality modality provides advantages in immersive learning and meta-information transmission. In this study, we present a novel VR torso anatomy teaching environment with naked-eye 3D visualization and free-hand interaction. This work allows for comprehensive modeling, visualization and interaction of torso anatomy for human anatomical variation education. In particular, we derive genuine shape of Chinese male and female torso organs based on the statistical shape model generated from 129 healthy Chinese individuals. The following visual information is given with interaction: (1) Anatomy for human torso organs from CT imaging: geometric modeling, visualization and interaction of male and female torso organs, including skin, muscle, torso skeleton, heart, lungs, liver, spleen and kidneys; (2) Morphological differences of trunk organs from meta-information: motion deformation modeling, visualization and interaction of male and female deformable torso model; (3) Instant personalized customization: real-time interaction and visualization for personalized customization with shape mode coefficients and soft body simulation.
Human activity recognition based on wireless sensing is advantageous at various features such as privacy preservation, but also very challenging due to the instability of wireless signals. This paper proposes a deep learning driven wireless human activity recognition solution based on Multiple-Input-Multiple-Output (MIMO) radar sensing. User activities are first sensed by a low-power Frequency-Modulated Continuous Wave (FMCW) MIMO radar. Then a sequence of 3D images are generated out of the reflected signal strength. Next, deep neural networks (DNNs) are designed to analyze the correlation among the sequential 3D images to recognize various types of human activities. This work has developed: 1) a large dataset containing over 1,500 training videos of six different types of indoor activities, 2) a customized deep learning video data-loader to select proper training data in each training epoch, 3) a deep recurrent neural network (RNN) model to recognize human activities based on radar imaging results. This solution has been extensively evaluated in a research lab room. The results show that the solution is able to generate wireless imaging frame-by-frame, and it can achieve over 86.7% accuracy in recognizing six different types of human activities.
2 August 2024 in IEEE Transactions on Human-Machine Systems
In traditional clinical practice, doctors often have to deal with 3D information based on 2D-displayed medical images. There is a considerable mismatch between the 2D and 3D dimensions in image interaction during clinical diagnosis, making image manipulation challenging and time-consuming. In this study, we explored 3D sketching for medical images using true 2D-3D interlinked visualization and interaction, presenting a novel AR environment named ARMedicalSketch. It supports image display enhancement preprocessing and 3D interaction tasks for original 3D medical images. Our interaction interface, based on 3D autostereoscopic display technology, provides both floating 3D display and 2D tablet display while enabling glasses-free visualization. We presented a method of 2D-3D interlinked visualization and interaction, employing synchronized projection visualization and a virtual synchronized interactive plane to establish an integrated relationship between 2D and 3D displays. Additionally, we utilized gesture sensors and a 2D touch tablet to capture the user's hand information for convenient interaction. We constructed the prototype and conducted a user study involving 23 students and 2 clinical experts. The controlled study compared our proposed system with a 2D display prototype, showing enhanced efficiency in interacting with medical images while maintaining 2D interaction accuracy, particularly in tasks involving strong 3D spatial correlation. In the future, we aim to further enhance the interaction precision and application scenarios of ARMedicalSketch.
11 October 2025 in Medical & Biological Engineering & Computing