Dianye Huang

Dianye Huang

Auto-generated profile, based on publicly available information

Dianye Huang

Chair for Computer Aided Medical Procedures and Augmented Reality, Technical University of Munich, Munich, Germany

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 August 2020 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Chenguang YangChenguang Yang
Chenguang Yang
DHDianye Huang
Dianye Huang
WHWei He
Wei He
LCLong Cheng
Long Cheng
This article presents a control scheme for the robot manipulator's trajectory tracking task considering output error constraints and control input saturation. We provide an alternative way to remove the feasibility condition that most BLF-based controllers should meet and design a control scheme on the premise that constraint violation possibly happens due to the control input saturation. A bounded barrier Lyapunov function is proposed and adopted to handle the output error constraints. Besides, to suppress the input saturation effect, an auxiliary system is designed and emerged into the control scheme. Moreover, a simplified RBFNN structure is adopted to approximate the lumped uncertainties. Simulation and experimental results demonstrate the effectiveness of the proposed control scheme.

6 December 2019 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
DHDianye Huang
Dianye Huang
Chenguang YangChenguang Yang
Chenguang Yang
YPYongping Pan
Yongping Pan
LCLong Cheng
Long Cheng
This paper presents a control scheme for robot manipulators with the consideration of output error constraints, unknown dynamics and bounded disturbances. A modified virtual input variable in the second stage design of the dynamic surface control scheme is proposed, which can enhance the robustness of the controller. Bounded disturbances due to the situations that the base is not well fixed if the robot manipulator is mounted at a mobile platform are considered and suppressed. Besides, the detailed implementation process of the composite learning laws adopted for enhancing the radical basis function neural network is presented. Lyapunov stability analysis verifies that the proposed control scheme ensures the trajectory tracking errors stay within predefined boundaries and parameter estimate errors converge without a stringent condition termed persistent excitation. Experimental results show the superiority of the proposed controller regarding parameter estimation and tracking capabilities.

29 May 2023
Verified
Conference Paper
Open access
GZGuangyao Zhai
Guangyao Zhai
DHDianye Huang
Dianye Huang
SWShun-Cheng Wu
Shun-Cheng Wu
HJHyunJun Jung
HyunJun Jung
YDYan Di
Yan Di
BBBenjamin Busam
Benjamin Busam
6-DoF robotic grasping is a long-lasting but un-solved problem. Recent methods utilize strong 3D networks to extract geometric grasping representations from depth sensors, demonstrating superior accuracy on common objects but performing unsatisfactorily on photometrically challenging objects, e.g., objects in transparent or reflective materials. The bottleneck lies in that the surface of these objects can not reflect accurate depth due to the absorption or refraction of light. In this paper, in contrast to exploiting the inaccurate depth data, we propose the first RGB-only 6-DoF grasping pipeline called MonoGraspNet that utilizes stable 2D features to simultaneously handle arbitrary object grasping and overcome the problems induced by photometrically challenging objects. MonoGraspNet leverages a keypoint heatmap and a normal map to recover the 6-DoF grasping poses represented by our novel representation parameterized with 2D keypoints with corresponding depth, grasping direction, grasping width, and angle. Extensive experiments in real scenes demonstrate that our method can achieve competitive results in grasping common objects and surpass the depth-based competitor by a large margin in grasping photometrically challenging objects. To further stimulate robotic manipulation research, we annotate and open-source a multi-view grasping dataset in the real world containing 44 sequence collections of mixed photometric complexity with nearly 20M accurate grasping labels.

12 January 2024 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
DHDianye Huang
Dianye Huang
Chenguang YangChenguang Yang
Chenguang Yang
MZMingchuan Zhou
Mingchuan Zhou
AKAngelos Karlas
Angelos Karlas
NNNassir Navab
Nassir Navab
ZJZhongliang Jiang
Zhongliang Jiang
Deep Venous Thrombosis (DVT) is a common vascular disease with blood clots inside deep veins, which may block blood flow or even cause a life-threatening pulmonary embolism. A typical exam for DVT using ultrasound (US) imaging is by pressing the target vein until its lumen is fully compressed. However, the compression exam is highly operator-dependent. To alleviate intra-and inter-variations, we present a robotic US system with a novel hybrid force motion control scheme ensuring position and force tracking accuracy, and soft landing of the probe onto the target surface. In addition, a path-based virtual fixture is proposed to realize easy human-robot interaction for repeat compression operation at the lesion location. To ensure the biometric measurements obtained in different examinations are comparable, the 6D scanning path is determined in a coarse-to-fine manner using both an external RGBD camera and US images. The RGBD camera is first used to extract a rough scanning path on the object. Then, the segmented vascular lumen from US images are used to optimize the scanning path to ensure the visibility of the target object. To generate a continuous scan path for developing virtual fixtures, an arc-length based path fitting model considering both position and orientation is proposed. Finally, the whole system is evaluated on a human-like arm phantom with an uneven surface. The code (https://github.com/dianyeHuang/RobDVTUS) and intuitive demonstration video (https://www.youtube.com/ watch?v=3xFyqU1rV8c) can be publicly accessed. Note to Practitioners —Robotic ultrasound (US) systems have attracted attention for various applications in the past decades. However, the existing studies are not mature and intelligent enough for some challenging applications, such as DVT exam, which requires rich contact interaction between patients and clinicians. To tackle with this challenge, this study presents a novel human-centric robotic DVT exam program using the technique of virtual fixture. The coarse-to-fine path planning module ensures the repeatability of US acquisitions carried out at different times. During DVT exam, the proposed continuous 6D path virtual fixture can guide clinicians to freely move the probe along the scan path while limiting the probe motion in other directions. In order to perform the compress-release exam, a decoupled position/force controller is developed to precisely generate the contact force conveyed by clinicians and to restrict the probe motion along the probe centerline. We believe such a robot-assisted system is a promising solution to take both advantages of robots about the accuracy and repeatability and human operators about the advanced physiological knowledge.

25 February 2025 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Open access
DHDianye Huang
Dianye Huang
CLChenyang Li
Chenyang Li
AKAngelos Karlas
Angelos Karlas
XCXiangyu Chu
Xiangyu Chu
KAK. W. Samuel Au
K. W. Samuel Au
ZJZhongliang Jiang
Zhongliang Jiang
Precise percutaneous needle detection is crucial for ultrasound (US)-guided interventions. However, inherent limitations such as speckles, needle-like artifacts, and low resolution make it challenging to robustly detect needles, especially when their visibility is reduced or imperceptible. To address this challenge, we propose VibNet, a learning-based framework designed to enhance the robustness and accuracy of needle detection in US images by leveraging periodic vibration applied externally to the needle shafts. VibNet integrates neural Short-Time Fourier Transform and Hough Transform modules to achieve successive sub-goals, including motion feature extraction in the spatiotemporal space, frequency feature aggregation, and needle detection in the Hough space. Due to the periodic subtle vibration, the features are more robust in the frequency domain than in the image intensity domain, making VibNet more effective than traditional intensity-based methods. To demonstrate the effectiveness of VibNet, we conducted experiments on distinct ex vivo porcine and bovine tissue samples. The results obtained on porcine samples demonstrate that VibNet effectively detects needles even when their visibility is severely reduced, with a tip error of 1.61±1.56 mm compared to 8.15±9.98 mm for UNet and 6.63±7.58 mm for WNet, and a needle direction error of 1.64 ± 1.86° compared to 9.29 ± 15.30° for UNet and 8.54 ± 17.92° for WNet. Code: https://github.com/marslicy/VibNet.

15 May 2024 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
SGShangding Gu
Shangding Gu
DHDianye Huang
Dianye Huang
MWMuning Wen
Muning Wen
GCGuang Chen
Guang Chen
AKAlois Christian Knoll
Alois Christian Knoll
Due to a lack of safety considerations, a wide range of multiagent reinforcement learning (MARL) applications are limited in real-world environments. Thus, ensuring MARL safety is essential and urgent in the domain. However, merely a few studies consider the safe MARL problem, and the investigation of real-world applications using safe MARL algorithms still needs to be improved. To fill this gap, we provide a framework with soft constrained policy optimization, in which we develop practical algorithms to address the problem in a cooperative game setting. First, the problem formulation of safe MARL is introduced. Second, the safe policy optimization of safe MARL algorithms based on soft constrained optimization is analyzed, and we further propose a safe learning framework for safe MARL. The framework can be plugged into MARL algorithms without manually fine-tuning safety bounds. Third, we investigate the sim-to-real problems, and conduct simulation and real-world experiments to evaluate the effectiveness of our algorithms. Finally, the comprehensive experimental results indicate that our method has significant benefits regarding the balance between reward and safety performance and outperforms several strong baselines.