Yan Di

Yan Di

Auto-generated profile, based on publicly available information

Yan Di

Technical University of Munich

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 January 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Open access
YSYongzhi Su
Yongzhi Su
YDYan Di
Yan Di
GZGuangyao Zhai
Guangyao Zhai
FMFabian Manhardt
Fabian Manhardt
JRJason Rambach
Jason Rambach
FTFederico Tombari
Federico Tombari
Monocular 3D object detection has recently made a significant leap forward thanks to the use of pre-trained depth estimators for pseudo-LiDAR recovery. Yet, such two-stage methods typically suffer from overfitting and are incapable of explicitly encapsulating the geometric relation between depth and object bounding box. To overcome this limitation, we instead propose to jointly estimate dense scene depth with depth-bounding box residuals and object bounding boxes, allowing a two-stream detection of 3D objects that harnesses both geometry and context information. Thereby, the geometry stream combines visible depth and depth-bounding box residuals to recover the object bounding box via explicit occlusion-aware optimization. In addition, a bounding box based geometry projection scheme is employed in an effort to enhance distance perception. The second stream, named as the Context Stream, directly regresses 3D object location and size. This novel two-stream representation enables us to enforce cross-stream consistency terms, which aligns the outputs of both streams, and further improves the overall performance. Extensive experiments on the public benchmark demonstrate that OPA-3D outperforms state-of-the-art methods on the main Car category, whilst keeping a real-time inference speed.

29 May 2023
Verified
Conference Paper
Open access
GZGuangyao Zhai
Guangyao Zhai
DHDianye Huang
Dianye Huang
SWShun-Cheng Wu
Shun-Cheng Wu
HJHyunJun Jung
HyunJun Jung
YDYan Di
Yan Di
BBBenjamin Busam
Benjamin Busam
6-DoF robotic grasping is a long-lasting but un-solved problem. Recent methods utilize strong 3D networks to extract geometric grasping representations from depth sensors, demonstrating superior accuracy on common objects but performing unsatisfactorily on photometrically challenging objects, e.g., objects in transparent or reflective materials. The bottleneck lies in that the surface of these objects can not reflect accurate depth due to the absorption or refraction of light. In this paper, in contrast to exploiting the inaccurate depth data, we propose the first RGB-only 6-DoF grasping pipeline called MonoGraspNet that utilizes stable 2D features to simultaneously handle arbitrary object grasping and overcome the problems induced by photometrically challenging objects. MonoGraspNet leverages a keypoint heatmap and a normal map to recover the 6-DoF grasping poses represented by our novel representation parameterized with 2D keypoints with corresponding depth, grasping direction, grasping width, and angle. Extensive experiments in real scenes demonstrate that our method can achieve competitive results in grasping common objects and surpass the depth-based competitor by a large margin in grasping photometrically challenging objects. To further stimulate robotic manipulation research, we annotate and open-source a multi-view grasping dataset in the real world containing 44 sequence collections of mixed photometric complexity with nearly 20M accurate grasping labels.

26 October 2024
Verified
Book Chapter
Closed access
PDF file
GZGuangyao Zhai
Guangyao Zhai
EÖEvin Pınar Örnek
Evin Pınar Örnek
DCDave Zhenyu Chen
Dave Zhenyu Chen
RLRuotong Liao
Ruotong Liao
YDYan Di
Yan Di
BBBenjamin Busam
Benjamin Busam

8 March 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
MZMichela Zaccaria
Michela Zaccaria
FMFabian Manhardt
Fabian Manhardt
YDYan Di
Yan Di
FTFederico Tombari
Federico Tombari
Jacopo AleottiJacopo Aleotti
Jacopo Aleotti
MGMikhail Giorgini
Mikhail Giorgini
Category-level 6D object pose estimation aims at determining the pose of an object of a given category. Most current state-of-the-art methods require a significant amount of real training data to supervise their models. Moreover, annotating the 6D pose is very time consuming, error-prone, and it does not scale well to a large amount of object classes. Therefore, a handful of methods have recently been proposed to use unlabelled data to establish weak supervision. In this letter we propose a self-supervised method that leverages the 2D optical flow as a proxy for supervising the 6D pose. To this purpose, we estimate the 2D optical flow between consecutive frames based on the pose estimation. Then, we harness an off-the-shelf optical flow method to enable weak supervision using a 2D-3D optical flow based consistency loss. Experiments show that our approach for self-supervised learning yields state-of-the-art performance on the NOCS benchmark, and it reaches comparable results with some fully-supervised approaches.

22 April 2020 in Applied Sciences
Verified
Journal Article
Open access
PDF file
MLMingyang Li
Mingyang Li
ZDZhijiang Du
Zhijiang Du
XMXiaoxing Ma
Xiaoxing Ma
KGKui Gao
Kui Gao
WDWei Dong
Wei Dong
YGYongzhuo Gao
Yongzhuo Gao
In the grinding process of friction stir weld seams, excessive grinding will cause damage to the base metal and bring significant economic losses. In this paper, the authors design a robotic system for grinding the weld seam and present a monitoring method of excessive grinding. The designed system consists of an industrial robot, a line scanner for measuring the weld seam and a force-controlled grinding tool. Since the result of the measurement of the weld seam is a point cloud, the extraction method of the weld seam point cloud based on graph-cut is proposed in this paper. The extracted features are used as prior knowledge of the monitoring algorithm. On the other hand, by combining the features from the point cloud and force-position information during the processing, a monitoring method for excessive grinding based on PSO-SVM is proposed and verified by experiments. The experiments demonstrate that the proposed method can identify excessive grinding, and the accuracy of recognition is 91.5%.

3 November 2024
Verified
Book Chapter
Closed access
PDF file
BFBowen Fu
Bowen Fu
GWGu Wang
Gu Wang
CZChenyangguang Zhang
Chenyangguang Zhang
YDYan Di
Yan Di
ZHZiqin Huang
Ziqin Huang
FTFederico Tombari
Federico Tombari