Yaoyu Hu

Yaoyu Hu

Auto-generated profile, based on publicly available information

Yaoyu Hu

Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 July 2019 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
WZWeikun Zhen
Weikun Zhen
YHYaoyu Hu
Yaoyu Hu
JLJingfeng Liu
Jingfeng Liu
SSSebastian Scherer
Sebastian Scherer
Fusing data from LiDAR and camera is conceptually attractive because of their complementary properties. For instance, camera images are of higher resolution and have colors, while LiDAR data provide more accurate range measurements and have a wider field of view. However, the sensor fusion problem remains challenging since it is difficult to find reliable correlations between data of very different characteristics (geometry versus texture, sparse versus dense). This letter proposes an offline LiDAR-camera fusion method to build dense, accurate 3-D models. Specifically, our method jointly solves a bundle adjustment problem and a cloud registration problem to compute camera poses and the sensor extrinsic calibration. In experiments, we show that our method can achieve an average accuracy of 2.7 mm and resolution of 70 points/cm 2 by comparing to the ground truth data from a survey scanner. Furthermore, the extrinsic calibration result is discussed and shown to outperform the state-of-the-art method.

29 January 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
DDDevansh Dhrafani
Devansh Dhrafani
YLYifei Liu
Yifei Liu
AJAndrew Jong
Andrew Jong
USUkcheol Shin
Ukcheol Shin
YHYao He
Yao He
SSSebastian Scherer
Sebastian Scherer
Robust depth perception in visually-degraded environments is crucial for autonomous aerial systems. Thermal imaging cameras, which capture infrared radiation, are robust to visual degradation. However, due to lack of a large-scale dataset, the use of thermal cameras for uncrewed aerial system (UAS) depth perception has remained largely unexplored. This paper presents a stereo thermal depth perception dataset for autonomous aerial perception applications. The dataset consists of stereo thermal images, LiDAR, IMU and ground truth depth maps captured in urban and forest settings under diverse conditions like day, night, rain, and smoke. We benchmark representative stereo depth estimation algorithms, offering insights into their performance in degraded conditions. Models trained on our dataset generalize well to unseen smoky conditions, highlighting the robustness of stereo thermal imaging for depth perception. We aim for this work to enhance robotic perception in disaster scenarios, allowing for exploration and operations in previously unreachable areas.

5 September 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
TFTaimeng Fu
Taimeng Fu
HYHuai Yu
Huai Yu
Wen YangWen Yang
Wen Yang
YHYaoyu Hu
Yaoyu Hu
SSSebastian Scherer
Sebastian Scherer
A 2-D and 3-D sensor extrinsic calibration is the key prerequisite for multisensor-based robot perception and localization. However, such calibration is challenging due to the variety of sensor modalities and the requirement of special calibration targets and human intervention. In this article, we demonstrate a new targetless cross-modal calibration system focusing on the extrinsic transformations among stereo cameras, thermal cameras, and laser sensors. Specifically, the calibration between stereo and laser is conducted in 3-D space by minimizing the registration error, while the thermal extrinsic to the other two sensors is estimated by optimizing the alignment of the edge features. Due to the low contrast of thermal images, the extracted edges are often noisy, resulting in incorrect edge matching. We introduce the edge alignment optimization on attraction field map to overcome this challenge. Our method requires no dedicated targets and performs the multisensor calibration in a single shot without human interaction. Extensive experiments on our collected real-world datasets show that our system can be easily used in structured environments with high extrinsic calibration accuracy. The video demonstration can be found at https://www.youtube.com/watch?v=b1QAVY7hUu8 . The code is released to the public at https://github.com/FuTaimeng/auto_calibration .

27 September 2021
Verified
Conference Paper
Open access
YHYaoyu Hu
Yaoyu Hu
WWWenshan Wang
Wenshan Wang
HYHuai Yu
Huai Yu
WZWeikun Zhen
Weikun Zhen
SSSebastian Scherer
Sebastian Scherer
Stereo reconstruction models trained on small images do not generalize well to high-resolution data. Training a model on high-resolution image size faces difficulties of data availability and is often infeasible due to limited computing resources. In this work, we present the Occlusion-aware Recurrent binocular Stereo matching (ORStereo), which deals with these issues by only training on available low disparity range stereo images. ORStereo generalizes to unseen high-resolution images with large disparity ranges by formulating the task as residual updates and refinements of an initial prediction. ORStereo is trained on images with disparity ranges limited to 256 pixels, yet it can operate 4K-resolution input with over 1000 disparities using limited GPU memory. We test the model’s capability on both synthetic and real-world high-resolution images. Experimental results demonstrate that ORStereo achieves comparable performance on 4K-resolution images compared to state-of-the-art methods trained on large disparity ranges. Compared to the baseline methods that are only trained on low-resolution images, our method has 60% or less error on 4K-resolution images.

1 August 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
BKBomena Kim
Bomena Kim
HLHojun Lee
Hojun Lee
YPYounsoo Park
Younsoo Park
YLYebin Lee
Yebin Lee
YHYaoyu Hu
Yaoyu Hu
ISInwook Shim
Inwook Shim

1 January 2026 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
ZZZitong Zhan
Zitong Zhan
HXHuan Xu
Huan Xu
ZFZihang Fang
Zihang Fang
XWXinpeng Wei
Xinpeng Wei
YHYaoyu Hu
Yaoyu Hu
WCwang chen
wang chen