Ruijie Zhu

Ruijie Zhu

Auto-generated profile, based on publicly available information

Ruijie Zhu

University of Science and Technology of China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 November 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
RZRuijie Zhu
Ruijie Zhu
ZSZiyang Song
Ziyang Song
LLLi Liu
Li Liu
JHJianfeng He
Jianfeng He
TZTianzhu Zhang
Tianzhu Zhang
YZYongdong Zhang
Yongdong Zhang
Existing monocular depth estimation methods have achieved satisfactory performance on wild datasets. However, these methods are usually trained and tested on a single dataset, which makes them difficult to generalize to other scenarios. To learn diverse scene priors from multiple datasets, we propose a hierarchical framework with adaptive bins for robust monocular depth estimation, which consists of two critical components: a group-wise query generator to assign hierarchical bins and a correlation-aware transformer decoder to generate adaptive bin features. The proposed HA-Bins enjoys several merits. First, the group-wise query generator progressively increases the number of bin queries for multi-scale image features, resulting in a hierarchical bin distribution robust to diverse scenarios. Second, the correlation-aware transformer decoder refines the correlation of bin queries and image features, effectively improving adaptive image feature aggregation. We visualize the query activation maps on NYUDepthv2 dataset, showing that the proposed network effectively suppresses the depth-irrelevant regions. Experiments on KITTI, Sintel, and RabbitAI benchmarks show that without any fine-tuning, our model jointly trained on multiple datasets achieves competitive performance with the state-of-the-art and solid robustness toward diverse scenarios. In addition, our method wins second place in Robust Vision Challenge 2022 towards challenging scenarios with different characteristics.

6 April 2026 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
ZSZiyang Song
Ziyang Song
ZWZerong Wang
Zerong Wang
BLBo Li
Bo Li
HZHao Zhang
Hao Zhang
RZRuijie Zhu
Ruijie Zhu
TZTianzhu Zhang
Tianzhu Zhang
Monocular depth estimation within the denoising diffusion paradigm demonstrates impressive generalization ability but suffers from low inference speed. Recent methods adopt a single-step deterministic paradigm to improve inference efficiency. However, uncritically applying the generative features from diffusion models to the perceptual depth estimation task leads to suboptimal results, due to the differences between image generation and dense prediction. In this work, we propose Depth-Master, a single-step diffusion model designed to tame diffusion models for enhanced performance and visual quality. First, to mitigate overfitting to texture details introduced by generative features, we propose a Feature Alignment module, which incorporates high-quality semantic features to enhance the denoising network’s representation capability. Second, to address the lack of fine-grained details in the single-step deterministic framework, we propose a Fourier Enhancement module to adaptively balance low-frequency structure and high-frequency details. We adopt a two-stage training strategy to fully leverage the potential of the two modules. In the first stage, we focus on learning the global scene structure with the Feature Alignment module, while in the second stage, we exploit the Fourier Enhancement module to improve the visual quality. Through these efforts, our model achieves state-of-the-art performance in terms of generalization and detail preservation, outperforming other diffusion-based methods across various datasets. Our project page can be found at https://indu1ge.github.io/DepthMaster page.

9 October 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
LLLi Liu
Li Liu
RZRuijie Zhu
Ruijie Zhu
JDJiacheng Deng
Jiacheng Deng
ZSZiyang Song
Ziyang Song
WYWenfei Yang
Wenfei Yang
TZTianzhu Zhang
Tianzhu Zhang
Monocular depth estimation aims to infer a dense depth map from a single image, which is a fundamental and prevalent task in computer vision. Many previous works have shown impressive depth estimation results through carefully designed network structures, but they usually ignore the planar information and therefore perform poorly in low-texture areas of indoor scenes. In this paper, we propose Plane2Depth, which adaptively utilizes plane information to improve depth prediction within a hierarchical framework. Specifically, in the proposed plane guided depth generator (PGDG), we design a set of plane queries as prototypes to softly model planes in the scene and predict per-pixel plane coefficients. Then the predicted plane coefficients can be converted into metric depth values with the pinhole camera model. In the proposed adaptive plane query aggregation (APGA) module, we introduce a novel feature interaction approach to improve the aggregation of multi-scale plane features in a top-down manner. Extensive experiments show that our method can achieve outstanding performance, especially in low-texture or repetitive areas. Furthermore, under the same backbone network, our method outperforms the state-of-the-art methods on the NYU-Depth-v2 dataset, achieves competitive results with state-of-the-art methods KITTI dataset and can be generalized to unseen scenes effectively.

21 November 2025 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
ZSZiyang Song
Ziyang Song
RZRuijie Zhu
Ruijie Zhu
JWJing Wang
Jing Wang
CWChuxin Wang
Chuxin Wang
JHJianfeng He
Jianfeng He
TZTianzhu Zhang
Tianzhu Zhang
Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics. However, existing methods are typically trained and evaluated on clear, sunny datasets, overlooking the impact of various adverse conditions commonly encountered in real-world applications, such as rainy weather, low visibility, and motion blur. As a result, they often struggle in challenging scenarios and produce artifacts. To address this issue, we propose ER-Depth, a novel two-stage self-supervised framework designed for robust depth estimation. In the first stage, we propose perturbation-invariant depth consistency regularization to propagate reliable supervision from standard to challenging scenes. In the second stage, we adopt the Mean Teacher paradigm for self-distillation and present a novel consistency-based pseudo-label filtering strategy to improve the quality of pseudo-labels. Extensive experiments demonstrate that our method exhibits exceptional robustness in challenging scenarios while maintaining high performance in standard scenes, significantly outperforming existing state-of-the-art methods on challenging KITTI-C, DrivingStereo, and NuScenes-Night benchmarks. Project page: https://ruijiezhu94.github.io/ERDepth_page .

12 May 2025
Verified
Book Chapter
Closed access
PDF file
PRPierluigi Zama Ramirez
Pierluigi Zama Ramirez
ACAlex Costanzino
Alex Costanzino
FTFabio Tosi
Fabio Tosi
MPMatteo Poggi
Matteo Poggi
LSLuigi Di Stefano
Luigi Di Stefano
JWJui-Lin Wang
Jui-Lin Wang

23 February 2026 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
RZRuijie Zhu
Ruijie Zhu
CWChuxin Wang
Chuxin Wang
ZSZiyang Song
Ziyang Song
LLLi Liu
Li Liu
JHJianfeng He
Jianfeng He
YZYongdong Zhang
Yongdong Zhang
Estimating the depth map of an image in the wild is a challenging visual task. Compared to relative depth estimation, metric depth estimation attracts more attention due to its practical physical significance and critical applications in real-life scenarios. However, existing depth estimation methods typically focus only on generalization of relative depth, neglecting the importance of metric depth generalization. To address this challenge, we propose a novel monocular depth estimation method called ScaleDepth. It decomposes metric depth into scene scale and relative depth and predicts them through a semantic-aware scale prediction (SASP) module and an adaptive relative depth estimation (ARDE) module, respectively. Our proposed approach has several merits. First, the SASP module can implicitly combine structural and semantic features of the images to predict precise scene scales. Second, the ARDE module can adaptively estimate the relative depth distribution of each image within a normalized depth space. Third, our method achieves metric depth estimation for both indoor and outdoor scenes in a unified framework, without the need to set the depth range or fine-tune the model. Extensive experiments demonstrate that our method achieves competitive performance in indoor, outdoor, unconfined, and unseen scenes. Project page: https://ruijiezhu94.github.io/ScaleDepth.