Chao Xu

Dr. Chao Xu

School of Optics and Photonics, Beijing Institute of Technology, Beijing, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 April 2023 in IEEE Access
Verified
Journal Article
Open access
YZYuwei Zhao
Yuwei Zhao
XWXia Wang
Xia Wang
YFYujie Fang
Yujie Fang
CXChao Xu
Chao Xu
Time-of-Flight imaging is one of the quintessential techniques in three-dimensional reconstruction. However, depth missing is a common problem in Time-of-Flight imaging, which can be classified into structure-based depth loss and large-area one according to various reasons. Large-area depth loss generally occurs due to close-range overexposure resulting in limited dynamic range in depth sensing. Compared to structure-based depth loss, the recovery of large-area depth missing is more challenging and has been rarely studied. In this paper, a large-area depth recovery framework guided by polarization cues is proposed stemmed from a solid physical basic concerning depth and polarization, to realize high dynamic range in applications. Inspired by RGB-D system and shape-from-polarization technique, a dual camera system is utilized including infrared Time-of-Flight camera and visible polarized camera. A physical model between depth map and polarization cues, specifically depth-gradient and degree-of-polarization, is investigated and established. Based on the physical basics, a corresponding polarization-guided depth recovery algorithm with statistical analysis and image processing approach is introduced. Experimental results towards different targets demonstrate the effectiveness of the proposed method qualitatively and quantitatively, accompanied with outcome analysis and detailed discussions about strengths and future works, which indicates a great potential for the applications of high-quality three-dimensional reconstruction and depth sensing.

29 May 2025 in IEEE Access
Verified
Journal Article
Open access
RHRihua Hao
Rihua Hao
CXChao Xu
Chao Xu
CZChonghao Zhong
Chonghao Zhong
Monocular depth estimation offers cost-effective 3D perception, while thermal infrared sensors show high robustness under varying illumination conditions. Their combination is crucial for day and night 3D perception, yet it faces two key challenges: (1) inadequate processing of 14-bit RAW data, leading to loss of subtle infrared information, and (2) the resolution limitation of current infrared datasets (existing 640×512 sensor collections restrict the camera’s ability to capture critical scene details). To this end, in this paper, we introduce the IRSL dataset, which integrates infrared, stereo RGB, and LiDAR modalities. Data were acquired using a high-resolution thermal camera (1280×1024 pixels), synchronized stereo cameras, and LiDAR (500K points per frame). The dataset aims to enhance the precision and robustness of depth estimation in both daytime and nighttime environments. Secondly, this paper proposes Radiation Field Detail Enhancement (RFDE), a novel method for enhancing infrared radiation field details in RAW data. This method performs gray mapping based on radiation field intensity and spatial context awareness and uses a bilateral filter to enhance the details in the image. Experimental results show that the proposed RFDE method fully leverages the advantages of high-resolution infrared images, effectively improving the quantitative and qualitative performance of the MDE model (δ1 = 0.964, SqRel = 0.441).

27 June 2025 in Sensors
Verified
Journal Article
Open access
PDF file
RHRihua Hao
Rihua Hao
CXChao Xu
Chao Xu
CZChonghao Zhong
Chonghao Zhong
Monocular depth estimation (MDE) has emerged as a powerful technique for extracting scene depth from a single image, particularly in the context of computational imaging. Conventional MDE methods based on RGB images often degrade under varying illuminations. To overcome this, an end-to-end framework is developed that leverages the illumination-invariant properties of infrared images for accurate depth estimation. Specifically, a multi-task UNet architecture was designed to perform gradient extraction, semantic segmentation, and texture reconstruction from infrared RAW images. To strengthen structural learning, a Radiation Field Gradient Guidance (RGG) module was incorporated, enabling edge-aware attention mechanisms. The gradients, semantics, and textures were mapped to the Saturation (S), Hue (H), and Value (V) channels in the HSV color space, subsequently converted into an RGB format for input into the depth estimation network. Additionally, a sky mask loss was introduced during training to mitigate the influence of ambiguous sky regions. Experimental validation on a custom infrared dataset demonstrated high accuracy, achieving a δ1 of 0.976. These results confirm that integrating radiation field gradient guidance and semantic priors in HSV space significantly enhances depth estimation performance for infrared imagery.

7 October 2024 in arXiv
Verified
Preprint
Open access
PDF file
CZChonghao Zhong
Chonghao Zhong
CXChao Xu
Chao Xu
Neural radiance fields (NeRF) has gained significant attention for its exceptional visual effects. However, most existing NeRF methods reconstruct 3D scenes from RGB images captured by visible light cameras. In practical scenarios like darkness, low light, or bad weather, visible light cameras become ineffective. Therefore, we propose TeX-NeRF, a 3D reconstruction method using only infrared images, which introduces the object material emissivity as a priori, preprocesses the infrared images using Pseudo-TeX vision, and maps the temperatures (T), emissivities (e), and textures (X) of the scene into the saturation (S), hue (H), and value (V) channels of the HSV color space, respectively. Novel view synthesis using the processed images has yielded excellent results. Additionally, we introduce 3D-TeX Datasets, the first dataset comprising infrared images and their corresponding Pseudo-TeX vision images. Experiments demonstrate that our method not only matches the quality of scene reconstruction achieved with high-quality RGB images but also provides accurate temperature estimations for objects in the scene.

12 May 2026 in Sensors
Verified
Journal Article
Open access
PDF file
CZChonghao Zhong
Chonghao Zhong
CXChao Xu
Chao Xu
Dynamic scene reconstruction from thermal infrared imagery remains insufficiently studied due to several inherent challenges, including low texture, low contrast, and radiometric ambiguity. In this paper, we present Thermal4D, a novel framework for reconstructing high-fidelity dynamic 3D scenes using only thermal images, without requiring visible-light inputs or auxiliary sensors. Built upon the 3D Gaussian Splatting paradigm, the proposed method introduces two key components. First, a frequency-aware attention module, termed TherHiLo, is designed to disentangle structural features across different frequency bands. Second, a physics-inspired atmospheric transmission module (ATM) is developed to model radiometric distortions caused by thermal imaging conditions. Although the reconstruction pipeline takes 8-bit thermal video sequences as input, high-precision 14-bit thermal frames are further exploited in TherHiLo to enhance attention learning with richer radiometric information. In addition, feature-level supervision from pretrained DINOv2 models is incorporated to improve structural consistency. To facilitate systematic evaluation, we also construct MVTD, a new multi-view dynamic thermal dataset. Experimental results on the MVTD and TI-NSD benchmarks show that Thermal4D consistently outperforms existing methods in both dynamic and static scenes, providing an effective framework for physics-consistent dynamic thermal scene reconstruction.