Siliang Du

Dr. Siliang Du


Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 April 2018 in Sensors
Verified
Journal Article
Open access
PDF file
XCXueli Chang
Xueli Chang
SDSiliang Du
Siliang Du
YLYingying Li
Yingying Li
SFShenghui Fang
Shenghui Fang
Large size high resolution (HR) satellite image matching is a challenging task due to local distortion, repetitive structures, intensity changes and low efficiency. In this paper, a novel matching approach is proposed for the large size HR satellite image registration, which is based on coarse-to-fine strategy and geometric scale-invariant feature transform (SIFT). In the coarse matching step, a robust matching method scale restrict (SR) SIFT is implemented at low resolution level. The matching results provide geometric constraints which are then used to guide block division and geometric SIFT in the fine matching step. The block matching method can overcome the memory problem. In geometric SIFT, with area constraints, it is beneficial for validating the candidate matches and decreasing searching complexity. To further improve the matching efficiency, the proposed matching method is parallelized using OpenMP. Finally, the sensing image is rectified to the coordinate of reference image via Triangulated Irregular Network (TIN) transformation. Experiments are designed to test the performance of the proposed matching method. The experimental results show that the proposed method can decrease the matching time and increase the number of matching points while maintaining high registration accuracy.

11 August 2023 in Remote Sensing
Verified
Journal Article
Open access
PDF file
SDSiliang Du
Siliang Du
YXYilin Xiao
Yilin Xiao
JHJingwei Huang
Jingwei Huang
MSMingwei Sun
Mingwei Sun
MLMingzhong Liu
Mingzhong Liu
GLFNet is proposed to be utilized for the detection and matching of local features among remote-sensing images, with existing sparse feature points being leveraged as guided points. Local feature matching is a crucial step in remote-sensing applications and 3D reconstruction. However, existing methods that detect feature points in image pairs and match them separately may fail to establish correct matches among images with significant differences in lighting or perspectives. To address this issue, the problem is reformulated as the extraction of corresponding features in the target image, given guided points from the source image as explicit guidance. The approach is designed to encourage the sharing of landmarks by searching for regions in the target image with features similar to the guided points in the source image. For this purpose, GLFNet is developed as a feature extraction and search network. The main challenge lies in efficiently searching for accurate matches, considering the massive number of guided points. To tackle this problem, the search network is divided into a coarse-level match network-based guided point transformer that narrows the search space and a fine-level regression network that produces accurate matches. The experimental results on challenging datasets demonstrate that the proposed method provides robust matching and benefits various applications, including remote-sensing image registration, optical flow estimation, visual localization, and reconstruction registration. Overall, a promising solution is offered by this approach to the problem of local feature matching in remote-sensing applications.

29 May 2024 in Applied Intelligence
Verified
Journal Article
Closed access
PDF file
YXYilin Xiao
Yilin Xiao
SDSiliang Du
Siliang Du
XCXu Chen
Xu Chen
MLMingzhong Liu
Mingzhong Liu
MSMingwei Sun
Mingwei Sun

28 August 2024 in arXiv
Verified
Preprint
Open access
PDF file
YYYu Yang
Yu Yang
JMJianbiao Mei
Jianbiao Mei
LLLiang Liu
Liang Liu
SDSiliang Du
Siliang Du
YXYilin Xiao
Yilin Xiao
Huifeng WuHuifeng Wu
Huifeng Wu
LiDAR panoptic segmentation, which jointly performs instance and semantic segmentation for things and stuff classes, plays a fundamental role in LiDAR perception tasks. While most existing methods explicitly separate these two segmentation tasks and utilize different branches (i.e., semantic and instance branches), some recent methods have embraced the query-based paradigm to unify LiDAR panoptic segmentation. However, the distinct spatial distribution and inherent characteristics of objects(things) and their surroundings(stuff) in 3D scenes lead to challenges, including the mutual competition of things/stuff and the ambiguity of classification/segmentation. In this paper, we propose decoupling things/stuff queries according to their intrinsic properties for individual decoding and disentangling classification/segmentation to mitigate ambiguity. To this end, we propose a novel framework dubbed DQFormer to implement semantic and instance segmentation in a unified workflow. Specifically, we design a decoupled query generator to propose informative queries with semantics by localizing things/stuff positions and fusing multi-level BEV embeddings. Moreover, a query-oriented mask decoder is introduced to decode corresponding segmentation masks by performing masked cross-attention between queries and mask embeddings. Finally, the decoded masks are combined with the semantics of the queries to produce panoptic results. Extensive experiments on nuScenes and SemanticKITTI datasets demonstrate the superiority of our DQFormer framework.

1 October 2025 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Verified
Journal Article
Open access
YXYilin Xiao
Yilin Xiao
YYYu Yang
Yu Yang
SDSiliang Du
Siliang Du
MLMingzhong Liu
Mingzhong Liu
XCXu Chen
Xu Chen
MSMingwei Sun
Mingwei Sun
Matching and aligning ground and aerial images is critical for enhancing the accuracy and completeness of 3D reconstruction. However, significant differences in perspective and radiometric characteristics between aerial and ground images make this task highly challenging. Existing mesh-based approaches often overlook the geometric properties of 3D points in the SfM model and suffer from limited track length. To address these issues, we propose a 3D Point-Guided Matching (PGM) framework that leverages reconstructed 3D points to guide the matching between aerial and ground images. Our method introduces a 3D Point-Guided Transformer (PGT) to encode point coordinates into embeddings and integrate them into image features, enabling effective correspondence between synthetic aerial views and real ground images. In addition, we design a Transformer-based Regression Module (TRM) to refine matching positions within local windows, improving the accuracy of aerial-ground correspondences. Our pipeline reduces matching errors, enables long-track correspondences, and facilitates robust multi-view integration. Furthermore, we construct two challenging aerial-ground datasets to validate the effectiveness of our method in city-scale 3D reconstruction. Extensive experiments on public benchmarks and our datasets demonstrate that our framework significantly outperforms state-of-the-art methods in both matching accuracy and reconstruction quality.