Hecheng Jia

Dr. Hecheng Jia

Information School, Fudan University, Shanghai, China
orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 January 2025 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Verified
Journal Article
Open access
XPXinyang Pu
Xinyang Pu
HJHecheng Jia
Hecheng Jia
LZLinghao Zheng
Linghao Zheng
FWFeng Wang
Feng Wang
Feng XuFeng Xu
Feng Xu
In the realm of artificial intelligence, the emergence of foundation models, backed by high computing capabilities and extensive data, has been revolutionary. Segment Anything Model (SAM), built on the Vision Transformer (ViT) model with millions of parameters and trained on its corresponding large-scale dataset SA-1B, excels in various segmentation scenarios relying on its significance of semantic information and generalization ability. Such achievement of visual foundation model stimulates continuous researches on specific downstream tasks in computer vision. The ClassWise-SAM-Adapter (CWSAM) is designed to adapt the high-performing SAM for landcover classification on space-borne Synthetic Aperture Radar (SAR) images. The proposed CWSAM freezes most of SAM's parameters and incorporates lightweight adapters for parameter efficient fine-tuning, and a classwise mask decoder is designed to achieve semantic segmentation task. This adapt-tuning method allows for efficient landcover classification of SAR images, balancing the accuracy with computational demand. In addition, the task specific input module injects low frequency information of SAR images by MLP-based layers to improve the model performance. Compared to conventional state-of-the-art semantic segmentation algorithms by extensive experiments, CWSAM showcases enhanced performance with fewer computing resources, highlighting the potential of leveraging foundational models like SAM for specific downstream tasks in the SAR domain. The source code is available at: https://github.com/xypu98/CWSAM.

28 February 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
HJHecheng Jia
Hecheng Jia
XPXinyang Pu
Xinyang Pu
QLQiaoyu Liu
Qiaoyu Liu
HWHaipeng Wang
Haipeng Wang
Feng XuFeng Xu
Feng Xu
Synthetic aperture radar (SAR) has emerged as a vital tool for ship monitoring due to its all-weather, all-day high-resolution imaging capabilities. In practical operations, the wide coverage and sparse ship distribution in very large full-scene SAR images pose challenges in terms of low efficiency and high false alarm rates. Traditional methods perform poorly in complex scenarios, while deep learning (DL) methods have high computation cost. This study proposes a fast progressive detection algorithm for ship targets in large SAR images, combining the advantages of traditional Non-DL methods and DL approaches. First, at a global scale, image preprocessing operations based on traditional methods are designed to quickly extract candidate regions. Then, at regional scale, an oriented ship detector is designed for refined ship detection within candidate regions. Finally, at individual-target scale, a false alarm discrimination network is constructed to further remove false alarms. Experimental results on GF-3 full-scene SAR images demonstrate that the proposed method can achieve minutes-level detection efficiency in images of billion-pixel-level size, while achieving high detection accuracy.

29 January 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YQYutong Qian
Yutong Qian
XPXinyang Pu
Xinyang Pu
HJHecheng Jia
Hecheng Jia
HWHaipeng Wang
Haipeng Wang
Feng XuFeng Xu
Feng Xu
Amidst the landscape of contemporary remote sensing technology, the endeavor to detect and recognize aircraft within remote sensing images (RSIs) assumes pivotal strategic and practical significance. The complex nature of fine-grained aircraft recognition is a result of the intricate interplay between aircraft and their background environments, alongside category imbalance, which collectively lead to the emergence of a long-tail distribution within the dataset. However, experts proficient in RSIs interpretation can effectively address these challenges through the application of prior knowledge. This paper introduces the Aircraft Reasoning Network (ARNet), a framework tailored for aircraft detection and fine-grained recognition in RSIs, building upon prior knowledge employed in expert interpretation. Specifically, the Knowledge Reasoning Module (KRM) introduces a knowledge graph that incorporates both common and expert knowledge into the end-to-end network. Additionally, the network encompasses a Spatial Context Module (SCM) and an Airport Facility Relationship Module (AFRM). These components facilitate highly accurate detection and recognition of fine-grained aircraft in diverse environmental contexts by employing adaptive prior knowledge reasoning and optimizing target spatial location. Furthermore, an independent Aircraft Component Discrimination Module (ACDM) distinguishes aircraft based on their predominant component features, contributing to improved classification performance in both the few-shot and easily confused categories. Moreover, this paper introduces the AR-RSI dataset, a compilation of RSIs capturing fine-grained aircraft targets from diverse locations. The effectiveness and superiority of ARNet are exemplified on AR-RSI, achieving a minimum of 3.7 percentage higher mAP than the mainstream aircraft detection framework.

15 December 2023 in IEEE Transactions on Aerospace and Electronic Systems
Verified
Journal Article
Closed access
XXXiayang Xiao
Xiayang Xiao
HJHecheng Jia
Hecheng Jia
QWQing Wang
Qing Wang
Penghao XiaoPenghao Xiao
Penghao Xiao
CFChunzhuo Fan
Chunzhuo Fan
HWHaipeng Wang
Haipeng Wang
Synthetic aperture radar (SAR) image intelligence interpretation is always a challenging task due to its special imaging mechanism. This paper focuses on the aircraft detection and recognition in large-scale SAR images. The objects in large-size SAR images are usually sparsely distributed and tend to be highly concentrated in certain areas. Therefore, the detection and classification in SAR images are affected easily by imaging environment, leading to ineffective and instability. It suffers from time-consuming, high false-alarm rate, and low recognition rate. To alleviate these problems, a joint probability detector (JPD) integrated with scattering attention (SA) is designed for aircraft detection and classification. Based on the fact that all aircraft are parked in the airport area, an airport detection method with mixed strategy (ADMS) is proposed to obtain the valid region (airport), narrowing downing the scope of detection area, increasing the detection efficiency as well as suppressing a lot of false alarms outside the airport. Considering that it's easy to generate false alarms within the airport on account of clutter scattering interference, a two-stage detector is introduced to improve the accuracy by replacing a stronger region proposal network (RPN) and optimizing a lower bound to a joint probabilistic objective over two stages. Furthermore, the classification encoder module incorporates scattering attention into convolution neural network to leverage the distribution relation among strong scattered points to enhance the classification performance. Finally, extensive experiments on the ZKXT and GaoFen-3 datasets verify the effectiveness and superiority of the proposed approach, and surpass runner up by 5.3% with mF1 indicator. On a large GaoFen3 image (16550× 11945 pixels), the proposed method improves the detection speed by 187.52%, without sacrificing the accuracy. More importantly, the proposed method has been applied to the SAR image interpretation and achieved the expected effect in the actual application.

29 June 2023 in Remote Sensing
Verified
Journal Article
Open access
PDF file
XPXinyang Pu
Xinyang Pu
HJHecheng Jia
Hecheng Jia
YXYu Xin
Yu Xin
FWFeng Wang
Feng Wang
HWHaipeng Wang
Haipeng Wang
Ship detection in low-quality Synthetic Aperture Radar (SAR) images poses a persistent challenge. Noise signals in complex environments disrupt imaging conditions, hindering SAR systems from acquiring precise target information, thereby significantly compromising the performance of detectors. Some methods mitigate interference via denoising techniques, while others introduce noise using classical methods to learn target features in the presence of noise. This conundrum is regarded as a cross-domain problem in this paper; a ship detection method in low-quality images is proposed to learn features of targets and shrink serious deterioration of detection performance by utilizing Generative Adversarial Networks (GANs). First, an image-to-image translation task is implemented using CycleGAN to generate low-quality SAR images with complex interference from the source domain to the target domain. Second, with the annotation inheritance, these generated SAR images participate in a training process to improve the detection accuracy and model robustness. Multiple experiments indicate that the proposed method conspicuously improves the detection performance and efficaciously reduces the missed detection rate in the SAR ship detection task. This cross-domain approach achieved outstanding improvements in the form of 11.0% mAP and 3.22% mAP on the GaoFen-3 ship dataset and SRSSD-V1.0, respectively. In addition, the characteristics and potentials of near-shore and off-shore SAR image reconstruction with style transfer based on Generative Adversarial Networks were explored and analyzed in this work.

21 June 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YWYanni Wang
Yanni Wang
HJHecheng Jia
Hecheng Jia
SFShilei Fu
Shilei Fu
Huiping LinHuiping Lin
Huiping Lin
Feng XuFeng Xu
Feng Xu
This paper attempts to infer the orientation angle of the target in synthetic aperture radar (SAR) images using reinforcement learning. It is intended to address the challenges like limited interpretability, the scarcity of SAR data and complex imaging mechanisms restrict the broader application of learning-based approaches. We propose an interactive deep reinforcement learning (DRL) framework, where an electromagnetic simulator named differentiable SAR renderer (DSR) is embedded to facilitate the interaction between the agent and the environment. Specifically, DSR generates SAR images at arbitrary orientation angles in real time, helping to simulate a human-like process of angle estimation. The differences in sequential and semantic aspects between images of different orientation angles are leveraged to construct the state space in DRL, which effectively suppress the complex background interference, and enhance the sensitivity to temporal variations. Moreover, to maintain the stability and convergence of our approach, reward mechanisms such as memory difference, smoothing and boundary penalty are incorporated to contribute to the formulation of the comprehensive reward function. Extensive experiments performed on both simulated and real datasets demonstrate the effectiveness and robustness of our proposed method. In addition, when utilized in the cross-domain area, the proposed method mitigates inconsistency between simulated and real domains, outperforming reference methods significantly.