Jianfeng He

Jianfeng He

Auto-generated profile, based on publicly available information

Jianfeng He

School of Information Science and Technology, University of Science and Technology of China (USTC), Hefei, China

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024
Verified
Conference Paper
Open access
PDF file
Min ZhangMin Zhang
Min Zhang
JHJianfeng He
Jianfeng He
TJTaoran Ji
Taoran Ji
CLChang-Tien Lu
Chang-Tien Lu
Min Zhang, Jianfeng He, Taoran Ji, Chang-Tien Lu. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 June 2023
Verified
Conference Paper
Closed access
QYQianjin Yu
Qianjin Yu
YMYinchao Ma
Yinchao Ma
JHJianfeng He
Jianfeng He
DYDawei Yang
Dawei Yang
TZTianzhu Zhang
Tianzhu Zhang
Recently, the need for advanced anti-UAV techniques is increasing due to the rising threat of unauthorized drone intrusion. Object tracking, specifically in thermal infrared (TIR) videos, offers a potential solution to this issue. However, the tracked target often suffers dramatic scale variation, frequent target disappearance, and camera movement which severely influence tracking performance. Therefore, we propose a Unified Transformer-based Tracker, dubbed UTTracker, which contains the following four modules. Firstly, a multi-region local tracking module is designed with temporal cues for tackling target appearance variation and multi-region search for tracking targets in multi proposals. Complementarily, a global detection module is introduced to meet the challenge of target frequent disappearance. Meanwhile, a background correction module is incorporated to align the backgrounds between adjacent frames for alleviating camera movement. Particularly, a dynamic small object detection module for tracking the small target that lacks appearance information. Thanks to the designed modules, our UTTracker can achieve robust UAV tracking in TIR scenarios. Numerous experiments on the 1st and 2nd anti-UAV benchmarks demonstrate the effectiveness of UTTracker. Notably, UTTracker is the foundation of the 2nd-place winning entry in the 3rd Anti-UAV Challenge.

15 May 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
CWChuxin Wang
Chuxin Wang
JDJiacheng Deng
Jiacheng Deng
JHJianfeng He
Jianfeng He
TZTianzhu Zhang
Tianzhu Zhang
ZZZhe Zhang
Zhe Zhang
YZYongdong Zhang
Yongdong Zhang
3D object detection in point cloud aims at simultaneously localizing and recognizing 3D objects from a 3D point set. However, since point clouds are usually sparse, unordered, and irregular, it is challenging to learn robust point representations and sample high-quality object queries. To deal with the above issues, we propose a Long-short rangE Adaptive transformer with Dynamic sampling (LeadNet), including a point representation encoder, a dynamic object query sampling decoder, and an object detection decoder in a unified architecture for 3D object detection. Specifically, in the point representation encoder, we combine an attention layer and a channel attentive kernel convolution layer to consider the local structure and the long-range context simultaneously. In the dynamic object query sampling decoder, we utilize multiple dynamic prototypes to adapt to various point clouds. In the object detection decoder, we incorporate a dynamic Gaussian weight map into the cross-attention mechanism to help the detection decoder focus on the proper visual regions near the object, further accelerating the training process. Extensive experimental results on two standard benchmarks show that our LeadNet outperforms the 3DETR baseline by 11.6% mAP 50 on the ScanNet v2 dataset and achieves the new state-of-the-art results on ScanNet v2 and SUN RGB-D benchmarks for the geometric-only approaches.

9 January 2024 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
JCJiahao Chang
Jiahao Chang
JHJianfeng He
Jianfeng He
TZTianzhu Zhang
Tianzhu Zhang
JYJiyang Yu
Jiyang Yu
FWFeng Wu
Feng Wu
Recent learning-based methods demonstrate their strong ability to estimate depth for multi-view stereo reconstruction. However, most of these methods directly extract features via regular or deformable convolutions, and few works consider the alignment of the receptive fields between views while constructing the cost volume. Through analyzing the constraint and inference of previous MVS networks, we find that there are still some shortcomings that hinder the performance. To deal with the above issues, we propose an Epipolar-Guided Multi-View Stereo Network with Interval-Aware Label (EI-MVSNet), which includes an epipolar-guided volume construction module and an interval-aware depth estimation module in a unified architecture for MVS. The proposed EI-MVSNet enjoys several merits. First, in the epipolar-guided volume construction module, we construct cost volume with features from aligned receptive fields between different pairs of reference and source images via epipolar-guided convolutions, which take rotation and scale changes into account. Second, in the interval-aware depth estimation module, we attempt to supervise the cost volume directly and make depth estimation independent of extraneous values by perceiving the upper and lower boundaries, which can achieve fine-grained predictions and enhance the reasoning ability of the network. Extensive experimental results on two standard benchmarks demonstrate that our EI-MVSNet performs favorably against state-of-the-art MVS methods. Specifically, our EI-MVSNet ranks $1_{st}$ on both intermediate and advanced subsets of the Tanks and Temples benchmark, which verifies the high precision and strong robustness of our model.

21 November 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
RZRuijie Zhu
Ruijie Zhu
ZSZiyang Song
Ziyang Song
LLLi Liu
Li Liu
JHJianfeng He
Jianfeng He
TZTianzhu Zhang
Tianzhu Zhang
YZYongdong Zhang
Yongdong Zhang
Existing monocular depth estimation methods have achieved satisfactory performance on wild datasets. However, these methods are usually trained and tested on a single dataset, which makes them difficult to generalize to other scenarios. To learn diverse scene priors from multiple datasets, we propose a hierarchical framework with adaptive bins for robust monocular depth estimation, which consists of two critical components: a group-wise query generator to assign hierarchical bins and a correlation-aware transformer decoder to generate adaptive bin features. The proposed HA-Bins enjoys several merits. First, the group-wise query generator progressively increases the number of bin queries for multi-scale image features, resulting in a hierarchical bin distribution robust to diverse scenarios. Second, the correlation-aware transformer decoder refines the correlation of bin queries and image features, effectively improving adaptive image feature aggregation. We visualize the query activation maps on NYUDepthv2 dataset, showing that the proposed network effectively suppresses the depth-irrelevant regions. Experiments on KITTI, Sintel, and RabbitAI benchmarks show that without any fine-tuning, our model jointly trained on multiple datasets achieves competitive performance with the state-of-the-art and solid robustness toward diverse scenarios. In addition, our method wins second place in Robust Vision Challenge 2022 towards challenging scenarios with different characteristics.

16 May 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YMYinchao Ma
Yinchao Ma
JHJianfeng He
Jianfeng He
DYDawei Yang
Dawei Yang
TZTianzhu Zhang
Tianzhu Zhang
FWFeng Wu
Feng Wu
Visual tracking aims to estimate object state in a video sequence, which is challenging when facing drastic appearance changes. Most existing trackers conduct tracking with divided parts to handle appearance variations. However, these trackers commonly divide target objects into regular patches by a hand-designed splitting way, which is too coarse to align object parts well. Besides, a fixed part detector is difficult to partition targets with arbitrary categories and deformations. To address the above issues, we propose a novel adaptive part mining tracker (APMT) for robust tracking via a transformer architecture, including an object representation encoder, an adaptive part mining decoder, and an object state estimation decoder. The proposed APMT enjoys several merits. First, in the object representation encoder, object representation is learned by distinguishing target object from background regions. Second, in the adaptive part mining decoder, we introduce multiple part prototypes to adaptively capture target parts through cross-attention mechanisms for arbitrary categories and deformations. Third, in the object state estimation decoder, we propose two novel strategies to effectively handle appearance variations and distractors. Extensive experimental results demonstrate that our APMT achieves promising results with high FPS. Notably, our tracker is ranked the first place in the VOT-STb2022 challenge.