lehan Han

Mr. lehan Han

Zhejiang University

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
YJYangbo Jiang
Yangbo Jiang
Zhiwei JiangZhiwei Jiang
Zhiwei Jiang
LHlehan Han
lehan Han
ZHZenan Huang
Zenan Huang
NZNenggan Zheng
Nenggan Zheng
Channel attention mechanisms endeavor to recalibrate channel weights to enhance representation abilities of networks. However, mainstream methods often rely solely on global average pooling as the feature squeezer, which significantly limits the overall potential of models. In this paper, we investigate the statistical moments of feature maps within a neural network. Our findings highlight the critical role of high-order moments in enhancing model capacity. Consequently, we introduce a flexible and comprehensive mechanism termed Extensive Moment Aggregation (EMA) to capture the global spatial context. Building upon this mechanism, we propose the Moment Channel Attention (MCA) framework, which efficiently incorporates multiple levels of moment-based information while minimizing additional computation costs through our Cross Moment Convolution (CMC) module. The CMC module via channel-wise convolution layer to capture multiple order moment information as well as cross channel features. The MCA block is designed to be lightweight and easily integrated into a variety of neural network architectures. Experimental results on classical image classification, object detection, and instance segmentation tasks demonstrate that our proposed method achieves state-of-the-art results, outperforming existing channel attention methods.

4 April 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
LHlehan Han
lehan Han
KCKaixuan Chen
Kaixuan Chen
LZLei Zhao
Lei Zhao
YJYangbo Jiang
Yangbo Jiang
PWPengfei Wang
Pengfei Wang
NZNenggan Zheng
Nenggan Zheng
Animal pose estimation is often constrained by the scarcity of annotations and the diversity of scenarios and species. The pseudo-label generation based unsupervised domain adaptation paradigm, which discriminates the predicted keypoints of unlabeled data based on the skeleton position consistency, has demonstrated effectiveness for such problems. However, existing methods generate pseudo-labels with massive false positives, because they cannot effectively distinguish sample pairs with the same errors. In this study, we propose a cross-domain animal pose estimation model from a novel perspective of skeleton anomaly learning. We construct a graph contrastive learning mechanism to acquire the skeleton anomaly-aware knowledge, which enables the generation of accurate pseudo-labels for target domain and imposes graph constraint on unlabeled data. And a skeleton anomaly-feedback based domain adaptation framework is designed to facilitate implicit alignment of object-specific features and joint training of cross-domain. Besides, we propose a novel rat pose dataset named UDARP-9.4K to address the gap of small-sized animal pose datasets encompassing diverse experimental scenarios. The related datasets are reviewed and evaluated in detail. Extensive experiments are conducted on UDARP-9.4K and two public datasets to demonstrate the superiority of the proposed model in cross-scenarios and cross-species animal pose estimation tasks. Further analysis reveals the effectiveness of the proposed model for skeleton structure feature learning. The UDARP-9.4K dataset is available here.

14 January 2022 in Remote Sensing
Verified
Journal Article
Open access
PDF file
XFXinxi Feng
Xinxi Feng
LHlehan Han
lehan Han
LDLe Dong
Le Dong
Recently, unmixing methods based on nonnegative tensor factorization have played an important role in the decomposition of hyperspectral mixed pixels. According to the spatial prior knowledge, there are many regularizations designed to improve the performance of unmixing algorithms, such as the total variation (TV) regularization. However, these methods mostly ignore the similar characteristics among different spectral bands. To solve this problem, this paper proposes a group sparse regularization that uses the weighted constraint of the L2,1 norm, which can not only explore the similar characteristics of the hyperspectral image in the spectral dimension, but also keep the data smooth characteristics in the spatial dimension. In summary, a non-negative tensor factorization framework based on weighted group sparsity constraint is proposed for hyperspectral images. In addition, an effective alternating direction method of multipliers (ADMM) algorithm is used to solve the algorithm proposed in this paper. Compared with the existing popular methods, experiments conducted on three real datasets fully demonstrate the effectiveness and advancement of the proposed method.

31 May 2024 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
NZNenggan Zheng
Nenggan Zheng
HZHan Zhang
Han Zhang
LHlehan Han
lehan Han
CLChao Liu
Chao Liu
QLQiqi Li
Qiqi Li
GZGuangyu Zhu
Guangyu Zhu
Controlling the cyborg rat with the guidance of an unmanned aerial vehicle (UAV) is important yet challenging. UAV can provide a mobile bird’s eye view (BEV) with multiple shooting angles to expand the motion space of the cyborg rat. However, uncertainty is a critical problem arising from the obscure and blurry imaging from UAV and the locomotion willingness of cyborg rats. To solve this problem, we propose the collaborative Rat-UAV navigation (RUN) paradigm. The uncertainty in RUN is formulated using the partially observed Markov decision processes (POMDP) in a perceptual-control framework. First, perceptual uncertainties in rat pose estimation and environmental modeling are reduced. Second, control policies are delivered to maximize rewards and minimize control uncertainties until the cyborg rat reaches the target. To achieve this, RUN can accurately detect tiny rats with fewer parameters, dynamically plan paths with partial observations from the UAV, and stably control the rat using a locomotion willingness transition graph in a large practical arena. Our framework is tested in real-world experiments. For the first time, a cyborg rat successfully completed a navigation task with the guidance of a UAV. Note to Practitioners —This paper studies, for the first time, the problem of navigating a cyborg rat with the guidance of an unmanned aerial vehicle (UAV). Most existing researches on the autonomous navigation of cyborg rats are conducted in fully observed environments with fixed cameras, disregarding uncertainties in complex environmental perception and rat control. In this paper, we propose a collaborative Rat-UAV navigation (RUN) paradigm, which formulates uncertainties using the partially observed Markov decision processes (POMDP). Specifically, RUN enhances the cyborg rat’s interaction with the UAV in the navigation environment. First, it narrows the gap between the rat’s perceived and actual states by utilizing keypoint detection, dynamic environment modeling, and locomotion willingness estimation from the view of the UAV. Secondly, RUN constructs a policy generation module to maximize the reward of controlling the cyborg rat, based on a locomotion willingness transition graph. Experimental results demonstrate that our framework effectively guides the cyborg rat through a large maze, followed by six targets, with the assistance of the UAV. In future researches, we will investigate the real-time prediction of rat locomotion willingness using multimodal neuroethological recordings, towards a bidirectional brain computer interface between rats and UAVs.

6 June 2025 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
LHlehan Han
lehan Han
LZLei Zhao
Lei Zhao
HZHan Zhang
Han Zhang
ZSZhiying Song
Zhiying Song
PWPengfei Wang
Pengfei Wang
NZNenggan Zheng
Nenggan Zheng
Remote measurement of animal pose and motion is essential in neuroscience and robotics. However, subjects like rats often appear as small objects in open environments, occupying a minimal field of view. The scarcity of visual information and high susceptibility to errors presents significant challenges for remote measurement of the pose of these objects. This study introduces SalPose, a pose estimation model designed for small objects, addressing these challenges through rapid perception of small objects and keypoints structural information mining. First, we enhance the perception of weak visual features by integrating saliency detection and constructing pseudo-saliency maps with annotated keypoints. Second, a scale-invariant structural similarity constraint is developed to facilitate the learning of intrinsic keypoint features and reduce the impact of small object size. Additionally, to address the crucial gap in small-sized animal behavior analysis datasets in open environments, we introduce RP-5.7K, a rat pose dataset comprising exclusively small object data from the aerial perspective. Extensive experiments on the proposed dataset and two public datasets demonstrate the superiority of the proposed model. This study presents a novel method for remote motion measurement using visual information, mitigating the high sensitivity of small objects to distance-based measurement errors. The contributed dataset is valuable for visual measurement tasks involving small objects and animal behavior analysis. The RP-5.7K dataset is available here.

26 October 2023
Verified
Conference Paper
Open access
LZLei Zhao
Lei Zhao
LHlehan Han
lehan Han
MYMin Yao
Min Yao
NZNenggan Zheng
Nenggan Zheng
In the field of pose estimation, keypoint representations can take the form of Gaussian heatmaps, classification vectors, or direct coordinates. However, the current networks suffer from a lack of consistency with these keypoint representations. They only accommodate these representations in the final layer, resulting in suboptimal efficiency and requiring a high number of parameters or computational resources. In this paper, we propose a simple yet efficient plug-and-play module, named the Implicit Decouple Module (IDM), which decouples features into two parts along the x-y axes and aggregates features in a direction-aware manner. This approach implicitly fuses direction-specific coordinate information, improving the consistency with the keypoint representations, especially in vector form. Furthermore, we introduce a fully convolutional backbone network, named the Implicit Decouple Network (IDN), which incorporates IDM without the need to maintain high-resolution features, dense multi-level feature fusion, or lots of repeated stages, while still achieving high performance. In experiments on the COCO dataset, our basic IDN without pre-training can outperform HRNet (28.5M) by 2.4 AP with 18.2M parameters, and even surpass some transformer-based methods. In the lightweight model scenario, our model outstrips Lite-HRNet by 3.9 AP with only 2.5M parameters. We also evaluate our model on the person instance segmentation task and other datasets, demonstrating its generality and effectiveness. http(s)://znk.ink/su/mm23idn.