Bochen Xie

Bochen Xie

Auto-generated profile, based on publicly available information

Bochen Xie

Department of Mechanical Engineering, City University of Hong Kong, Hong Kong SAR, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 January 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
HLHai Liu
Hai Liu
CZCheng Zhang
Cheng Zhang
YDYongjian Deng
Yongjian Deng
BXBochen Xie
Bochen Xie
Tingting LiuTingting Liu
Tingting Liu
YLYou-Fu Li
You-Fu Li
Fine-grained bird image classification (FBIC) is not only meaningful for endangered bird observation and protection but also a prevalent task for image classification in multimedia processing and computer vision. However, FBIC suffers from several challenges, such as bird molting, complex background, and arbitrary bird posture. To effectively tackle these challenges, we present a novel invariant cues-aware feature concentration Transformer (TransIFC), which learns invariant and core information in bird images. To this end, two novel modules are proposed to leverage the characteristics of bird images, namely, the hierarchy stage feature aggregation (HSFA) module and the feature in feature abstraction (FFA) module. The HSFA module aggregates the multiscale information of bird images by concatenating multilayer features. The FFA module extracts the invariant cues of birds through feature selection based on discrimination scores. Transformer is employed as the backbone to reveal the long-dependent semantic relationships in bird images. Moreover, abundant visualizations are provided to prove the interpretability of the HSFA and FFA modules in TransIFC. Comprehensive experiments demonstrate that TransIFC can achieve state-of-the-art performance on the CUB-200-2011 dataset (91.0%) and the NABirds dataset (90.9%). Finally, extended experiments have been conducted on the Stanford Cars dataset to suggest the potential of generalizing our method on other fine-grained visual classification tasks.

6 January 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
BXBochen Xie
Bochen Xie
YDYongjian Deng
Yongjian Deng
ZSZhanpeng Shao
Zhanpeng Shao
HLHai Liu
Hai Liu
YLYoufu Li
Youfu Li
Event cameras can perceive pixel-level brightness changes to output asynchronous event streams, and have notable advantages in high temporal resolution, high dynamic range and low power consumption for challenging vision tasks. To apply existing learning models on event data, many researchers integrate sparse events into dense frame-based representations which can work with convolutional neural networks directly. Although these works achieve high performance on event-based classification, their models need lots of parameters to process dense event frames which do not fit with the sparsity of event data. To utilize the sparse nature of events, we propose a voxel-wise graph learning model ( VMV-GCN ) for spatio-temporal feature learning on event streams. Specifically, we design the volumetric multi-view fusion module ( VMVF ) to extract spatial and temporal information from views of voxelized event data. Then we take representative event voxels as vertices and use a novel dual-graph construction strategy to connect them. By aggregating neighborhood information based on relationships of vertices, the proposed dynamic neighborhood feature learning module ( DNFL ) can capture discriminative spatio-temporal features on dynamically updated graphs. Experiments show that our method achieves state-of-the-art performance with low model complexity on event-based classification tasks, such as object classification and action recognition.

21 March 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
BXBochen Xie
Bochen Xie
YDYongjian Deng
Yongjian Deng
ZSZhanpeng Shao
Zhanpeng Shao
YLYoufu Li
Youfu Li
Bio-inspired event cameras record a scene as sparse and asynchronous “events” by detecting per-pixel brightness changes. Such cameras show great potential in challenging scene understanding tasks, benefiting from the imaging advantages of high dynamic range and high temporal resolution. Considering the complementarity between event and standard cameras, we propose a multi-modal fusion network (EISNet) to improve the semantic segmentation performance. The key challenges of this topic lie in ( i ) how to encode event data to represent accurate scene information and ( ii ) how to fuse multi-modal complementary features by considering the characteristics of two modalities. To solve the first challenge, we propose an Activity-Aware Event Integration Module (AEIM) to convert event data into frame-based representations with high-confidence details via scene activity modeling. To tackle the second challenge, we introduce the Modality Recalibration and Fusion Module (MRFM) to recalibrate modal-specific representations and then aggregate multi-modal features at multiple stages. MRFM learns to generate modal-oriented masks to guide the merging of complementary features, achieving adaptive fusion. Based on these two core designs, our proposed EISNet adopts an encoder-decoder transformer architecture for accurate semantic segmentation using events and images. Experimental results show that our model outperforms state-of-the-art methods by a large margin on event-based semantic segmentation datasets. The code is publicly available at https://github.com/bochenxie/EISNet .

23 August 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
BXBochen Xie
Bochen Xie
YDYongjian Deng
Yongjian Deng
ZSZhanpeng Shao
Zhanpeng Shao
Qingsong XuQingsong Xu
Qingsong Xu
YLYoufu Li
Youfu Li
Event cameras are neuromorphic vision sensors that record a scene as sparse and asynchronous event streams. Most event-based methods project events into dense frames and process them using conventional vision models, resulting in high computational complexity. A recent trend is to develop point-based networks that achieve efficient event processing by learning sparse representations. However, existing works may lack robust local information aggregators and effective feature interaction operations, thus limiting their modeling capabilities. To this end, we propose an attention-aware model named Event Voxel Set Transformer (EVSTr) for efficient spatiotemporal representation learning on event streams. It first converts the event stream into voxel sets and then hierarchically aggregates voxel features to obtain robust representations. The core of EVSTr is an event voxel transformer encoder that consists of two well-designed components, including the Multi-Scale Neighbor Embedding Layer (MNEL) for local information aggregation and the Voxel Self-Attention Layer (VSAL) for global feature interaction. Enabling the network to incorporate a long-range temporal structure, we introduce a segment modeling strategy (S2TM) to learn motion patterns from a sequence of segmented voxel sets. The proposed model is evaluated on two recognition tasks, including object classification and action recognition. To provide a convincing model evaluation, we present a new event-based action recognition dataset (NeuroHAR) recorded in challenging scenarios. Comprehensive experiments show that EVSTr achieves state-of-the-art performance while maintaining low model complexity.

18 February 2025 in Neurocomputing
Verified
Journal Article
Closed access
YLYuhan Liu
Yuhan Liu
YDYongjian Deng
Yongjian Deng
BXBochen Xie
Bochen Xie
HLHai Liu
Hai Liu
ZYZhen Yang
Zhen Yang
YLYoufu Li
Youfu Li

5 September 2025 in Engineering Applications of Artificial Intelligence
Verified
Journal Article
Closed access
HMHaoxiang Ma
Haoxiang Ma
YDYongjian Deng
Yongjian Deng
BXBochen Xie
Bochen Xie
JLJian Liu
Jian Liu
HLHai Liu
Hai Liu
ZYZhen Yang
Zhen Yang