Chuanbo Zhu

Dr. Chuanbo Zhu


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 October 2021 in Knowledge-Based Systems
Verified
Journal Article
Closed access
SZSheng Zhang
Sheng Zhang
MCMin Chen
Min Chen
JCJincai Chen
Jincai Chen
YLYuan-Fang Li
Yuan-Fang Li
YWYiling Wu
Yiling Wu
CZChuanbo Zhu
Chuanbo Zhu

28 January 2025 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
CSChao Sun
Chao Sun
Min ChenMin Chen
Min Chen
CZChuanbo Zhu
Chuanbo Zhu
SZSheng Zhang
Sheng Zhang
PLPing Lu
Ping Lu
Jincai ChenJincai Chen
Jincai Chen
In real-world physiological and psychological scenarios, there often exists a robust complementary correlation between audio and visual signals. Audio-Visual Event Localization (AVEL) aims to identify segments with Audio-Visual Events (AVEs) that contain both audio and visual tracks in unconstrained videos. Prior studies have predominantly focused on audio-visual cross-modal fusion methods, overlooking the fine-grained exploration of the cross-modal information fusion mechanism. Moreover, due to the inherent heterogeneity of multi-modal data, inevitable new noise is introduced during the audio-visual fusion process. To address these challenges, we propose a novel Cross-modal Contrastive Learning Network (CCLN) for AVEL, comprising a backbone network and a branch network. In the backbone network, drawing inspiration from physiological theories of sensory integration, we elucidate the process of audio-visual information fusion, interaction, and integration from an information-flow perspective. Notably, the Self-constrained Bi-modal Interaction (SBI) module is a bi-modal attention structure integrated with audio-visual fusion information, and through gated processing of the audio-visual correlation matrix, it effectively captures inter-modal correlation. The Foreground Event Enhancement (FEE) module emphasizes the significance of event-level boundaries by elongating the distance between scene events during training through adaptive weights. Furthermore, we introduce weak video-level labels to constrain the cross-modal semantic alignment of audio-visual events and design a weakly supervised cross-modal contrastive learning loss (WCCL Loss) function, which enhances the quality of fusion representation in the dual-branch contrastive learning framework. Extensive experiments conducted on the AVE dataset for both fully supervised and weakly supervised event localization, as well as Cross-Modal Localization (CML) tasks, demonstrate the superior performance of our model compared to state-of-the-art approaches. The code will be available from https://github.com/Supersunn/CCLN.

Verified
Journal Article
Open access
PDF file
ZJzheng jia
zheng jia
Jincai ChenJincai Chen
Jincai Chen
XWXinjian Wu
Xinjian Wu
HLHan Liang
Han Liang
ZZZhi Zheng
Zhi Zheng
DHDahua He
Dahua He
As an important sensor of an unmanned surface vehicle (USV), an electro-optical device is usually used to detect ships and obstacles in USV autonomous navigation and collision avoidance. However, the installation perpendicularity error of the electro-optical device greatly impacts the line-of-sight (LOS) stability control. This error is difficult to eliminate through mechanical calibration because the platform inertial navigation axis cannot be led out. This study aims to establish the model for the perpendicularity error of electro-optical devices during circumferential scanning and analyze its impact on the stability of LOS. In addition, we present a measurement technique for perpendicularity errors utilizing sea–sky line images. Through this method, we find an error function of LOS elevation angle, which is a convex function that can quickly search out high-precision perpendicularity errors step by step. Finally, we measured and compensated the perpendicularity error according to experimental data collected by the electro-optical device. The findings of this research demonstrate that the suggested approach can efficiently mitigate low-frequency disruptions and minor amplitude high-frequency vibrations of LOS in the elevation direction. As a result, it considerably enhances the precision of stability and image observation effect of electro-optical devices.

26 October 2023
Verified
Conference Paper
Open access
CSChao Sun
Chao Sun
Min ChenMin Chen
Min Chen
JCJialiang Cheng
Jialiang Cheng
HLHan Liang
Han Liang
CZChuanbo Zhu
Chuanbo Zhu
Jincai ChenJincai Chen
Jincai Chen
Audio and vision are important senses for high-level cognition, and their special strong correlation makes audio-visual coding a crucial factor in many multimodal tasks. However, there are two challenges in audio-visual coding. First, the heterogeneity of multimodal data often leads to misalignment of cross-modal features under the same sample, which reduces their representation quality. Second, most self-supervised learning frameworks are constructed based on instance semantics, and the generated pseudo labels introduce additional classification noise. To address these challenges, we propose a Supervised Cross-modal Contrastive Learning Framework for Audio-Visual Coding (SCLAV). Our framework includes an audio-visual coding network composed of an inter-modal attention interaction module and an intra-modal self-integration module, which leverage multimodal complementary and hidden information for better representation. Additionally, we introduce a supervised cross-modal contrastive loss to minimize the distance between audio and vision features of the same instance, and use weak labels of multimodal data to eliminate the feature-oriented classification noise. Extensive experiments on the AVE and XD-Violence datasets demonstrate that SCLAV outperforms the state-of-the-art results, even with limited computational resources.

20 November 2024 in Neural Computing and Applications
Verified
Journal Article
Closed access
PDF file
CZChuanbo Zhu
Chuanbo Zhu
Min ChenMin Chen
Min Chen
HLHaomin Li
Haomin Li
SZSheng Zhang
Sheng Zhang
HLHan Liang
Han Liang
Jincai ChenJincai Chen
Jincai Chen

22 July 2025 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
JZJunming Zhang
Junming Zhang
ZSZheyuan Sheng
Zheyuan Sheng
HSHuajun Sun
Huajun Sun
CZChuanbo Zhu
Chuanbo Zhu
LCLiangyu Chen
Liangyu Chen
XMXiangshui Miao
Xiangshui Miao
Language networks are crucial in artificial intelligence, with the novel Mamba architecture significantly reducing computations and consumption compared to the traditional transformer network. However, a full-circuit implementation of the Mamba network has not been proposed due to the complexity of computations and data storage. Additionally, optimized hardware-aware parallel algorithms for Mamba inference in circuits remain undeveloped. This work addresses these challenges by presenting a memristor-based full-circuit implementation of the Mamba network and introducing a computing-in-memory parallel-aware algorithm tailored for circuit-level inference. The implementation includes: 1) Standard 1T1M memristor crossbar and depthwise separable convolution memristor crossbar for different convolutions. 2) Computing-in-memory implicit latent state circuits for the computation and transition of latent states. 3) Functional circuits for SiLU activation, RMS normalization, and multi-layer multiply-accumulate operations. 4) Optimized algorithm and circuit implementation for hardware-aware inference, achieving parallel scanning and hardware awareness in circuits. The proposed circuit enables analog signal computations and eliminates redundant analog-to-digital conversions and intermediate storage. A basic single-sentence generation task was simulated in PSPICE, validating the circuit’s correctness. Analyses of analog computation accuracy, circuit stability, and power consumption demonstrate the proposed circuit’s advantages, highlighting its potential as a fundamental module for large-scale circuit integration and complex text generation tasks.