Zhihan Wang

Zhihan Wang

Auto-generated profile, based on publicly available information

Zhihan Wang

School of Artificial Intelligence, China University of Mining and Technology-Beijing, Beijing, China

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 March 2025 in IEEE Sensors Journal
Verified
Journal Article
Closed access
QXQian Xu
Qian Xu
YWYunxia Wu
Yunxia Wu
JZJiachen Zeng
Jiachen Zeng
ZWZhihan Wang
Zhihan Wang
HZHailan Zhang
Hailan Zhang
The task of Audio-Visual Event (AVE) localization involves the temporal localization of both audible and visible events captured by camera sensors. However, the audio noise and visual background inherent in these sensors can obscure the distinction between event categories, or the inconsistency between audio and visual information may lead to incorrect predictions of event boundaries. To address these challenges, we propose a cross-modal feature enhancement network designed to enhance modality-specific audio and visual features as well as overall audio-visual event features. Specifically, our modality-specific feature enhancement approach employs cross-modal attentional mechanisms that allow the visual and audio modalities to focus on event-related features within the opposite modality. This approach also establishes intra-modal dependencies within each modality, enhancing the temporal relevance of event-related audio and visual features. Additionally, our audio-visual event feature enhancement scheme develops inter-modal correspondences through audio-visual interaction fusion, aligning the feature representations of audio-visual events temporally. To further mitigate the interference of visual background noise, we have developed an audio-visual channel-spatial fusion module that leverages audio-guided visual attention to improve the visual representation of the sounding target within the visual scene. Experiments conducted on the AVE dataset demonstrate that our method surpasses state-of-the-art methods in terms of AVE localization accuracy in both supervised and weakly supervised settings.

9 June 2026 in IEEE Sensors Journal
Verified
Journal Article
Closed access
QXQian Xu
Qian Xu
YWYunxia Wu
Yunxia Wu
HZHailan Zhang
Hailan Zhang
ZZZhengyang Zou
Zhengyang Zou
ZWZhihan Wang
Zhihan Wang
The task of coal-rock cutting event localization is to locate the start and end time of both visible and audible cutting events through video sensors, as well as identify the coal-rock cutting categories. The development of video sensors equipped with functionalities to localize coal-rock cutting events is crucial for the intelligent development of coal mines. However, challenges such as coal dust and equipment noise compromise the discriminability of visual and audio features of cutting events, consequently diminishing the accuracy of event localization. To mitigate these challenges, we propose the Cross-Modal Spatial-Temporal-Semantic Adaptive Network (CM-STSAN). By introducing the Cross-Modal Spatial-Temporal-Semantic Adapter (CM-STSA) into the frozen pre-trained Swin Transformer (Swin-T) model, which enhances the representation of visual and audio features, thereby improving the accuracy of coal-rock cutting event localization. Specifically, initially, a modality-specific temporal relation module is employed to capture the temporal dependencies between the cutting sound source and the cutting action. Subsequently, a spatial audio-visual interaction fusion module is designed to utilize the clues of the opposite modality to achieve cross-modal feature alignment. Lastly, a semantic audio-visual interaction fusion module is devised to use the shared audio-visual semantic interaction to supports accurate inference of cutting semantic. In the latter two steps, an audio-visual attention interaction module dynamically adjusts the weighting of cross-modal features via an attention gating mechanism, effectively suppressing interference from coal dust and background noise. Our methodology verifies the accuracy of coal-rock cutting events localization on the self-bulit Audio-Visual Cutting Event (AVCE) dataset. Furthermore, validation on the publicly available Audio-Visual Event (AVE) dataset demonstrates that our CM-STSAN achieves state-of-the-art results in AVE localization tasks.