Menglan Hu

Menglan Hu

Auto-generated profile, based on publicly available information

Menglan Hu

Anhui Provincial Key Laboratory of Multimodal Cognitive Computation, the Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 January 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
AZAihua Zheng
Aihua Zheng
MHMenglan Hu
Menglan Hu
BJBo Jiang
Bo Jiang
YHYan Huang
Yan Huang
YYYan Yan
Yan Yan
BLBin Luo
Bin Luo
Audio-visual matching aims to learn the intrinsic correspondence between image and audio clip. Existing works mainly concentrate on learning discriminative features, while ignore the cross-modal heterogeneous issue between audio and visual modalities. To deal with this issue, we propose a novel Adversarial-Metric Learning (AML) model for audio-visual matching. AML aims to generate a modality-independent representation for each person in each modality via adversarial learning, while simultaneously learns a robust similarity measure for cross-modality matching via metric learning. By integrating the discriminative modality-independent representation and robust cross-modality metric learning into an end-to-end trainable deep network, AML can overcome the heterogeneous issue with promising performance for audio-visual matching. Experiments on the various audio-visual learning tasks, including audio-visual matching, audio-visual verification and audio-visual retrieval on benchmark dataset demonstrate the effectiveness of the proposed AML model. The implementation codes are available on https://github.com/MLanHu/AML .