Xinmeng Xu

Dr. Xinmeng Xu

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 January 2024 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
XXXinmeng Xu
Xinmeng Xu
Monaural speech enhancement (SE) is a versatile and cost-effective approach that leverages recordings from a single microphone. However, it falls short of multi-channel SE due to the absence of spatial cues. These cues, present in multi-channel recordings, aid in distinguishing speech from noise more effectively. To bridge this gap, we introduce a method for mapping monaural speech into a fixed simulation space. Here, single-channel recordings are transformed into a predefined binaural format, enhancing the differentiation between target speech and noise components. This is achieved through knowledge distillation, enabling the monaural SE model to learn simulated binaural speech features from a pre-trained binaural SE model. It is important to note that we use a single type of binaural room impulse response and the monaural input of the student to simulate binaural speech. This way, our approach bypasses the paradox of generating virtual spatial information from monaural speech, while still benefiting from the spatial cues of binaural speech. Rigorous experiments demonstrate the effectiveness of our proposed method, showcasing its superior performance compared to recent monaural SE techniques in terms of PESQ and STOI scores.

17 November 2025 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Closed access
XXXinmeng Xu
Xinmeng Xu
WTWeiping Tu
Weiping Tu
YYYuhong Yang
Yuhong Yang
JLJizhen Li
Jizhen Li
YZYiqun Zhang
Yiqun Zhang
Speech enhancement (SE) often struggles with residual noise and speech distortion when speech and noise share over lapping feature representations. To enhance the discriminability between speech and noise, many existing methods introduce explicit noise modeling as a way to provide stronger contrastive supervision. However, their effectiveness is fundamentally limited by the unpredictable and unstructured nature of noise signals. In this work, we propose the Positive-Negative Features Decomposition and Fusion SE Network (PN-DeFuSE-Net). Instead of modeling noise explicitly, PN-DeFuSE-Net decomposes the input features into speech-dominant (target-positive) and noise-dominant (target-negative) components to enable more effective separation. These features interact through guided correction, allowing the model to recover residual speech from noise-dominant regions while suppressing residual noise in speech-dominant areas. To support this architecture, we introduce three key modules: (1) a self-similarity-guided Decomposition Module that captures static and dynamic patterns across perceptual frequency bands; (2) a Convolutional Back-Projection Module (CBPM) that enhances fine-grained speech details through residual compensation; and (3) a Multi-sparsity Back-projection Conformer Module (MBCM) that refines time-frequency dependencies with sparsity-aware attention. Extensive evaluations across diverse noise environments demonstrate that PN-DeFuSE-Net achieves substantial improvements in speech quality and intelligibility, significantly reducing speech distortion and residual noise compared to prior models.

28 July 2023 in arXiv
Verified
Preprint
Open access
PDF file
XXXinmeng Xu
Xinmeng Xu
WTWeiping Tu
Weiping Tu
YYYuhong Yang
Yuhong Yang
Convolutional neural networks (CNN) and Transformer have wildly succeeded in multimedia applications. However, more effort needs to be made to harmonize these two architectures effectively to satisfy speech enhancement. This paper aims to unify these two architectures and presents a Parallel Conformer for speech enhancement. In particular, the CNN and the self-attention (SA) in the Transformer are fully exploited for local format patterns and global structure representations. Based on the small receptive field size of CNN and the high computational complexity of SA, we specially designed a multi-branch dilated convolution (MBDC) and a self-channel-time-frequency attention (Self-CTFA) module. MBDC contains three convolutional layers with different dilation rates for the feature from local to non-local processing. Experimental results show that our method performs better than state-of-the-art methods in most evaluation criteria while maintaining the lowest model parameters.

16 January 2026 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
XXXinmeng Xu
Xinmeng Xu
WTWeiping Tu
Weiping Tu
YYYuhong Yang
Yuhong Yang
JLJizhen Li
Jizhen Li
YZYiqun Zhang
Yiqun Zhang
HCHongyang Chen
Hongyang Chen
Recent developments in audio-visual speech separation (AVSS) highlight the importance of visual information in improving the extraction of clean speech from noisy audio. However, the audio modality often dominates the learning process because of its direct connection to the output. This leads networks to focus more on audio-related parameters, while the visual modality is underutilized. This issue is especially noticeable in cases where the visual input is of low quality, as the visual modality provides limited useful information. To address this problem, we propose the Contribution-aware Multimodal Balance Network (CAMB-Net). This approach uses the dominant modality to guide the extraction and processing of low-contribution features in the weaker modality. CAMB-Net introduces two main innovations: (1) it identifies the dominant and weak modalities by analyzing the similarity between each modality's features and the fused features, then divides the weak modality's features into high- and low-contribution groups for refinement; and (2) it leverages cross-modal features to guide the extraction of low-contribution features within the weak modality, with high-contribution features from the weak modality influencing the guidance process. We evaluated CAMB-Net on datasets with both high- and low-quality video inputs. The results show significant improvements, with gains of 0.4 dB in SDRi, 0.5 dB in SI-SNRi, and 0.05 in PESQ under high-quality video conditions compared to the state-of-the-art IIANet model. In more challenging scenarios with visual occlusion in LRS3, CAMB-Net achieves strong results, reaching 15.2 dB in SDRi, 15.6 dB in SI-SNRi, and 3.19 in PESQ, demonstrating its robustness.


26 July 2023 in arXiv
Verified
Preprint
Open access
PDF file
CHChang Han
Chang Han
XXXinmeng Xu
Xinmeng Xu
WTWeiping Tu
Weiping Tu
YYYuhong Yang
Yuhong Yang
YLYajie Liu
Yajie Liu
Acoustic echo cancellation (AEC) aims to remove interference signals while leaving near-end speech least distorted. As the indistinguishable patterns between near-end speech and interference signals, near-end speech can't be separated completely, causing speech distortion and interference signals residual. We observe that besides target positive information, e.g., ground-truth speech and features, the target negative information, such as interference signals and features, helps make pattern of target speech and interference signals more discriminative. Therefore, we present a novel AEC model encoder-decoder architecture with the guidance of negative information termed as CMNet. A collaboration module (CM) is designed to establish the correlation between the target positive and negative information in a learnable manner via three blocks: target positive, target negative, and interactive block. Experimental results demonstrate our CMNet achieves superior performance than recent methods.