Long Ye

Long Ye


Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 October 2023 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Closed access
YXYuankun Xie
Yuankun Xie
HCHaonan Cheng
Haonan Cheng
YWYutian Wang
Yutian Wang
LYLong Ye
Long Ye
In this paper, we propose an Aggregation and Separation Domain Generalization (ASDG) method for Audio DeepFake Detection (ADD). Fake speech generated from different methods exhibits varied amplitude and frequency distributions rather than genuine speech. In addition, the spoofing attacks in training sets may not keep pace with the evolving diversity of real-world deepfake distributions. In light of this, we attempt to learn an ideal feature space that can aggregate real speech and separate fake speech to achieve better generalizability in the detection of unseen target domains. Specifically, we first propose a feature generator based on Lightweight Convolutional Neural Networks (LCNN), which is employed for generating a feature space and categorizing the feature into real and fake. Meanwhile, single-side domain adversarial learning is leveraged to make only the real speech from different domains indistinguishable, which enables the distribution of real speech to be aggregated in the feature space. Furthermore, a triplet loss is adopted to separate the distribution of fake speech while aggregating the distribution of real speech. Finally, in order to test the generalizability of the model, we train it with three different English datasets and evaluate in harsh conditions: cross-language and noisy datasets. The extensive experiments show that ASDG outperforms the baseline models in cross-domain tasks and decreases Equal Error Rate (EER) by up to 39.24% when compared to that of RawNet2. It is proved that the proposed Aggregation and Separation Domain Generalization method can be an effective strategy to improve the model generalizability.

7 January 2025 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Closed access
YXYuankun Xie
Yuankun Xie
YLYi Lu
Yi Lu
RFRuibo Fu
Ruibo Fu
ZWZhengqi Wen
Zhengqi Wen
ZWZhiyong Wang
Zhiyong Wang
YSYi Sun
Yi Sun
With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for generalized detection methods. ALM-based deepfake audio currently exhibits widespread, high deception, and type versatility, posing a significant challenge to current audio deepfake detection (ADD) models trained solely on vocoded data. To effectively detect ALM-based deepfake audio, we focus on the mechanism of the ALM-based audio generation method, the conversion from neural codec to waveform. We initially constructed the Codecfake dataset, an open-source, large-scale collection comprising over 1 million audio samples in both English and Chinese, focus on ALM-based audio detection. As countermeasure, to achieve universal detection of deepfake audio and tackle domain ascent bias issue of original sharpness aware minimization (SAM), we propose the CSAM strategy to learn a domain balanced and generalized minima. In our experiments, we first demonstrate that ADD model training with the Codecfake dataset can effectively detects ALM-based audio. Furthermore, our proposed generalization countermeasure yields the lowest average equal error rate (EER) of 0.616% across all test conditions compared to baseline models. The dataset1 and associated code2 are available online.

24 March 2021 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
XXXueyuan Xu
Xueyuan Xu
TJTianyuan Jia
Tianyuan Jia
QLQing Li
Qing Li
FWFulin Wei
Fulin Wei
LYLong Ye
Long Ye
XWXia Wu
Xia Wu
A common drawback of EEG-based emotion recognition is that volume conduction effects of the human head introduce interchannel dependence and result in highly correlated information among most EEG features. These highly correlated EEG features cannot provide extra useful information, and they actually reduce the performance of emotion recognition. However, the existing feature selection methods, commonly used to remove redundant EEG features for emotion recognition, ignore the correlation between the EEG features or utilize a greedy strategy to evaluate the interdependence, which leads to the algorithms retaining the correlated and redundant features with similar feature scores in the EEG feature subset. To solve this problem, we propose a novel EEG feature selection method for emotion recognition, termed global redundancy minimization in orthogonal regression (GRMOR). GRMOR can effectively evaluate the dependence among all EEG features from a global view and then select a discriminative and nonredundant EEG feature subset for emotion recognition. To verify the performance of GRMOR, we utilized three EEG emotional data sets (DEAP, SEED, and HDED) with different numbers of channels (32, 62, and 128). The experimental results demonstrate that GRMOR is a promising tool for redundant feature removal and informative feature selection from highly correlated EEG features.

18 May 2018 in EURASIP Journal on Wireless Communications and Networking
Verified
Journal Article
Open access
PDF file
XCXufen Cai
Xufen Cai
LYLong Ye
Long Ye
QZQin Zhang
Qin Zhang
This paper presents an ensemble learning particle swarm optimization (ELPSO) algorithm for real-time indoor localization based on ultra-wideband (UWB). Indoor localization problem can be formulated as an optimization problem to predict the target. The proposed algorithm expands the original PSO into ELPSO under superbest guide, which is a parameter employed to identify the top gbest by learning from three individual algorithms and updated asynchronously. The performance of the proposed ELPSO is evaluated by using the CEC2005 benchmark and compared with each individual algorithm and other state-of-the-art optimization algorithms. The feasibility of the proposed ELPSO is demonstrated in both 2D and 3D UWB indoor localization system generating promising results.

21 August 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
XMXin Ma
Xin Ma
CLChang Liu
Chang Liu
CXChunyu Xie
Chunyu Xie
LYLong Ye
Long Ye
YDYafeng Deng
Yafeng Deng
XJXiangyang Ji
Xiangyang Ji
Masked image modeling (MIM) has shown great promise for self-supervised learning (SSL) yet been criticized for learning inefficiency. We believe the insufficient utilization of training signals should be responsible. To alleviate this issue, we introduce a conceptually simple yet learning-efficient MIM training scheme, termed D isjoint M asking with J oint D istillation (DMJD). For disjoint masking (DM), we sequentially sample multiple masked views per image in a mini-batch with the disjoint regulation to raise the usage of tokens for reconstruction in each image while keeping the masking rate of each view. For joint distillation (JD), we adopt a dual branch architecture to respectively predict invisible (masked) and visible (unmasked) tokens with superior learning targets. Rooting in orthogonal perspectives for training efficiency improvement, DM and JD cooperatively accelerate the training convergence yet not sacrificing the model generalization ability. Concretely, DM can train ViT with less effective training epochs (at most $3.7\times$ less time-consuming) to report competitive performance. With JD, our DMJD clearly improves the linear probing classification accuracy, up to 3.4 $\%$ . On fine-grained downstream tasks like semantic segmentation, object detection, etc. , our DMJD also presents superior generalization compared with state-of-the-art SSL methods. The code and model can be found at https://github.com/mx-mark/DMJD .

17 January 2024 in Multimedia Systems
Verified
Journal Article
Closed access
PDF file
Hongfei WangHongfei Wang
Hongfei Wang
YZYi Zou
Yi Zou
HCHaonan Cheng
Haonan Cheng
LYLong Ye
Long Ye