Thomas Fang Zheng

Prof. Thomas Fang Zheng

orcid

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2017 in Pattern Recognition Letters
Verified
Journal Article
Closed access
MFMiao Fan
Miao Fan
QZQiang Zhou
Qiang Zhou
TZThomas Fang Zheng
Thomas Fang Zheng
RGRalph Grishman
Ralph Grishman

16 September 2020 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Closed access
LZLinlin Zheng
Linlin Zheng
JLJiakang Li
Jiakang Li
MSMeng Sun
Meng Sun
XZXiongwei Zhang
Xiongwei Zhang
TZThomas Fang Zheng
Thomas Fang Zheng
The technique of transforming voices in order to hide the real identity of a speaker is called voice disguise, among which automatic voice disguise (AVD) by modifying the spectral and temporal characteristics of voices with miscellaneous algorithms are easily conducted with softwares accessible to the public. AVD has posed great threat to both human listening and automatic speaker verification (ASV). In this paper, we have found that ASV is not only a victim of AVD but could be a tool to beat some simple types of AVD. Firstly, three types of AVD, pitch scaling, vocal tract length normalization (VTLN) and voice conversion (VC), are introduced as representative methods. State-of-the-art ASV methods are subsequently utilized to objectively evaluate the impact of AVD on ASV by equal error rates (EER). Moreover, an approach to restore disguised voice to its original version is proposed by minimizing a function of ASV scores w.r.t. restoration parameters. Experiments are then conducted on disguised voices from Voxceleb, a dataset recorded in real-world noisy scenario. The results have shown that, for the voice disguise by pitch scaling, the proposed approach obtains an EER around 7% comparing to the 30% EER of a recently proposed baseline using the ratio of fundamental frequencies. The proposed approach generalizes well to restore the disguise with nonlinear frequency warping in VTLN by reducing its EER from 34.3% to 18.5%. However, it is difficult to restore the source speakers in VC by our approach, where more complex forms of restoration functions or other paralinguistic cues might be necessary to restore the nonlinear transform in VC. Finally, contrastive visualization on ASV features with and without restoration illustrate the role of the proposed approach in an intuitive way.

1 October 2015
Verified
Conference Paper
Closed access
ARAskar Rozi
Askar Rozi
Dong WangDong Wang
Dong Wang
Zhiyong ZhangZhiyong Zhang
Zhiyong Zhang
TZThomas Fang Zheng
Thomas Fang Zheng
Few research has been conducted on Uyghur speaker recognition. Among the limited works, researchers usually collect small speech databases and publish results based on their own private data. This `close-door evaluation' makes most of the publications doubtable. This paper publishes an open and free speech database THUYG-20 SRE and a benchmark for Uyghur speaker recognition. The database is based on the THUYG-20 speech corpus we recently released, and the benchmark involves recognition tasks with various training/enrollment/test conditions. We provide a complete description for the database as well as the benchmark, and present an i-vector baseline system constructed using the Kaldi toolkit.

16 March 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
HSHaoran Sun
Haoran Sun
DWDong Wang
Dong Wang
LLLantian LI
Lantian LI
CCChen Chen
Chen Chen
TZThomas Fang Zheng
Thomas Fang Zheng
Speech disentanglement aims to decompose independent causal factors of speech signals into separate codes. Perfect disentanglement benefits to a broad range of speech processing tasks. This paper presents a simple but effective disentanglement approach based on cycle consistency loss and random factor substitution. This leads to a novel random cycle (RC) loss that enforces analysis-and-resynthesis consistency, a main principle of reductionism. We theoretically demonstrate that the proposed RC loss can achieve independent codes if well optimized, which in turn leads to superior disentanglement when combined with information bottleneck (IB). Extensive simulation experiments were conducted to understand the properties of the RC loss, and experimental results on voice conversion further demonstrate the practical merit of the proposal. Source code and audio samples can be found on the webpage http://rc.cslt.org .

1 May 2016 in Speech Communication
Verified
Journal Article
Closed access
LWLinlin Wang
Linlin Wang
JWJun Wang
Jun Wang
LLLantian Li
Lantian Li
TZThomas Fang Zheng
Thomas Fang Zheng
FSFrank K. Soong
Frank K. Soong

1 January 2006 in Journal of Computer Science and Technology
Verified
Journal Article
Closed access
PDF file
JLJing Li
Jing Li
TZThomas Fang Zheng
Thomas Fang Zheng
WBWilliam Byrne
William Byrne
DJDan Jurafsky
Dan Jurafsky