Zhiyao Duan

Zhiyao Duan

Auto-generated profile, based on publicly available information

Zhiyao Duan

Department of Electrical and Computer Engineering University of Rochester Rochester NY USA

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 October 2018
Verified
Book Chapter
Closed access
PDF file
YTYapeng Tian
Yapeng Tian
JSJing Shi
Jing Shi
BLBochen Li
Bochen Li
ZDZhiyao Duan
Zhiyao Duan
CXChenliang Xu
Chenliang Xu

25 December 2018 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
Emmanouil BenetosEmmanouil Benetos
Emmanouil Benetos
SDSimon Dixon
Simon Dixon
ZDZhiyao Duan
Zhiyao Duan
SESebastian Ewert
Sebastian Ewert
The capability of transcribing music audio into music notation is a fascinating example of human intelligence. It involves perception (analyzing complex auditory scenes), cognition (recognizing musical objects), knowledge representation (forming musical structures), and inference (testing alternative hypotheses). Automatic music transcription (AMT), i.e., the design of computational algorithms to convert acoustic music signals into some form of music notation, is a challenging task in signal processing and artificial intelligence. It comprises several subtasks, including multipitch estimation (MPE), onset and offset detection, instrument recognition, beat and rhythm tracking, interpretation of expressive timing and dynamics, and score typesetting.

28 April 2021 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
YZYou Zhang
You Zhang
FJFei Jiang
Fei Jiang
ZDZhiyao Duan
Zhiyao Duan
Human voices can be used to authenticate the identity of the speaker, but the automatic speaker verification (ASV) systems are vulnerable to voice spoofing attacks, such as impersonation, replay, text-to-speech, and voice conversion. Recently, researchers developed anti-spoofing techniques to improve the reliability of ASV systems against spoofing attacks. However, most methods encounter difficulties in detecting unknown attacks in practical use, which often have different statistical distributions from known attacks. Especially, the fast development of synthetic voice spoofing algorithms is generating increasingly powerful attacks, putting the ASV systems at risk of unseen attacks. In this work, we propose an anti-spoofing system to detect unknown synthetic voice spoofing attacks (i.e., text-to-speech or voice conversion) using one-class learning. The key idea is to compact the bona fide speech representation and inject an angular margin to separate the spoofing attacks in the embedding space. Without resorting to any data augmentation methods, our proposed system achieves an equal error rate (EER) of 2.19% on the evaluation set of ASVspoof 2019 Challenge logical access scenario, outperforming all existing single systems ( i.e. , those without model ensemble).

6 October 2018
Verified
Book Chapter
Closed access
PDF file
LCLele Chen
Lele Chen
ZLZhiheng Li
Zhiheng Li
RMRoss K. Maddox
Ross K. Maddox
ZDZhiyao Duan
Zhiyao Duan
CXChenliang Xu
Chenliang Xu

16 July 2018 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
BLBochen Li
Bochen Li
XLXinzhao Liu
Xinzhao Liu
KDKarthik Dinesh
Karthik Dinesh
ZDZhiyao Duan
Zhiyao Duan
GSGaurav Sharma
Gaurav Sharma
We introduce a dataset for facilitating audio-visual analysis of music performances. The dataset comprises 44 simple multi-instrument classical music pieces assembled from coordinated but separately recorded performances of individual tracks. For each piece, we provide the musical score in MIDI format, the audio recordings of the individual tracks, the audio and video recording of the assembled mixture, and ground-truth annotation files including frame-level and note-level transcriptions. We describe our methodology for the creation of the dataset, particularly highlighting our approaches to address the challenges involved in maintaining synchronization and expressiveness. We demonstrate the high quality of synchronization achieved with our proposed approach by comparing the dataset with existing widely used music audio datasets. We anticipate that the dataset will be useful for the development and evaluation of existing music information retrieval (MIR) tasks, as well as for novel multimodal tasks. We benchmark two existing MIR tasks (multipitch analysis and score-informed source separation) on the dataset and compare them with other existing music audio datasets. In addition, we consider two novel multimodal MIR tasks (visually informed multipitch analysis and polyphonic vibrato analysis) enabled by the dataset and provide evaluation measurements and baseline systems for future comparisons (from our recent work). Finally, we propose several emerging research directions that the dataset enables.

2 February 2010 in IEEE Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
ZDZhiyao Duan
Zhiyao Duan
BPBryan Pardo
Bryan Pardo
CZChangshui Zhang
Changshui Zhang
This paper presents a maximum-likelihood approach to multiple fundamental frequency (F0) estimation for a mixture of harmonic sound sources, where the power spectrum of a time frame is the observation and the F0s are the parameters to be estimated. When defining the likelihood model, the proposed method models both spectral peaks and non-peak regions (frequencies further than a musical quarter tone from all observed peaks). It is shown that the peak likelihood and the non-peak region likelihood act as a complementary pair. The former helps find F0s that have harmonics that explain peaks, while the latter helps avoid F0s that have harmonics in non-peak regions. Parameters of these models are learned from monophonic and polyphonic training data. This paper proposes an iterative greedy search strategy to estimate F0s one by one, to avoid the combinatorial problem of concurrent F0 estimation. It also proposes a polyphony estimation method to terminate the iterative process. Finally, this paper proposes a postprocessing method to refine polyphony and F0 estimates using neighboring frames. This paper also analyzes the relative contributions of different components of the proposed method. It is shown that the refinement component eliminates many inconsistent estimation errors. Evaluations are done on ten recorded four-part J. S. Bach chorales. Results show that the proposed method shows superior F0 estimation and polyphony estimation compared to two state-of-the-art algorithms.