weizhao zhang

Dr. weizhao zhang

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 November 2019 in IEEE Access
Verified
Journal Article
Open access
WZweizhao zhang
weizhao zhang
HYHONGWU YANG
HONGWU YANG
XBXiaolong Bu
Xiaolong Bu
LWLili Wang
Lili Wang

22 September 2023 in ACM Transactions on Asian and Low-Resource Language Information Processing
Verified
Journal Article
Open access
WZweizhao zhang
weizhao zhang
HYHONGWU YANG
HONGWU YANG
There are about 6,000 languages worldwide, most of which are low-resource languages. Although the current speech synthesis (or text-to-speech, TTS) for major languages (e.g., Mandarin, English, French) has achieved good results, the voice quality of TTS for low-resource languages (e.g., Tibetan) still needs to be further improved. Because prosody plays a significant role in natural speech, the article proposes two sequence-to-sequence (seq2seq) Tibetan TTS models with prosodic information fusion to improve the voice quality of synthesized Tibetan speech. We first constructed a large-scale Tibetan corpus for seq2seq TTS. Then we designed a prosody generator to extract prosodic information from the Tibetan sentences. Finally, we trained two seq2seq Tibetan TTS models by fusing prosodic information, including feature-level and model-level prosodic information fusion. The experimental results showed that the proposed two seq2seq Tibetan TTS models, which fuse prosodic information, could effectively improve the voice quality of synthesized speech. Furthermore, the model-level prosodic information fusion only needs 60% ~ 70% of the training data to synthesize a voice similar to the baseline seq2seq Tibetan TTS. Therefore, the proposed prosodic information fusion methods can improve the voice quality of synthesized speech for low-resource languages.

28 November 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
WZweizhao zhang
weizhao zhang
HYHONGWU YANG
HONGWU YANG
The paper proposes a meta-learning-based Mandarin-Tibetan cross-lingual text-to-speech (TTS) to realize both Mandarin and Tibetan speech synthesis under a unique framework. First, we build two kinds of Tacotron2-based Mandarin-Tibetan cross-lingual baseline TTS. One is a shared encoder Mandarin-Tibetan cross-lingual TTS, and another is a separate encoder Mandarin-Tibetan cross-lingual TTS. Both baseline TTS use the speaker classifier with a gradient reversal layer to disentangle speaker-specific information from the text encoder. At the same time, we design a prosody generator to extract prosodic information from sentences to explore syntactic and semantic information adequately. To further improve the synthesized speech quality of the Tacotron2-based Mandarin-Tibetan cross-lingual TTS, we propose a meta-learning-based Mandarin-Tibetan cross-lingual TTS. Based on the separate encoder Mandarin-Tibetan cross-lingual TTS, we use an additional dynamic network to predict the parameters of the language-dependent text encoder that could realize better cross-lingual knowledge sharing in the sequence-to-sequence TTS. Lastly, we synthesize Mandarin or Tibetan speech through the unique acoustic model. The baseline experimental results show that the separate encoder Mandarin-Tibetan cross-lingual TTS could handle the input of different languages better than the shared encoder Mandarin-Tibetan cross-lingual TTS. The experimental results further show that the proposed meta-learning-based Mandarin-Tibetan cross-lingual speech synthesis method could effectively improve the voice quality of synthesized speech in terms of naturalness and speaker similarity.

1 December 2019
Verified
Conference Paper
Closed access
WZweizhao zhang
weizhao zhang
HYHONGWU YANG
HONGWU YANG
XBXiaolong Bu
Xiaolong Bu
In this paper, we constructed speech synthesis corpus of Kham dialect. At the same time, we designed SAMP-Kham machine-readable phonetic label of Kham dialect, and proposed a framework of Kham dialect speech synthesis based on deep learning. The deep learning architecture includes deep neural network (DNN), hybrid long short-term memory (LSTM) and hybrid Bidirectional long short-term memory (BLSTM). The objective and subjective evaluations test showed that quality of synthesized speech of Kham dialect was satisfied.

24 February 2026 in Computer Speech & Language
Verified
Journal Article
Closed access
WZweizhao zhang
weizhao zhang
MWMengjuan Wang
Mengjuan Wang
JLJunzhi Li
Junzhi Li
HYHongwu Yang
Hongwu Yang