Colorectal cancer (CRC) is the third most common cancer and is usually diagnosed using colonoscopy and biopsy. Diagnosis of pathological biopsy requires professional knowledge and technology. Computer-aided gland and lesion segmentation systems have been proposed to help pathologists in diagnosis of CRC. However, to the best of our knowledge, there has not been a literature work trying to segment different levels of intraepithelial neoplasia in CRC pathological image. To reduce such a research gap, in this paper, we firstly collect a colorectal cancer biopsy histopathology whole slide image (WSI) dataset, named Histo-CRC Biopsy dataset, for algorithm evaluation. We further propose a PPC-UNet network to segment high level, low level intraepithelial neoplasia and normal tissues. The proposed PPC-UNet consists of two modules i.e., a UNet-based network for segmentation, and a pixel-to-propagation consistency (PPC) contrastive learning-based network for UNet encoder pre-training. As the important feature can be learned from the unannotated data during pre-training, our approach can consistently improve the Dice of UNet by around 2% when different ratios of the training data are labeled.
With the increasing popularity of speech synthesis products, the industry has put forward more requirements for personalized speech synthesis: (1) How to use low-resource, easily accessible data to clone a person's voice. (2) How to clone a person's voice while controlling the style and prosody. To solve the above two problems, we proposed the Hieratron model framework in which the prosody and timbre are modeled separately using two modules, therefore, the independent control of timbre and the other characteristics of audio can be achieved while generating speech. The practice shows that, for very limited target speaker data in the wild, Hieratron has obvious advantages over the traditional method, in addition to controlling the style and language of the generated speech, the mean opinion score on speech quality of the generated speech has also been improved by more than 0.2 points.
In Mandarin text-to-speech (TTS) system, the front-end text processing module significantly influences the intelligibility and naturalness of synthesized speech. Building a typical pipeline-based front-end which consists of multiple individual components requires extensive efforts. In this paper, we proposed a unified sequence-to-sequence front-end model for Mandarin TTS that converts raw texts to linguistic features directly. Compared to the pipeline-based front-end, our unified front-end can achieve comparable performance in polyphone disambiguation and prosody word prediction, and improve intonation phrase prediction by 0.0738 in F1 score. We also implemented the unified front-end with Tacotron and WaveRNN to build a Mandarin TTS system. The synthesized speech by that got a comparable MOS (4.38) with the pipeline-based front-end (4.37) and close to human recordings (4.49).
Streaming voice conversion (VC) is the task of converting the voice of one person to another in real-time. Previous streaming VC methods use phonetic posteriorgrams (PPGs) extracted from automatic speech recognition (ASR) systems to represent speaker-independent information. However, PPGs lack the prosody and vocalization information of the source speaker, and streaming PPGs contain undesired leaked timbre of the source speaker. In this paper, we propose to use intermediate bottleneck features (IBFs) to replace PPGs. VC systems trained with IBFs retain more prosody and vocalization information of the source speaker. Furthermore, we propose a non-streaming teacher guidance (TG) framework that addresses the timbre leakage problem. Experiments show that our proposed IBFs and the TG framework achieve a state-of-the-art streaming VC naturalness of 3.85, a content consistency of 3.77, and a timbre similarity of 3.77 under a future receptive field of 160 ms which significantly outperform previous streaming VC systems.