In this work, we first propose a deep neural network (DNN) system for the automatic detection of speech in audio signals, otherwise known as voice activity detection (VAD). Several DNN types were investigated, including multilayer perceptrons (MLPs), recurrent neural networks (RNNs), and convolutional neural networks (CNNs), with the best performance being obtained for the latter. Additional postprocessing techniques, i.e., hysteretic thresholding, minimum duration filtering, and bilateral extension, were employed in order to boost performance. The systems were trained and tested using several data subsets of the CENSREC-1-C database, with different simulated ambient noise conditions, and additional testing was performed on a different CENSREC-1-C data subset containing actual ambient noise, as well as on a subset of the TIMIT database. An accuracy of up to 99.13% was obtained for the CENSREC-1-C datasets, and 97.60% for the TIMIT dataset. We proceed to show how the final VAD system can be adapted and employed within an utterance-level deceptive speech detection (DSD) processing pipeline. The best DSD performance is achieved by a novel hybrid CNN-MLP network leveraging a fusion of algorithmically and automatically extracted speech features, and reaches an unweighted accuracy (UA) of 63.7% on the RLDD database, and 62.4% on the RODeCAR database.
Studies have shown that newborns are crying differently depending on their need: hunger, tiredness, discomfort, eructation, pain, and so on. Skilled persons such as pediatricians can distinguish between different types of newborn cries and consequently estimate the baby's need by using the sounds and the gestures produced by the baby. However, this is a real problem for the unskilled parents who would like to answer promptly to their baby needs. Recently, research work has been invested into developing automated methods to detect the baby's need using only a short audio recording of his/her live cry. In this paper we report the initial results we obtained by applying various methods that were successful in speaker and language recognition to the task of baby cry recognition. The results are promising: 70% accuracy on a dataset with 39 babies and 5 types of cry.
1 September 2002 in International Journal of Speech Technology
Studies have shown that there are different types of cries depending on the newborns' need such as hunger, tiredness, discomfort and so on. Neonatologist or pediatricians can distinguish between different types of cries and can find a pattern in each type of cry. Unfortunately, this is a real problem for the parents who want to act as fast as possible to comfort the newborn. In this paper, we propose a fully automatic system that attempts to discriminate between different types of cries. The baby cry classification system is based on Gaussian Mixture Models and i-vectors. The evaluation is performed on an audio database comprising six types of cries (colic, eructation, discomfort, hunger, pain, tiredness) from 127 babies. The experiments show promising results despite the difficulty of the task.
This paper presents the main improvements brought recently to the SpeeD automatic speech recognition system. Several aspects, such as speech and text resources acquisition, noise-robust speech features and feature transforms are discussed. All the updates in our ASR system are accompanied by experimental results illustrating significant improvements: between 30% and 35% relative WER reductions for various case studies (read/spontaneous speech, noisy/clean speech). In the last part of the paper, our ASR system is also compared with Google's ASR system and a brief analysis of the results is presented.
In order to build a TTS (Text-to-Speech) synthesis system one must provide two key components: a NLP (Natural Language Processing) stage, which essentially operates on the input text, and a speech generation stage to produce the desired output. These two distinct levels must exchange both data and commands to produce intelligible and natural speech. As the complete TTS task relies on many distinct scientific areas, any achievement toward standardization can minimize the effort and increase the dynamic of the results. This paper gives an overview of the NLP stage in the TTS system for Romanian language built by our collective, and describes the integration into the system of SSML (Speech Synthesis Markup Language), as a nowadays well recognized standard for TTS document authoring and inter-modules communication.