Javier Hernando

Prof. Dr. Javier Hernando

Department of Signal Theory and Communications, Polytechnic University of Catalonia, 08034 Barcelona, Spain
orcid

Research Focus & Metrics

Academic Career Length

26Years (2001-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 August 2007 in IEEE Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
XAXavier Anguera
Xavier Anguera
CWChuck Wooters
Chuck Wooters
Javier HernandoJavier Hernando
Javier Hernando
When performing speaker diarization on recordings from meetings, multiple microphones of different qualities are usually available and distributed around the meeting room. Although several approaches have been proposed in recent years to take advantage of multiple microphones, they are either too computationally expensive and not easily scalable or they cannot outperform the simpler case of using the best single microphone. In this paper, the use of classic acoustic beamforming techniques is proposed together with several novel algorithms to create a complete frontend for speaker diarization in the meeting room domain. New techniques we are presenting include blind reference-channel selection, two-step time delay of arrival (TDOA) Viterbi postprocessing, and a dynamic output signal weighting algorithm, together with using such TDOA values in the diarization to complement the acoustic information. Tests on speaker diarization show a 25% relative improvement on the test set compared to using a single most centrally located microphone. Additional experimental results show improvements using these techniques in a speech recognition task.

1 April 2001 in Speech Communication
Verified
Journal Article
Closed access
CNCliment Nadeu
Climent Nadeu
DMDušan Macho
Dušan Macho
Javier HernandoJavier Hernando
Javier Hernando

1 November 2016 in Microprocessors and Microsystems
Verified
Journal Article
Open access
CÁCarlos Álvarez
Carlos Álvarez
EAEduard Ayguadé
Eduard Ayguadé
JBJaume Bosch
Jaume Bosch
JBJavier Bueno
Javier Bueno
ACArtem Cherkashin
Artem Cherkashin
RGRoberto Giorgi
Roberto Giorgi

9 July 2019 in Applied Sciences
Verified
Journal Article
Open access
PDF file
UKUmair Khan
Umair Khan
PSpooyan safari
pooyan safari
Javier HernandoJavier Hernando
Javier Hernando
Restricted Boltzmann Machines (RBMs) have shown success in both the front-end and backend of speaker verification systems. In this paper, we propose applying RBMs to the front-end for the tasks of speaker clustering and speaker tracking in TV broadcast shows. RBMs are trained to transform utterances into a vector based representation. Because of the lack of data for a test speaker, we propose RBM adaptation to a global model. First, the global model—which is referred to as universal RBM—is trained with all the available background data. Then an adapted RBM model is trained with the data of each test speaker. The visible to hidden weight matrices of the adapted models are concatenated along with the bias vectors and are whitened to generate the vector representation of speakers. These vectors, referred to as RBM vectors, were shown to preserve speaker-specific information and are used in the tasks of speaker clustering and speaker tracking. The evaluation was performed on the audio recordings of Catalan TV Broadcast shows. The experimental results show that our proposed speaker clustering system gained up to 12% relative improvement, in terms of Equal Impurity (EI), over the baseline system. On the other hand, in the task of speaker tracking, our system has a relative improvement of 11% and 7% compared to the baseline system using cosine and Probabilistic Linear Discriminant Analysis (PLDA) scoring, respectively.

18 July 2005 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
JAJ. Anguita
J. Anguita
Javier HernandoJavier Hernando
Javier Hernando
SPS. Peillon
S. Peillon
ABA. Bramoulle
A. Bramoulle
A new method to detect words that are likely to be confused by speech recognition systems is presented in this letter. A new dissimilarity measure between two words is calculated in two steps. First, the phonetic transcriptions of the words are aligned using only phonetic information. Two kinds of alignments are used: either with or without insertions and deletions. Second, the dissimilarity measure is calculated on the basis of the resulting alignment and acoustic information obtained from the hidden Markov models of the phones. In a classical false acceptance/false rejection framework, the equal error rate was measured to be less than 5%.

29 January 2014 in Sensors
Verified
Journal Article
Open access
PDF file
CSCarlos Segura
Carlos Segura
Javier HernandoJavier Hernando
Javier Hernando
This paper addresses the problem of three-dimensional speaker orientation estimation in a smart-room environment equipped with microphone arrays. A Bayesian approach is proposed to jointly track the location and orientation of an active speaker. The main motivation is that the knowledge of the speaker orientation may yield an increased localization performance and vice versa. Assuming that the sound produced by the speaker is originated from his mouth, the center of the head is deduced based on the estimated head orientation. Moreover, the elevation angle of the head of the speaker can be partly inferred from the fast vertical movements of the computed mouth location. In order to test the performance of the proposed algorithm, a new multimodal dataset has been recorded for this purpose, where the corresponding 3D orientation angles are acquired by an inertial measurement unit (IMU) provided by accelerometers, magnetometers and gyroscopes in the three-axes. The proposed joint algorithm outperforms a two-step approach in terms of localization and orientation angle precision assessing the superiority of the joint approach.