Amin honarmandi Shandiz

Mr. Amin honarmandi Shandiz

University of Szeged, Szeged, Csongrád, Hungary
orcid

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 August 2021
Verified
Conference Paper
Closed access
YYYide Yu
Yide Yu
Amin honarmandi ShandizAmin honarmandi Shandiz
Amin honarmandi Shandiz
LTLaszlo Toth
Laszlo Toth
Several approaches exist for the recording of articulatory movements, such as eletromagnetic and permanent magnetic articulagraphy, ultrasound tongue imaging and surface electromyography. Although magnetic resonance imaging (MRI) is more costly than the above approaches, the recent developments in this area now allow the recording of real-time MRI videos of the articulators with an acceptable resolution. Here, we experiment with the reconstruction of the speech signal from a real-time MRI recording using deep neural networks. Instead of estimating speech directly, our networks are trained to output a spectral vector, from which we reconstruct the speech signal using the WaveGlow neural vocoder. We compare the performance of three deep neural architectures for the estimation task, combining convolutional (CNN) and recurrence-based (LSTM) neural layers. Besides the mean absolute error (MAE) of our networks, we also evaluate our models by comparing the speech signals obtained using several objective speech quality metrics like the mean cepstral distortion (MCD), Short-Time Objective Intelligibility (STOI), Perceptual Evaluation of Speech Quality (PESQ) and Signal-to-Distortion Ratio (SDR). The results indicate that our approach can successfully reconstruct the gross spectral shape, but more improvements are needed to reproduce the fine spectral details.

8 November 2022 in Sensors
Verified
Journal Article
Open access
PDF file
TCTamás Gábor Csapó
Tamás Gábor Csapó
GGGábor Gosztolya
Gábor Gosztolya
LTLászló Tóth
László Tóth
Amin honarmandi ShandizAmin honarmandi Shandiz
Amin honarmandi Shandiz
AMAlexandra Markó
Alexandra Markó
Within speech processing, articulatory-to-acoustic mapping (AAM) methods can apply ultrasound tongue imaging (UTI) as an input. (Micro)convex transducers are mostly used, which provide a wedge-shape visual image. However, this process is optimized for the visual inspection of the human eye, and the signal is often post-processed by the equipment. With newer ultrasound equipment, now it is possible to gain access to the raw scanline data (i.e., ultrasound echo return) without any internal post-processing. In this study, we compared the raw scanline representation with the wedge-shaped processed UTI as the input for the residual network applied for AAM, and we also investigated the optimal size of the input image. We found no significant differences between the performance attained using the raw data and the wedge-shaped image extrapolated from it. We found the optimal pixel size to be 64 × 43 in the case of the raw scanline input, and 64 × 64 when transformed to a wedge. Therefore, it is not necessary to use the full original 64 × 842 pixels raw scanline, but a smaller image is enough. This allows for the building of smaller networks, and will be beneficial for the development of session and speaker-independent methods for practical applications. AAM systems have the target application of a “silent speech interface”, which could be helpful for the communication of the speaking-impaired, in military applications, or in extremely noisy conditions.

30 August 2021
Verified
Conference Paper
Closed access
Amin honarmandi ShandizAmin honarmandi Shandiz
Amin honarmandi Shandiz
LTLászló Tóth
László Tóth
GGGábor Gosztolya
Gábor Gosztolya
AMAlexandra Markó
Alexandra Markó
TCTamás Gábor Csapó
Tamás Gábor Csapó

29 May 2021
Verified
Book Chapter
Closed access
PDF file
Amin honarmandi ShandizAmin honarmandi Shandiz
Amin honarmandi Shandiz
LTLászló Tóth
László Tóth
GGGábor Gosztolya
Gábor Gosztolya
AMAlexandra Markó
Alexandra Markó
TCTamás Gábor Csapó
Tamás Gábor Csapó