14 March 2022 in IEEE Access
Automatic speech recognition (ASR) is one of the utmost demanding tasks in Natural Language Processing due to its complexity. Recently, deep learning approaches have been deployed for this task, and have been proven to outperform traditional machine learning approaches such as ANN. Particularly; deep learning methods such as Long Short-Term Memory (LSTM) has achieved improved performance in ASR. However, this method is limited in processing continuous input streams. Traditional LSTM requires 4 linear layers (MLP layer) per cell, which require large amounts of memory bandwidth to run at and for each sequence time-step. LSTM cannot afford many computational units required in processing continuous input streams because the system does not have enough memory bandwidth to feed the computational units. In this research, an enhanced deep learning LSTM RNN model is proposed to resolve this shortcoming. In the proposed model, a Recurrent Neural Network (RNN) is incorporated as a "forget gate" to the memory block to allow resetting of the cell states at the beginning of sub-sequences. This will enable the system to efficiently process continuous input streams without necessarily increasing the required bandwidths. In the proposed model, the standard architecture of the LSTM networks has been modified to make effective use of the model parameters to address the computational efficiency problems of large networks on large vocabulary speech recognition. Some CNN based models and Sequential models were also used on the same dataset, and the performances of the models were compared with the performance of the proposed model. The LSTM-RNN outperformed the other deep learning models with the accuracy of 99.36% on the well-established public benchmark spoken English digits dataset.
28 September 2022 in Computational Intelligence and Neuroscience
Classification of isolated digits is the basic challenge for many speech classification systems. While a lot of work has been carried out on spoken languages, only limited research work on spoken English digit data has been reported in the literature. The paper proposes an intelligent-based system based on deep feedforward neural network (DFNN) with hyperparameter optimization techniques, an ensemble method; random forest (RF), and a regression method; gradient boosting (GB) for the classification of spoken digit data. The paper investigates different machine learning (ML) algorithms to determine the best method for the classification of spoken English digit data. The DFNN classifier outperformed the RF and GB classifiers on the public benchmark spoken English digit data and achieved 99.65% validation accuracy. The outcome of the proposed model performs better compared to existing models with only traditional classifiers.