Alymzhan Toleu

Dr. Alymzhan Toleu


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2020 in Cogent Engineering
Verified
Journal Article
Open access
Orken MamyrbayevOrken Mamyrbayev
Orken Mamyrbayev
ATAlymzhan Toleu
Alymzhan Toleu
GTGulmira Tolegen
Gulmira Tolegen
NMNurbapa Mekebayev
Nurbapa Mekebayev
In this paper, we investigate two neural architecture for gender detection and speaker identification tasks by utilizing Mel-frequency cepstral coefficients (MFCC) features which do not cover the voice related characteristics. One of our goals is to compare different neural architectures, multi-layers perceptron (MLP) and, convolutional neural networks (CNNs) for both tasks with various settings and learn the gender/speaker-specific features automatically. The experimental results reveal that the models using z-score and Gramian matrix transformation obtain better results than the models only use max-min normalization of MFCC. In terms of training time, MLP requires large training epochs to converge than CNN. Other experimental results show that MLPs outperform CNNs for both tasks in terms of generalization errors.

26 February 2023
Verified
Book Chapter
Closed access
PDF file
GTGulmira Tolegen
Gulmira Tolegen
ATAlymzhan Toleu
Alymzhan Toleu
OMOrken Mamyrbayev
Orken Mamyrbayev
RMRustam Mussabayev
Rustam Mussabayev

23 December 2024 in Applied Sciences
Verified
Journal Article
Open access
PDF file
ATAlymzhan Toleu
Alymzhan Toleu
GTGulmira Tolegen
Gulmira Tolegen
RMRustam Mussabayev
Rustam Mussabayev
AKAlexander Krassovitskiy
Alexander Krassovitskiy
BZBagashar Zhumazhanov
Bagashar Zhumazhanov
This study examines how ten different audio features, including MFCC, mel-spectrogram, chroma, and spectral contrast etc., influence speaker change detection (SCD) performance. The analysis is conducted using two unsupervised methods: Bayesian information criterion with Gaussian mixture model (BIC-GMM), a model-based approach, and Kullback-Leibler divergence with Gaussian Mixture Model (KL-GMM), a metric-based approach. Evaluation involved statistical analysis of feature changes in relation to speaker changes (vice versa), supported by comprehensive experimental validation. Experimental results show MFCC as the most effective feature, demonstrating consistently good performance across both methods. Features such as zero crossing rate, chroma, and spectral contrast also showed notable effectiveness within the BIC-GMM framework, while mel-spectrogram consistently ranked as the least influential feature in both approaches. Further analysis revealed that BIC-GMM exhibits greater stability in managing variations in feature performance, whereas KL-GMM is more sensitive to threshold optimization. Nevertheless, KL-GMM achieved competitive results when paired with specific features, such as MFCC and zero crossing rate. These findings offer valuable insights into the impact of feature selection on unsupervised SCD, providing guidance for the development of more robust and accurate algorithms for practical applications.

1 November 2024 in Applied Sciences
Verified
Journal Article
Open access
PDF file
GTGulmira Tolegen
Gulmira Tolegen
ATAlymzhan Toleu
Alymzhan Toleu
RMRustam Mussabayev
Rustam Mussabayev
In this paper, a contrastive learning approach for morphological disambiguation (MD) using large language models (LLMs) is presented. A contrastive loss function is introduced for training the approach, which reduces the distance between the correct analysis and contextual embeddings while maintaining a margin between correct and incorrect embeddings. One of the aims of the paper is to analyze the effects of fine-tuning an LLM on MD in morphologically complex languages (MCLs) with special reference to low-resource languages such as Kazakh, as well as Turkish. Another goal of the paper is to consider various distance measures for this contrastive loss function, aiming to achieve better results when performing disambiguation by computing the distance between the context and the analysis embeddings. The existing approaches for morphological disambiguation, such as HMM-based and feature-engineering approaches, have limitations in modeling long-term dependencies and in the case of large, sparse tagsets. These challenges are mitigated in the proposed approach by leveraging LLMs, thus achieving better accuracy in handling the cases of ambiguity and OOV tokens without the need to rely on other features. Experiments were conducted on three datasets for two MCLs, Kazakh and Turkish—the former is a typical low-resource language. The results revealed that the proposed approach with contrastive loss improves MD performance when integrated with knowledge from large language models.

15 November 2024
Verified
Conference Paper
Closed access
IAIskander Akhmetov
Iskander Akhmetov
SAShakarim Aubakirov
Shakarim Aubakirov
TSTimur Saparov
Timur Saparov
RMRustam Mussabayev
Rustam Mussabayev
ATAlymzhan Toleu
Alymzhan Toleu
AKAlexander Krassovitskiy
Alexander Krassovitskiy
Kazakh is an agglutinative language, where the sequential attachment of morphemes forms words, each bearing specific grammatical information. The complexity of this morphological structure presents significant challenges for computational linguistics, particularly in natural language processing tasks such as part-of-speech tagging, syntactic parsing, and machine translation. This paper provides a comprehensive review of the most widely used machine learning approaches applied to Kazakh morphology. It compares classical machine learning techniques, such as hidden Markov models and conditional random fields, along with rule-based methods, and recent advances in deep learning, including recurrent neural networks, long short-term memory networks, and transformer-based architectures like BERT. The paper also explores the applicability of data-driven approaches and reviews existing research on Kazakh morphology, offering a comparative analysis based on efficiency, scalability, and accuracy. Finally, future directions are discussed, focusing on expanding annotated datasets and developing models tailored for low-resource languages like Kazakh to improve their representation in natural language processing tasks.

19 November 2020
Verified
Book Chapter
Closed access
PDF file
ATAlymzhan Toleu
Alymzhan Toleu
GTGulmira Tolegen
Gulmira Tolegen
RMRustam Mussabayev
Rustam Mussabayev