Akbayan Bekarystankyzy

Dr. Akbayan Bekarystankyzy


Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 February 2022 in Eastern-European Journal of Enterprise Technologies
Verified
Journal Article
Open access
PDF file
Orken MamyrbayevOrken Mamyrbayev
Orken Mamyrbayev
KAKeylan Alimhan1
Keylan Alimhan1
Dina OralbekovaDina Oralbekova
Dina Oralbekova
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
BZBagashar Zhumazhanov
Bagashar Zhumazhanov
Ensuring the best quality and performance of modern speech technologies, today, is possible based on the widespread use of machine learning methods. The idea of this project is to study and implement an end-to-end system of automatic speech recognition using machine learning methods, as well as to develop new mathematical models and algorithms for solving the problem of automatic speech recognition for agglutinative (Turkic) languages. Many research papers have shown that deep learning methods make it easier to train automatic speech recognition systems that use an end-to-end approach. This method can also train an automatic speech recognition system directly, that is, without manual work with raw signals. Despite the good recognition quality, this model has some drawbacks. These disadvantages are based on the need for a large amount of data for training. This is a serious problem for low-data languages, especially Turkic languages such as Kazakh and Azerbaijani. To solve this problem, various methods are needed to apply. Some methods are used for end-to-end speech recognition of languages belonging to the group of languages of the same family (agglutinative languages). Method for low-resource languages is transfer learning, and for large resources – multi-task learning. To increase efficiency and quickly solve the problem associated with a limited resource, transfer learning was used for the end-to-end model. The transfer learning method helped to fit a model trained on the Kazakh dataset to the Azerbaijani dataset. Thereby, two language corpora were trained simultaneously. Conducted experiments with two corpora show that transfer learning can reduce the symbol error rate, phoneme error rate (PER), by 14.23 % compared to baseline models (DNN+HMM, WaveNet, and CNC+LM). Therefore, the realized model with the transfer method can be used to recognize other low-resource languages.

15 June 2024 in Scientific Reports
Verified
Journal Article
Open access
PDF file
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
OMOrken Mamyrbayev
Orken Mamyrbayev
MMMateus Mendes
Mateus Mendes
AFAnar Fazylzhanova
Anar Fazylzhanova
MAMuhammad Assam
Muhammad Assam
To obtain a reliable and accurate automatic speech recognition (ASR) machine learning model, it is necessary to have sufficient audio data transcribed, for training. Many languages in the world, especially the agglutinative languages of the Turkic family, suffer from a lack of this type of data. Many studies have been conducted in order to obtain better models for low-resource languages, using different approaches. The most popular approaches include multilingual training and transfer learning. In this study, we combined five agglutinative languages from the Turkic family—Kazakh, Bashkir, Kyrgyz, Sakha, and Tatar,—in order to provide multilingual training using connectionist temporal classification and an attention mechanism including a language model, because these languages have cognate words, sentence formation rules, and alphabet (Cyrillic). Data from the open-source database Common voice was used for the study, to make the experiments reproducible. The results of the experiments showed that multilingual training could improve ASR performances for all languages included in the experiment, except Bashkir language. A dramatic result was achieved for the Kyrgyz language: word error rate decreased to nearly one-fifth and character error rate decreased to one-fourth, which proves that this approach can be helpful for critically low-resource languages.

30 March 2023 in Scientific Journal of Astana IT University
Verified
Journal Article
Open access
PDF file
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
Orken MamyrbayevOrken Mamyrbayev
Orken Mamyrbayev
With the improvement of intelligent systems, speech recognition technologies are being widely integrated into various aspects of human life. Speech recognition is applied to smart assistants, smart home infrastructure, the call center applications of banks, information system components for impaired people, etc. But these facilities of information systems are available only for common languages, like English, Chinese, or Russian. For low-resource language, these opportunities for information technologies are still not implemented. Most modern speech recognition approaches are still not tested on agglutinative languages, especially for the languages of Turkic group like Kazakh, Tatar, and Turkish Languages. The HMM-GMM (Hidden Markov Models - Gaussian Mixture Models) model has been the most popular in the field of Automatic Speech Recognition (ASR) for a long time. Currently, neural networks are widely used in different fields of NLP, especially in automatic speech recognition. In an enormous number of works application of neural networks within different stages of automatic speech recognition makes the quality level of this systems much better. Integral speech recognition systems based on neural networks are investigated in the article. The paper proves that the Connectionist Temporal Classification (CTC) model works precisely for agglutinative languages. The author conducted an experiment with the LSHTM neural network using an encoder-decoder model, which is based on the attention-based models. The result of the experiment showed a Character Error Rate (CER) equal to 8.01% and a Word Error Rate (WER) equal to 17.91%. This result proves the possibility of getting a good ASR model without the use of the Language Model (LM).

27 January 2026 in Algorithms
Verified
Journal Article
Open access
PDF file
Aray KassenkhanAray Kassenkhan
Aray Kassenkhan
mateus mendesmateus mendes
mateus mendes
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
This article proposes an interpretable adaptive control model for dynamically regulating task difficulty in Artificial intelligence (AI)-augmented reading-comprehension learning systems. The model adjusts, on the fly, the level of task complexity associated with reading comprehension and post-text analytical tasks based on learner performance, with the objective of maintaining an optimal difficulty level. Grounded in adaptive control theory and learning theory, the proposed algorithm updates task difficulty according to the deviation between observed learner performance and a predefined target mastery rate, modulated by an adaptivity coefficient. A simulation study involving heterogeneous learner profiles demonstrates stable convergence behavior and a strong positive correlation between task difficulty and learning performance (r = 0.78). The results indicate that the model achieves a balanced trade-off between learner engagement and cognitive load while maintaining low computational complexity, making it suitable for real-time integration into intelligent learning environments. The proposed approach contributes to AI-supported education by offering a transparent, control-theoretic alternative to heuristic difficulty adjustment mechanisms commonly used in e-learning systems.

6 March 2026 in Algorithms
Verified
Journal Article
Open access
PDF file
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
DRDiana Rakhimova
Diana Rakhimova
AZAliya Zhiger
Aliya Zhiger
ASAssel Sakatay
Assel Sakatay
NZNazym Zhumakhan
Nazym Zhumakhan
MTMUSSA TURDALYULY
MUSSA TURDALYULY
Machine translation for low-resource languages such as Kazakh remains a complex task due to the scarcity of training data, intricate morphological structures, and culturally specific linguistic characteristics. This study presents the first extensive exploration of fine-tuning large language models for automated post-editing of Kazakh translations. We introduce KazPE, a carefully curated and annotated dataset that includes 10,008 training sentences and 311 test sentences spanning six domains: the medical, scientific, journalistic, oral, fiction, and legal. The dataset features detailed error classifications across 9 linguistic categories. Our method fine-tunes GPT-4.1 mini using supervised learning to enhance translation quality by systematically correcting targeted errors. According to human evaluations, conducted on a continuous 0–1 scale, the fine-tuned model achieves an average quality score of 0.84, surpassing the baseline score of 0.80, corresponding to a 5% relative improvement. The greatest improvements are observed in handling morphological and lexical errors, as well as in domain-specific texts—particularly in legal (+17%) and medical (+22%) domains. In addition, the translations were evaluated using the automatic metrics: BLEU, TER and METEOR. The fine-tuned model shows improvements across all automatic metrics (BLEU, TER, METEOR), which confirms better n-gram overlap with reference texts, fewer edits needed, and enhanced lexical and semantic alignment with the reference texts. Comprehensive error analysis shows that the fine-tuning process effectively mitigates challenges related to Kazakh’s agglutinative morphology and specialized terminology, while preserving accuracy on already correct sentences. This research establishes the first structured evaluation framework for Kazakh translation post-editing and offers valuable guidance for enhancing machine translation in morphologically rich, low-resource languages. To facilitate further progress in Turkic language processing, we publicly release the KazPE dataset, trained models, and evaluation framework.

29 September 2023
Verified
Book Chapter
Closed access
PDF file
ABAkbayan Bekarystankyzy
Akbayan Bekarystankyzy
Orken MamyrbayevOrken Mamyrbayev
Orken Mamyrbayev
MMMateus Mendes
Mateus Mendes
Dina OralbekovaDina Oralbekova
Dina Oralbekova
BZBagashar Zhumazhanov
Bagashar Zhumazhanov
AFAnar Fazylzhanova
Anar Fazylzhanova