Sign languages are characterized by complex and subtle hand movements, which are challenging for computer vision systems to accurately recognize. This study suggests an innovative deep learning pipeline specifically designed for reliable gesture recognition of Kazakh Sign Language. This approach combines key point detection using the YOLO model, optical flow estimation, and a bidirectional long short-term memory (BiLSTM) network. At the initial stage, a dataset is generated using MediaPipe, which is then used to train the YOLO model in order to accurately identify key hand points. After training, the YOLO model extracts key points and bounding boxes from video recordings of gestures, creating consistent representations of movements. To improve the recognition of dynamic gestures, the optical flow is calculated in an area covering 10% of the area around key points, which allows the dynamics of movements to be captured and provides additional time characteristics. The BiLSTM network is trained on multimodal input that combines data on keypoints, bounding boxes, and optical flow, resulting in improved gesture classification accuracy. The experimental results demonstrate that the proposed approach is superior to traditional methods based solely on key points, especially in recognizing fast and complex gestures. The proposed structure promotes the development of sign language recognition technologies, especially for poorly studied languages such as Kazakh, paving the way to more inclusive and effective communication tools.

The optimization capabilities of Kolmogorov–Arnold Networks (KANs) remain largely unexplored, which has limited their practical use in video anomaly recognition compared to conventional 3D-CNNs. To address this gap, we introduce a novel hybrid optimization framework that combines a Minimax Ant System (MMAS) for hyperparameter selection with a modified DARTS strategy for adaptive tuning of the 3D KAN architecture. Unlike existing approaches, our method simultaneously optimizes both learning dynamics and architectural configurations, enabling KANs to better exploit their expressive power in spatiotemporal feature extraction. Applied to a three-class video dataset, the proposed approach improved model accuracy to 87%, surpassing the performance of a standard 3D-CNN by 6%.