Human activity recognition (HAR) is pivotal in advancing applications ranging from healthcare monitoring to interactive gaming. Traditional HAR systems, primarily relying on single data sources, face limitations in capturing the full spectrum of human activities. This study introduces a comprehensive approach to HAR by integrating two critical modalities: RGB imaging and advanced pose estimation features. Our methodology leverages the strengths of each modality to overcome the drawbacks of unimodal systems, providing a richer and more accurate representation of activities. We propose a two-stream network that processes skeletal and RGB data in parallel, enhanced by pose estimation techniques for refined feature extraction. The integration of these modalities is facilitated through advanced fusion algorithms, significantly improving recognition accuracy. Extensive experiments conducted on the UTD multimodal human action dataset (UTD MHAD) demonstrate that the proposed approach exceeds the performance of existing state-of-the-art algorithms, yielding improved outcomes. This study not only sets a new benchmark for HAR systems but also highlights the importance of feature engineering in capturing the complexity of human movements and the integration of optimal features. Our findings pave the way for more sophisticated, reliable, and applicable HAR systems in real-world scenarios.
Accurate air quality prediction (AQP) is crucial for safeguarding public health and guiding smart city management. However, reliable assessment remains challenging due to complex emission patterns, meteorological variability, and chemical interactions, compounded by the limited coverage of ground-based monitoring networks. To address this gap, we propose Vision-AQ (Visual Integrated Operational Network for Air Quality), a novel multi-modal deep learning framework that classifies Air Quality Index (AQI) levels by integrating environmental imagery with pollutant data. Vision-AQ employs a dual-input neural architecture: (1) a pre-trained ResNet50 convolutional neural network (CNN) that extracts high-level features from city-scale environmental photographs in India and Nepal, capturing haze, smog, and visibility patterns, and (2) a multi-layer perceptron (MLP) that processes tabular sensor data, including , , and AQI values. The fused representations are passed to a classifier to predict six AQI categories. Trained on a comprehensive dataset, the model achieves strong predictive performance with high accuracy, precision, recall and F1-score of 99%, with 23.7 million parameters. To ensure interpretability, we use Grad-CAM visualization to highlights the model’s reliance on meaningful atmospheric features, confirming its explainability. The results demonstrate that Vision-AQ is a reliable, scalable, and cost-effective approach for localized AQI classification, offering the potential to augment conventional monitoring networks and enable more granular air quality management in urban South Asia.
Electroencephalography (EEG) has emerged as a powerful, non-invasive modality for investigating neurological and oculomotor disorders, particularly when combined with advances in artificial intelligence (AI). This systematic review examines recent progress in machine learning (ML) and deep learning (DL) techniques applied to EEG-based analysis for the diagnosis, classification, and monitoring of neurological conditions, including oculomotor-related disorders. Following the PRISMA guidelines, a structured literature search was conducted across major scientific databases, resulting in the inclusion of 15 peer-reviewed studies published over the last decade. The reviewed works encompass a range of neurological and ocular-related disorders and employ diverse AI models, from conventional ML algorithms to advanced DL architectures capable of learning complex spatiotemporal representations of neural signals. Key trends in feature extraction, signal representation, model design, and validation strategies are synthesized here to highlight methodological advancements and common challenges. While the reviewed studies demonstrate the growing potential of AI-enhanced EEG analysis for supporting clinical decision-making, limitations such as small sample sizes, heterogeneous datasets, and limited external validation remain prevalent. Addressing these challenges through standardized methodologies, larger multi-center datasets, and robust validation frameworks will be essential for translating EEG-driven AI approaches into reliable clinical applications. Overall, this review provides a comprehensive overview of current methodologies and future directions for AI-driven EEG analysis in neurological and oculomotor disorder assessment.
Epilepsy is a long-term neurological disorder affecting more than 65 million people worldwide, and accurate detection of its phases from electroencephalogram (EEG) signals is essential for diagnosis and patient management. This paper presents a comprehensive method for multi-phase seizure classification using robust feature engineering, advanced machine learning (ML), deep learning (DL), and explainable artificial intelligence (XAI). A rich set of EEG features is constructed, combining traditional and specialized metrics to capture subtle neurophysiological shifts across seizure phases. Exploratory data analysis demonstrates the discriminative power of these features, with PCA and t-SNE revealing distinct non-linear clusters. Multiple ML models—including Random Forest, Support Vector Machines, K-Nearest Neighbors, LightGBM, and XGBoost—are evaluated using 5-fold stratified cross-validation, achieving consistently high performance. The proposed MLP-based EpilepsyNet-XAI model outperforms all baselines. Post hoc XAI techniques such as LIME are applied to enhance transparency and interpretability in the classification process. By integrating high-performing models with interpretable analysis, this work supports more reliable AI-driven approaches for methodological epilepsy research and analysis.
Autonomous driving (AD) systems remain vulnerable to rare, ambiguous, and out-of-label (OOL) hazards that are insufficiently represented in conventional training datasets. This work investigates perception robustness under such conditions by using the Challenge of Out-Of-Label (COOOL) benchmark dataset, which consists of 200 dashcam video sequences annotated with both common and uncommon traffic hazards. We analyze that the behavior of widely used methods in the perception of components and present a multimodal pipeline in which we integrate YOLO11x for object detection, Hough Transform for lane estimation, and GPT-4o for scene description, and for temporal modeling, we use Long Short-Term Memory (LSTM) networks. On the COOOL benchmark, YOLO11x achieves an of on the common object categories, whereas the detection of rare and OFL hazards remains challenging, with a recall of . Incorporating temporal risk modeling improves hazard recall to , indicating a modest but consistent gain in recognizing uncommon events. Hough Transform shows the stable behavior in standard conditions for lane estimation, with a mean lateral deviation of pixels in daylight scenes and pixels under low-light conditions. The temporal anomaly detection module attains an AUROC of , reflecting the limitation but meaningful discrimination between nominal and anomalous driving situations. For interpretability, the GPT-4o scene description module generates context-aware textual explanations with an object coverage score of and a factual consistency rate of , as assessed through manual inspection. The end-to-end pipeline operates at approximately 10–12 frames per second on a single GPU, supporting near-real-time analysis and optimization. Our results confirm that state-of-the-art perception models struggle with OOL hazards and that multimodal vision–language–temporal integration provides incremental improvements in robustness and interpretability when evaluated under the standardized out-of-distribution conditions.