11 June 2025 in Applied Soft Computing
18 August 2025 in IEEE Transactions on Computational Social Systems
The integration of artificial intelligence (AI) into the modern educational system is rapidly evolving, particularly in monitoring student behavior in classrooms—a task traditionally dependent on manual observation. This conventional method is notably inefficient, prompting a shift toward more advanced solutions such as computer vision. However, existing target detection models face significant challenges such as occlusion, blurring, and scale disparity, which are exacerbated by the dynamic and complex nature of classroom settings. Furthermore, these models must adeptly handle multiple target detection. To overcome these obstacles, we introduce the student classroom behavior detection with multiscale deformable transformers (SCB-DETR), an innovative approach that utilizes large convolutional kernels for upstream feature extraction, and multiscale feature fusion. This technique significantly improves the detection capabilities for multiscale and occluded targets, offering a robust solution for analyzing student behavior. SCB-DETR establishes an end-to-end system that simplifies the detection process and consistently outperforms other deep learning methods. Employing our custom student classroom behavior (SCBehavior) dataset, SCB-DETR achieves a mean Average Precision (mAP) of 0.626, which is a 1.5% improvement over the baseline model’s mAP and a 6% increase in AP50. These results demonstrate SCB-DETR’s superior performance in handling the uneven distribution of student behaviors and ensuring precise detection in dynamic classroom environments. The source code of this study is publicly available at https://github.com/CCNUZFW/SCB-DETR.
17 April 2026 in IEEE Transactions on Computational Social Systems
With the rapid advancement of industrial informatics, educational behavior detection has become crucial for enabling intelligent, personalized teaching in smart education. Traditional methods, reliant on predefined behavior categories, struggle to meet the demands of open-vocabulary learning behavior detection in real-world scenarios. To address this, we introduce education open behavior detection (Edu-OBD), an open-vocabulary learning behavior detection model designed for smart education using a pretraining approach based on region-text pairs. The model employs a contrastive language-image pretraining encoder and contrastive loss to enable effective open-vocabulary behavior detection. To enhance the integration of image and text features, we propose a novel visual-language integrator comprising two modules: text-guided sparse attention (TGSA) and multiscale text enhancer (MSTE). TGSA strengthens category-relevant semantic information, while MSTE refines multiscale feature embeddings. In addition, the position-aware context fusion module (PCFM) uses relative position encoding to improve feature extraction. For evaluation, we developed the zero-shot behavior evaluation dataset (ZBED), tailored for zero-shot evaluation on novel behaviors. Experimental results show that Edu-OBD achieves 33.6% average precision (AP) at 81.2 frames per second (FPS) on ZBED and 28.1% AP for novel category detection, demonstrating its effectiveness as a flexible and efficient solution for educational behavior detection in complex environments, paving the way for future research in smart education.