Behavioral computing based on visual cues has become increasingly important, as it can capture and annotate teachers’ and students’ classroom states on a large scale and in real time. However, there is a lack of consensus on the research status and future trends of computer vision-based classroom behavior recognition. The present study conducted a systematic literature review of 80 peer-reviewed journal articles following the Preferred Reporting Items for Systematic Assessment and Meta-Analysis (PRISMA) guidelines. Three research questions were addressed concerning goal orientation, recognition techniques, and research challenges. Results showed that: (1) computer vision-supported classroom behavior recognition focused on four categories: physical action, learning engagement, attention, and emotion. Physical actions and learning engagement have been the primary recognition targets; (2) behavioral categorizations have been defined in various ways and lack connections to instructional content and events; (3) existing studies have focused on college students, especially in a natural classical classroom; (4) deep learning was the main recognition method, and the YOLO series was applicable for multiple behavioral purposes; (5) moreover, we identified challenges in experimental design, recognition methods, practical applications, and pedagogical research in computer vision. This review will not only inform the recognition and application of computer vision to classroom behavior but also provide insights for future research.

Classroom learning behavior recognition can provide effective technical support for teaching and learning. However, in natural classroom teaching scenarios, classroom learning behaviors are often missed or falsely detected due to character occlusion and the small object. To tackle the above issues, this study proposed an improved classroom learning behavior recognition algorithm (YOLOv8n_BT) based on YOLOv8n. On the one hand, for the occlusion problem of classroom learning behaviors, this study incorporated the BRA into the Backbone to better capture feature information; on the other hand, for the small object problem of classroom learning behaviors for back-row-students, this study expanded a Tiny Object Detection Layer (TODL) to detect small targets better. Experiments show that the BRA and the TODL can significantly improve the model performance. The YOLOv8n_BT model, which incorporated both the BRA and the TODL into the YOLOv8n(baseline) model simultaneously, has the most significant performance improvement. Compared with the YOLOv8n(baseline), the YOLOv8n_BT model improved by 3.0%, 6.7%, 5.0%, 3.6%, and 9.0% on P, R, F1, mAP50, and mAP50-90, respectively. The detection performance of YOLOv8n_BT also outperforms other state-of-the-arts.

Freeway traffic flow prediction is of great significance to freeway traffic management, route planning, toll strategy development and public safety. Existing traffic flow prediction methods mainly use deep learning models, which mainly have the following two problems: on the one hand, the special characteristics of the highway network structure make the common urban network traffic flow prediction methods inapplicable; on the other hand, the influence of external factors, such as weather and accidents, on the flow is ignored. Aiming at the above problems, this paper proposes a highway traffic flow prediction algorithm that supports multi-traffic parameter detection. Firstly, the topological map conforming to the highway network structure is constructed, which makes the traffic distribution conform to the reality; secondly, the initial prediction of the traffic is made by using the Informer time series model; finally, the traffic adjustment template is constructed by using the regression model according to the multi-traffic parameters. In this paper, multiple angles are selected to test the performance of the algorithm on two real datasets, and the results show that the performance of the algorithm in this paper is significantly improved compared with other mainstream traffic models.