This study addresses the limitations of current Optical Character Recognition (OCR) systems in supporting minority languages and integrating intelligent retrieval functions. We propose an integrated system that combines an advanced end-to-end OCR model with a novel hybrid search approach. First, we developed the MultiLang-OCR-30K dataset containing 30,000 annotated samples of handwritten Chinese, Tibetan, and Uyghur texts. Second, we extended the GOT model using a freeze encoder–fine-tune decoder strategy to enhance multilingual capabilities. Finally, we designed a character-level hybrid retrieval framework integrating TF-IDF efficiency with Sentence-BERT semantic strength. Experimental results show our extended GOT model achieves sentence accuracies of 82.3%, 76.5%, and 78.1% for handwritten Chinese, Tibetan, and Uyghur, respectively. The hybrid search improves F1 score by 28.7% over TF-IDF alone while maintaining 23 ms average response time. This system provides a practical solution for multilingual document digitization and management, thereby bridging the technological gap for minority languages.
Accurate recognition of classroom interaction behaviors helps characterize the teaching process, analyze the state of teacher–student interaction, and provide a basis for teaching quality evaluation. Existing methods mostly rely on classroom transcription texts for behavior classification. These methods can capture semantic information in discourse content but have difficulty fully utilizing acoustic cues in speech, such as intonation, pauses, and emotional intensity. Meanwhile, classroom interaction behaviors exhibit obvious contextual dependence, and the current behavior is often associated with preceding behaviors. Modeling only the current utterance can easily overlook the temporal information contained in historical behaviors. To address the above problems, this paper proposes Classroom Multimodal Interaction and Temporal Modeling (CMITM), a multimodal interaction and local temporal modeling method for classroom interactive behavior recognition. CMITM models classroom interactive behaviors from two perspectives: one is the cross-modal feature interaction between text and audio information contained in the current utterance, and the other is the category transition relationships and state evolution processes contained in local historical behaviors. This paper designs cross-modal feature interaction, local historical behavior transition modeling, and adaptive context correction mechanisms to enhance the information complementarity between text and audio and utilize historical contextual information related to the current behavior. Experiments were conducted on a self-built multimodal dataset of classroom interaction behaviors. The results show that CMITM outperforms various unimodal models and multimodal fusion baseline models and achieves better performance on the classroom interaction behavior recognition task.
To address the reliance on manual calibration and the performance degradation caused by loosely coupled modules in lane-wise vehicle counting under complex traffic scenarios, this paper presents a lane-wise vehicle counting system based on adaptive lane partitioning and multi-module integration. The system first applies YOLOPv2 for lane-line detection, providing the basis for lane-region partitioning. Subsequently, Hue-Saturation-Value (HSV) color segmentation, morphological processing, and contour filtering are employed to enhance the robustness of lane feature extraction. Leveraging perspective geometry, lane regions are constructed to achieve adaptive lane partitioning. For vehicle analysis, YOLOv11 is utilized for vehicle detection, and ByteTrack is adopted for multi-object tracking. These modules are combined with lane assignment to form an integrated pipeline that preserves trajectory continuity and mitigates identity loss under occlusion and motion blur. Furthermore, a PyQt5-based interactive visualization interface is developed to support video processing, real-time display, lane-region visualization, and statistical analysis of per-lane traffic flow and lane-change behaviors. Experimental results demonstrate the effectiveness and practicality of the proposed system in complex multi-lane traffic scenarios.