Since multimodal emotion classification in different human states has rarely been studied, this paper explores the emotional mechanisms of the brain functional connectivity networks after emotional stimulation. We devise a multimodal emotion classification method fusing a brain functional connectivity network based on electroencephalography (EEG) and eye gaze (ECFCEG) to study emotional mechanisms. First, the nonlinear phase lag index (PLI) and phase-locked value (PLV) are calculated to construct the multiband brain functional connectivity networks, which are then converted into binary brain networks, and the seven features of the binary brain networks are extracted. At the same time, the features of the eye gaze signals are extracted. Then, a fusion algorithm called kernel canonical correlation analysis, based on feature level and randomization (FRKCCA), is executed for feature-level fusion (FLF) of brain functional connectivity networks and eye gaze. Finally, support vector machines (SVMs) are utilized to classify positive and negative emotions in multiple frequency bands with single modal features and multimodal features. The experimental results demonstrate that multimodal complementary representation properties can effectively improve the accuracy of emotion classification, achieving a classification accuracy of 91.32±1.81%. The classification accuracy of pupil diameter in the valence dimension is higher than that of additional features. In addition, the average emotion classification effect of the valence dimension is preferable to that of arousal. Our findings demonstrate that the brain functional connectivity networks of the right brain exhibit a deficiency. In particular, the information processing ability of the right temporal (RT) and right posterior (RP) regions is weak in the low frequency after emotional stimulation; Conversely, phase synchronization of the brain functional connectivity networks based on PLI is stronger than that of PLV.
Accurate detection of apple blossoms is critical for monitoring flowering status and optimizing agricultural management. Traditional methods often fail to address challenges such as overlapping petals and environmental variability, leading to inefficiency and inaccuracy. In this paper, LEAF-Net, a modified YOLOv11-based target detection model, is proposed. The original C3k2 module in YOLOv11 lacks a targeted attention mechanism and exhibits insufficient enhancement of key features such as petal edges. Therefore, we propose our model, LEAF-Net, which incorporates a Multi-scale Attention Enhanced Block (MAEB) that enhances edge feature extraction through a hierarchical attention mechanism and reconstructs the C3k2 module. A Frequency-aware Feature Pyramid Network (Freq-FPN) that optimizes multi-scale feature fusion while preserving high-frequency details; and a comprehensive apple blossom dataset capturing diverse growth stages and environmental conditions. To address the dataset deficiencies, a specialized apple blossom dataset with complex backgrounds is constructed. Experimental results demonstrate state-of-the-art performance, with LEAF-Net achieving 90.4% mAP50 and 70.4% mAP50-95, significantly outperforming existing benchmarks. The framework’s computational efficiency (7.1 GFLOPs) and adaptability make it suitable for real-time deployment in precision agriculture. These advancements provide an extensible framework for precision orchard surveillance, thereby paving the way for their adaptive deployment in diverse agricultural automation contexts.
27 February 2025 in IEEE Internet of Things Journal
In the field of the Internet of Medical Things (IoMT), the demand for Human Action Recognition (HAR) is growing. Due to the limitations of portability and privacy of traditional sensors, many endeavors have made significant progress in 3D skeleton-based action recognition. However, existing methods ignore potential higher-order semantic information between joints and fail to perceive rapidly changing dynamic details, resulting in frequent confusion of actions with similar motion trajectories. To alleviate this issue, we propose a novel learning confusion representation network (LCR-Net). Specifically, a progressive feature enhancement module is first designed to utilize self-attention to gradually aggregate lower-order features to higher-order features, emphasizing the relative movement between body parts. Second, we design the enhanced spatiotemporal convolution to explore the potential spatio-temporal dependencies between joints by adding a mask matrix and an attention fusion mechanism. To further perceive the spatiotemporal relationships in subtle changes, we divide the interactive sparse-dense pathways at different spatio-temporal resolutions and enhance the complementary information between the two pathways through feature interaction. Finally, the frequency excitation learning module is proposed to efficiently learn the importance of different frequencies by cross-channel modeling, promoting the compactness of actions within classes and the separability of confusion actions. In addition, the lightweight LCR-Net+ is achieved through model compression optimization to meet the deployment requirements of IoT systems. Comprehensive experiments conducted on three public datasets (NTU-RGB+ D60&120, NW-UCLA) demonstrate the superior performance of our model.