UAV-based visible-infrared image fusion can offer a promising tool for rapid identification of rice blast resistance (RBR), which is significant to promote rice breeding and ensure global food security. However, effectively combining the benefits of visible and infrared modalities for RBR identification still remains a challenge. This challenge stems from the difficulty of adaptively balancing the contribution of both modalities, and preserving the integrity of local and global representation for decision making. Also, the widely employed multi-scale feature fusion brings extra computational costs. To address the aforementioned limitations, this paper proposes a parallel resnet-transformer and cross-modal attention (PRCA) network for rapid RBR identification. The hybrid architecture processes the local and global feature learning in separate branches, retaining the representation ability of local and global features to maximum extent. Later, we introduce a visible-infrared cross-modal (VICM) attention mechanism to build the integration of visible and infrared modalities, striving to balance the contribution of visible and infrared imagery. Next, we present a lightweight multi-scale feature fusion (LMFF) method to further improve the precision, introducing no extra parameters and low computational costs. Comparison results of field tests on 530 rice plots showed that the PRCA model outperformed other SOTA methods in OA (+1.85%), kappa (+3.22%), F1-score (+0.24%), and recall (+1.38%). Finally, the effectiveness of our method was validated through ablation study. The experimental results indicate that the PRCA method has potential in RBR identification as well as quantitative inversion of other phenotypic traits.
Understanding how piglets move around sows during posture changes is crucial for their safety and healthy growth. Automated monitoring can reduce farm labor and help prevent accidents like piglet crushing. Current methods (called Joint Detection-and-Tracking-based, abbreviated as JDT-based) struggle with problems like misidentifying piglets or losing track of them due to crowding, occlusion, and shape changes. To solve this, we developed MSHMTracker, a smarter tracking system that introduces a motion-status hierarchical architecture to significantly improve tracking performance by adapting to piglets’ motion statuses. In MSHMTracker, a score- and time-driven hierarchical matching mechanism (STHM) was used to establish the spatio-temporal association by the motion status, helping maintain accurate tracking even in challenging conditions. Finally, piglet group aggregation or dispersion behaviors in response to sow posture changes were identified based on the tracked trajectory information. Tested on 100 videos (30,000+ images), our method achieved 93.8% tracking accuracy (MOTA) and 92.9% identity consistency (IDF1). It outperformed six popular tracking systems (e.g., DeepSort, FairMot). The mean accuracy of behavior recognition was 87.5%. In addition, the correlations (0.6 and 0.82) between piglet stress responses and sow posture changes were explored. This research showed that piglet movements are closely related to sow behavior, offering insights into sow–piglet relationships. This work has the potential to reduce farmers’ labor and improve the productivity of animal husbandry.