The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusion of visible and infrared light can avoid the disadvantages of two single sensors and, in fusing the advantages of both sensors, significantly improve the quality of the images. The fusion of infrared and visible images is widely used in agriculture, industry, medicine, and other fields. In this study, firstly, the architecture of mainstream infrared and visible image fusion technology and application was reviewed; secondly, the application status in robot vision, medical imaging, agricultural remote sensing, and industrial defect detection fields was discussed; thirdly, the evaluation indicators of the main image fusion methods were combined into the subjective evaluation and the objective evaluation, the properties of current mainstream technologies were then specifically analyzed and compared, and the outlook for image fusion was assessed; finally, infrared and visible image fusion was summarized. The results show that the definition and efficiency of the fused infrared and visible image had been improved significantly. However, there were still some problems, such as the poor accuracy of the fused image, and irretrievably lost pixels. There is a need to improve the adaptive design of the traditional algorithm parameters, to combine the innovation of the fusion algorithm and the optimization of the neural network, so as to further improve the image fusion accuracy, reduce noise interference, and improve the real-time performance of the algorithm.

Acquiring phenotypic data from livestock constitutes a crucial yet cumbersome phase in the breeding process. Traditionally, obtaining livestock phenotypic data primarily involves manual, on-body measurement methods. This approach not only requires extensive labor but also induces stress on animals, which leads to potential economic losses. Presently, the integration of next-generation Artificial Intelligence (AI), visual processing, intelligent sensing, multimodal fusion processing, and robotic technology is increasingly prevalent in livestock farming. The advantages of these technologies lie in their rapidity and efficiency, coupled with their capability to acquire livestock data in a non-contact manner. Based on this, we provide a comprehensive summary and analysis of the primary advanced technologies employed in the non-contact acquisition of livestock phenotypic data. This review focuses on visual and AI-related techniques, including 3D reconstruction technology, body dimension acquisition techniques, and live animal weight estimation. We introduce the development of livestock 3D reconstruction technology and compare the methods of obtaining 3D point cloud data of livestock through RGB cameras, laser scanning, and 3D cameras. Subsequently, we explore body size calculation methods and compare the advantages and disadvantages of RGB image calculation methods and 3D point cloud body size calculation methods. Furthermore, we also compare and analyze weight estimation methods of linear regression and neural networks. Finally, we discuss the challenges and future trends of non-contact livestock phenotypic data acquisition. Through emerging technologies like next-generation AI and computer vision, the acquisition, analysis, and management of livestock phenotypic data are poised for rapid advancement.

Natural breeding scenes have the characteristics of a large number of cows, complex lighting, and a complex background environment, which presents great difficulties for the detection of dairy cow estrus behavior. However, the existing research on cow estrus behavior detection works well in ideal environments with a small number of cows and has a low inference speed and accuracy in natural scenes. To improve the inference speed and accuracy of cow estrus behavior in natural scenes, this paper proposes a cow estrus behavior detection method based on the improved YOLOv5. By improving the YOLOv5 model, it has stronger detection ability for complex environments and multi-scale objects. First, the atrous spatial pyramid pooling (ASPP) module is employed to optimize the YOLOv5l network at multiple scales, which improves the model’s receptive field and ability to perceive global contextual multiscale information. Second, a cow estrus behavior detection model is constructed by combining the channel-attention mechanism and a deep-asymmetric-bottleneck module. Last, K-means clustering is performed to obtain new anchors and complete intersection over union (CIoU) is used to introduce the relative ratio between the predicted box of the cow mounting and the true box of the cow mounting to the regression box prediction function to improve the scale invariance of the model. Multiple cameras were installed in a natural breeding scene containing 200 cows to capture videos of cows mounting. A total of 2668 images were obtained from 115 videos of cow mounting events from the training set, and 675 images were obtained from 29 videos of cow mounting events from the test set. The training set is augmented by the mosaic method to increase the diversity of the dataset. The experimental results show that the average accuracy of the improved model was 94.3%, that the precision was 97.0%, and that the recall was 89.5%, which were higher than those of mainstream models such as YOLOv5, YOLOv3, and Faster R-CNN. The results of the ablation experiments show that ASPP, new anchors, C3SAB, and C3DAB designed in this study can improve the accuracy of the model by 5.9%. Furthermore, when the ASPP dilated convolution was set to (1,5,9,13) and the loss function was set to CIoU, the model had the highest accuracy. The class activation map function was utilized to visualize the model’s feature extraction results and to explain the model’s region of interest for cow images in natural scenes, which demonstrates the effectiveness of the model. Therefore, the model proposed in this study can improve the accuracy of the model for detecting cow estrus events. Additionally, the model’s inference speed was 71 frames per second (fps), which meets the requirements of fast and accurate detection of cow estrus events in natural scenes and all-weather conditions.

The use of an accelerometer is considered as a promising method for the automatic measurement of the feeding behavior or feed intake of cattle, with great significance in facilitating daily management. To address further need for commercial use, an efficient classification algorithm at a low sample frequency is needed to reduce the amount of recorded data to increase the battery life of the monitoring device, and a high-precision model needs to be developed to predict feed intake on the basis of feeding behavior. Accelerograms for the jaw movement and feed intake of 13 mid-lactating cows were collected during feeding with a sampling frequency of 1 Hz at three different positions: the nasolabial levator muscle (P1), the right masseter muscle (P2), and the left lower lip muscle (P3). A behavior identification framework was developed to recognize jaw movements including ingesting, chewing and ingesting–chewing through extreme gradient boosting (XGB) integrated with the hidden Markov model solved by the Viterbi algorithm (HMM–Viterbi). Fourteen machine learning models were established and compared in order to predict feed intake rate through the accelerometer signals of recognized jaw movement activities. The developed behavior identification framework could effectively recognize different jaw movement activities with a precision of 99% at a window size of 10 s. The measured feed intake rate was 190 ± 89 g/min and could be predicted efficiently using the extra trees regressor (ETR), whose R², RMSE, and NME were 0.97, 0.36 and 0.05, respectively. The three investigated monitoring sites may have affected the accuracy of feed intake prediction, but not behavior identification. P1 was recommended as the proper monitoring site, and the results of this study provide a reference for the further development of a wearable device equipped with accelerometers to measure feeding behavior and to predict feed intake.

Body dimensions are key indicators for the beef cattle fattening and breeding process. On-animal measurement is relatively inefficient, and can induce severe stress responses among beef cattle and pose a risk for operators, thereby impacting the cattle’s growth rate and wellbeing. To address the above issues, a highly efficient and automatic method was developed to measure beef cattle’s body dimensions, including the oblique length, height, width, abdominal girth, and chest girth, based on the reconstructed three-dimensional point cloud data. The horizontal continuous slice sequence of the complete point clouds was first extracted, and the central point of the beef cattle leg region was determined from the span distribution of the point cloud clusters in the targeted slices. Subsequently, the boundary of the beef cattle leg region was identified by the “five-point clustering gradient boundary recognition algorithm” and was then calibrated, followed by the accurate segmentation of the corresponding region. The key regions for body dimension data calculation were further determined by the proposed algorithm, which forms the basis of the scientific calculation of key body dimensions. The influence of different postures of beef cattle on the measurement results was also preliminarily discussed. The results showed that the errors of calculated body dimensions, i.e., the oblique length, height, width, abdominal girth, and chest girth, were 2.3%, 2.8%, 1.6%, 2.8%, and 2.6%, respectively. In the present work, the beef cattle body dimensions could be effectively measured based on the 3D regional features of the point cloud data. The proposed algorithm shows a degree of generalization and robustness that is not affected by different postures of beef cattle. This automatic method can be effectively used to collect reliable phenotype data during the fattening of beef cattle and can be directly integrated into the breeding process.

As machine vision technology has advanced, pig face recognition has gained wide attention as an individual pig identification method. This study establishes an improved ResNAM network as a backbone network for pig face image feature extraction by combining an NAM (normalization-based attention module) attention mechanism and a ResNet model to probe non-contact open-set pig face recognition. Then, an open-set pig face recognition framework is designed by integrating three loss functions and two metrics to finish the task with no crossover of individuals in the training and test sets. The SphereFace loss function with the cosine distance as a metric and ResNAM are combined in the framework to obtain the optimal open-set pig face recognition model. To train our model, 37 pigs with a total of 12,993 images were randomly selected from the collected pig face images, and 9 pigs with a total of 3431 images were set as a test set. 900 pairs of positive sample pairs and 900 pairs of negative pairs were obtained from the images in the test set. A series of experimental results show that our accuracy reached 95.28%, which was 2.61% higher than that of a human face recognition model. NAM was more effective in improving the performance of the pig face recognition model than the mainstream BAM (bottleneck attention module) and CBAM (convolutional block attention module). The research results can provide technological support for non-contact open-set individual recognition for intelligent farming processes.