Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model’s feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

The identification of safflower filament targets and the precise localization of picking points are fundamental prerequisites for achieving automated filament retrieval. In light of challenges such as severe occlusion of targets, low recognition accuracy, and the considerable size of models in unstructured environments, this paper introduces a novel lightweight YOLO-SaFi model. The architectural design of this model features a Backbone layer incorporating the StarNet network; a Neck layer introducing a novel ELC convolution module to refine the C2f module; and a Head layer implementing a new lightweight shared convolution detection head, Detect_EL. Furthermore, the loss function is enhanced by upgrading CIoU to PIoUv2. These enhancements significantly augment the model’s capability to perceive spatial information and facilitate multi-feature fusion, consequently enhancing detection performance and rendering the model more lightweight. Performance evaluations conducted via comparative experiments with the baseline model reveal that YOLO-SaFi achieved a reduction of parameters, computational load, and weight files by 50.0%, 40.7%, and 48.2%, respectively, compared to the YOLOv8 baseline model. Moreover, YOLO-SaFi demonstrated improvements in recall, mean average precision, and detection speed by 1.9%, 0.3%, and 88.4 frames per second, respectively. Finally, the deployment of the YOLO-SaFi model on the Jetson Orin Nano device corroborates the superior performance of the enhanced model, thereby establishing a robust visual detection framework for the advancement of intelligent safflower filament retrieval robots in unstructured environments.

Addressing the limitation of existing object detection methods in accurately distinguishing the hazard level posed by foreign objects on railway tracks, this study proposes an intrusion warning approach for foreign object detection and risk assessment on railway surfaces. This method integrates MobileNetv3 with Transformer to detect foreign objects on railway tracks, constructing a novel backbone feature extraction network, MobileNetV3-CATr, aimed at reducing model complexity. Furthermore, a BiFPN-Lite module is introduced to fuse more target features without increasing complexity, with YOLO Head utilized to output the type information of foreign objects on the track surface. An improved track detection method is adopted toextact the railway tracks, using least squares to establish a track linear equation and delineate risk level zones. Key points of foreign objects within the image positions are selected to evaluate the intrusion risk level. Verification of detection accuracy for foreign object intrusions on railway tracks is conducted on a self-constructed image dataset. The results demonstrate that the proposed detection model can effectively identify foreign object intrusions on tracks, mitigating issues such as missed and false alarms. It achieves a 3.7% improvement in mean average precision ( mAP ) compared to the baseline model. Additionally, the refined Unet semantic segmentation network A_MIoU attains an accuracy of 90.53%, representing a 2.65% enhancement over its predecessor, with better extracted track edge integrity. The proposed risk assessment method determines different intrusion risk levels based on the location of the intruding objects, thereby assisting relevant personnel in adopting appropriate actions to enhance the safe operation of trains.

Accurate identification of picking points remains a critical challenge for automated marigold harvesting, primarily due to complex backgrounds and significant pose variations of the flowers. To overcome this challenge, this study proposes SCS-YOLO-Seg, a novel method based on a lightweight segmentation model. The approach enhances the baseline YOLOv8n-seg architecture by replacing its backbone with StarNet and introducing C2f-Star, a novel lightweight feature extraction module. These modifications achieve substantial model compression, significantly reducing the model size, parameter count, and computational complexity (GFLOPs). Segmentation efficiency is further optimized through a dual-path collaborative architecture (Seg-Marigold head). Following mask extraction, picking points are determined by intersecting the optimized elliptical mask fitting results with the stem skeleton. Experimental results demonstrate that SCS-YOLO-Seg effectively balances model compression with segmentation performance. Compared to YOLOv8n-seg, it maintains high accuracy while significantly reducing resource requirements, achieving a picking point identification accuracy of 93.36% with an average inference time of 28.66 ms per image. This work provides a robust and efficient solution for vision systems in automated marigold harvesting.

This study addresses the core challenges of precise marigold corollas recognition and efficient continuous path planning under complex natural conditions (strong illumination, occlusion, adhesion) by proposing an integrated lightweight visual recognition and real-time path planning framework. We introduce MPD-YOLO, an optimized model based on YOLOv11n, incorporating (1) a Multi-scale Information Enhancement Module (MSEE) to boost feature extraction; (2) structured pruning for significant model compression (final size: 2.1 MB, 39.6% of original); and (3) knowledge distillation to recover accuracy loss post-pruning. The resulting model achieves high precision (P: 89.8%, mAP@0.5: 95.1%) with reduced computational load (3.2 GFLOPs) while demonstrating enhanced robustness in challenging scenarios—recall significantly increased by 6.8% versus YOLOv11n. Leveraging these recognition outputs, an adaptive ant colony algorithm featuring dynamic parameter adjustment and an improved pheromone strategy reduces average path planning time to 2.2 s—a 68.6% speedup over benchmark methods. This integrated approach significantly enhances perception accuracy and operational efficiency for automated marigold harvesting in unstructured environments, providing robust technical support for continuous automated operations.

A key challenge in automated marigold harvesting lies in the accurate identification of picking points under complex environmental conditions, such as dense shading and intense illumination. To tackle this problem, this research proposes a lightweight instance segmentation model combined with a harvest position estimation method. Based on the YOLOv11n-seg segmentation framework, we develop a lightweight PDS-YOLO model through two key improvements: (1) structural pruning of the base model to reduce its parameter count, (2) incorporation of a Channel-wise Distillation (CWD)-based feature distillation method to compensate for the accuracy loss caused by pruning. The resulting lightweight segmentation model achieves a size of only 1.3 MB (22.8% of the base model) and a computational cost of 5 GFLOPs (49.02% of the base model). At the same time, it maintains high segmentation performance, with a precision of 93.6% and a mean average precision (mAP) of 96.7% for marigold segmentation. Furthermore, the proposed model demonstrates enhanced robustness under challenging scenarios including strong lighting, cloudy weather, and occlusion, improving the recall rate by 1.1% over the base model. Based on the segmentation results, a method for estimating marigold harvest positions using 3D point clouds is proposed. Fitting and deflection angle experiments confirm that the fitting errors are constrained within 3–12 mm, which lies within an acceptable range for automated harvesting. These results validate the capability of the proposed approach to accurately locate marigold harvest positions under top-down viewing conditions. The lightweight segmentation network and harvest position estimation method presented in this work offer effective technical support for selective harvesting of marigolds.