13 December 2024 in IEEE Internet of Things Journal
Robot perception difficulties in complex environments seriously affect robot operational efficiency. The application of generative big model (GBM) technology on robots through the Agriculture Internet of Things (AIoT) can solve the difficulty of low-operational efficiency. Therefore, this article proposes an automatic decision-making localization algorithm for robots fused with GBMs in AIoT. First, in the AIoT, the complex agricultural scene information is acquired in real-time by the Realsense D435i equipped on the robot, which is accessed in the GBM through a proprietary network to realize real-time intelligent sensing and control between the environmental information and the robot. Then, the innovative reinforcement learning method based on human solid feedback (S-RLHF) and the automatic generation method of weakly supervised fine-tuning data (WS-FT DAGM) are designed in the generative large model. At the same time, by combining the characteristics of the robot operation, two generative significant model recommendation methods are designed, which solves the problem of the difficulty of the target perception in the complex agricultural scene. Finally, by integrating the AIoT and generative large models, the critical method of real-time analysis of crop shading characteristics by the large model is innovatively proposed to solve the problem of low efficiency in robot operation. In the robot test experiments, the operation efficiency using the fusion of AIoT and generative large model reaches more than 92%, significantly improving the operation efficiency compared to the small model (CNN) method without AIoT and generative large model in the traditional agricultural robot.
23 January 2026 in Computers and Electronics in Agriculture
1 January 2026 in IEEE Internet of Things Journal
26 March 2026 in IEEE Transactions on Consumer Electronics
The operation performance of agricultural robots is a key factor in the development of smart agriculture, while the interference of dynamic lighting environment is one of the main bottlenecks restricting its performance improvement. To address this problem, this study proposes an agricultural robot posture coupling perception operation system for dynamic lighting environment. Firstly, by analyzing the impact of different lighting conditions on the operation performance of agricultural robots, a light coupling dataset was constructed to provide a data basis for subsequent research. Based on this, this study designed an adaptive two-stage light coupling module LCM (Light Coupling Module), which significantly improved the robot’s perception data signal-to-noise ratio (SNR) and feature extraction robustness in dynamic lighting environment. Furthermore, combined with the adaptive two-stage light coupling module, an adaptive light enhancement model LEM (Light Enhancement Model) was proposed, and the Gaussian enhancement method GEM (Gausterity enhancement method) was innovatively introduced to expand the receptive field by fusing high-dimensional information and enhance the robustness of the model in dynamic lighting environment. In addition, this study also developed a robotic arm-vision system calibration method that incorporates a light compensation mechanism (LDM) to mitigate the impact of light on system performance, reducing the harvesting damage rate from 26.9% to 12.5%. The method was then integrated into an agricultural robot platform for verification. Experimental results show that compared to the original target detection model, the light coupling module (LCM) and LEM model designed in this study increased mAP (mean Average Precision) from 92.36% to 96.11%. Although the number of model parameters has increased, the detection accuracy and robustness in complex lighting environments have been significantly improved. In the actual operation test of the robot, after the introduction of the light coupling module LCM, LEM model and light compensation mechanism LDM, the system positioning accuracy reached 92.3%, which significantly improved the recognition accuracy and positioning accuracy, and greatly improved the operation efficiency of the agricultural robot. This study provides an innovative solution to solve the perception and operation problems of agricultural robots in complex lighting environments, and lays an important foundation for the implementation of smart farms and the development of modern agricultural robot technology.