RM Rasika D Abeyrathna

Dr. RM Rasika D Abeyrathna

University of Tsukuba, Tsukuba, Japan
orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 April 2023 in Sensors
Verified
Journal Article
Open access
PDF file
RM Rasika D AbeyrathnaRM Rasika D Abeyrathna
RM Rasika D Abeyrathna
Victor Massaki NakaguchiVictor Massaki Nakaguchi
Victor Massaki Nakaguchi
AMArkar Minn
Arkar Minn
Tofael AhamedTofael Ahamed
Tofael Ahamed
Recognition and 3D positional estimation of apples during harvesting from a robotic platform in a moving vehicle are still challenging. Fruit clusters, branches, foliage, low resolution, and different illuminations are unavoidable and cause errors in different environmental conditions. Therefore, this research aimed to develop a recognition system based on training datasets from an augmented, complex apple orchard. The recognition system was evaluated using deep learning algorithms established from a convolutional neural network (CNN). The dynamic accuracy of the modern artificial neural networks involving 3D coordinates for deploying robotic arms at different forward-moving speeds from an experimental vehicle was investigated to compare the recognition and tracking localization accuracy. In this study, a Realsense D455 RGB-D camera was selected to acquire 3D coordinates of each detected and counted apple attached to artificial trees placed in the field to propose a specially designed structure for ease of robotic harvesting. A 3D camera, YOLO (You Only Look Once), YOLOv4, YOLOv5, YOLOv7, and EfficienDet state-of-the-art models were utilized for object detection. The Deep SORT algorithm was employed for tracking and counting detected apples using perpendicular, 15°, and 30° orientations. The 3D coordinates were obtained for each tracked apple when the on-board camera in the vehicle passed the reference line and was set in the middle of the image frame. To optimize harvesting at three different speeds (0.052 ms−1, 0.069 ms−1, and 0.098 ms−1), the accuracy of 3D coordinates was compared for three forward-moving speeds and three camera angles (15°, 30°, and 90°). The mean average precision (mAP@0.5) values of YOLOv4, YOLOv5, YOLOv7, and EfficientDet were 0.84, 0.86, 0.905, and 0.775, respectively. The lowest root mean square error (RMSE) was 1.54 cm for the apples detected by EfficientDet at a 15° orientation and a speed of 0.098 ms−1. In terms of counting apples, YOLOv5 and YOLOv7 showed a higher number of detections in outdoor dynamic conditions, achieving a counting accuracy of 86.6%. We concluded that the EfficientDet deep learning algorithm at a 15° orientation in 3D coordinates can be employed for further robotic arm development while harvesting apples in a specially designed orchard.

30 January 2024 in Sensors
Verified
Journal Article
Open access
PDF file
RSRizky Mulya Sampurno
Rizky Mulya Sampurno
ZLZifu Liu
Zifu Liu
RM Rasika D AbeyrathnaRM Rasika D Abeyrathna
RM Rasika D Abeyrathna
Tofael AhamedTofael Ahamed
Tofael Ahamed
Mechanical weed management is a drudging task that requires manpower and has risks when conducted within rows of orchards. However, intrarow weeding must still be conducted by manual labor due to the restricted movements of riding mowers within the rows of orchards due to their confined structures with nets and poles. However, autonomous robotic weeders still face challenges identifying uncut weeds due to the obstruction of Global Navigation Satellite System (GNSS) signals caused by poles and tree canopies. A properly designed intelligent vision system would have the potential to achieve the desired outcome by utilizing an autonomous weeder to perform operations in uncut sections. Therefore, the objective of this study is to develop a vision module using a custom-trained dataset on YOLO instance segmentation algorithms to support autonomous robotic weeders in recognizing uncut weeds and obstacles (i.e., fruit tree trunks, fixed poles) within rows. The training dataset was acquired from a pear orchard located at the Tsukuba Plant Innovation Research Center (T-PIRC) at the University of Tsukuba, Japan. In total, 5000 images were preprocessed and labeled for training and testing using YOLO models. Four versions of edge-device-dedicated YOLO instance segmentation were utilized in this research—YOLOv5n-seg, YOLOv5s-seg, YOLOv8n-seg, and YOLOv8s-seg—for real-time application with an autonomous weeder. A comparison study was conducted to evaluate all YOLO models in terms of detection accuracy, model complexity, and inference speed. The smaller YOLOv5-based and YOLOv8-based models were found to be more efficient than the larger models, and YOLOv8n-seg was selected as the vision module for the autonomous weeder. In the evaluation process, YOLOv8n-seg had better segmentation accuracy than YOLOv5n-seg, while the latter had the fastest inference time. The performance of YOLOv8n-seg was also acceptable when it was deployed on a resource-constrained device that is appropriate for robotic weeders. The results indicated that the proposed deep learning-based detection accuracy and inference speed can be used for object recognition via edge devices for robotic operation during intrarow weeding operations in orchards.

19 December 2024 in Sensors
Verified
Journal Article
Open access
PDF file
ZLZifu Liu
Zifu Liu
RSRizky Mulya Sampurno
Rizky Mulya Sampurno
RM Rasika D AbeyrathnaRM Rasika D Abeyrathna
RM Rasika D Abeyrathna
Victor Massaki NakaguchiVictor Massaki Nakaguchi
Victor Massaki Nakaguchi
Tofael AhamedTofael Ahamed
Tofael Ahamed
With the decreasing and aging agricultural workforce, fruit harvesting robots equipped with higher degrees of freedom (DoF) manipulators are seen as a promising solution for performing harvesting operations in unstructured and complex orchard environments. In such a complex environment, guiding the end-effector from its starting position to the target fruit while avoiding obstacles poses a significant challenge for path planning in automatic harvesting. However, existing studies often rely on manually constructed environmental map models and face limitations in planning efficiency and computational cost. Therefore, in this study, we introduced a collision-free path planning method for a 6-DoF orchard harvesting manipulator using an RGB-D camera and the Bi-RRT algorithm. First, by transforming the RGB-D camera’s point cloud data into collision geometries, we achieved 3D obstacle map reconstruction, allowing the harvesting robot to detect obstacles within its workspace. Second, by adopting the URDF format, we built the manipulator’s simulation model to be inserted with the reconstructed 3D obstacle map environment. Third, the Bi-RRT algorithm was introduced for path planning, which performs bidirectional expansion simultaneously from the start and targets configurations based on the principles of the RRT algorithm, thereby effectively shortening the time required to reach the target. Subsequently, a validation and comparison experiment were conducted in an artificial orchard. The experimental results validated our method, with the Bi-RRT algorithm achieving reliable collision-free path planning across all experimental sets. On average, it required just 0.806 s and generated 12.9 nodes per path, showing greater efficiency in path generation compared to the Sparse Bayesian Learning (SBL) algorithm, which required 0.870 s and generated 15.1 nodes per path. This method proved to be both effective and fast, providing meaningful guidance for implementing path planning for a 6-DoF manipulator in orchard harvesting tasks.

9 June 2024 in Sensors
Verified
Journal Article
Open access
PDF file
RM Rasika D AbeyrathnaRM Rasika D Abeyrathna
RM Rasika D Abeyrathna
Victor Massaki NakaguchiVictor Massaki Nakaguchi
Victor Massaki Nakaguchi
ZLZifu Liu
Zifu Liu
RSRizky Mulya Sampurno
Rizky Mulya Sampurno
Tofael AhamedTofael Ahamed
Tofael Ahamed
Accurate localization of apples is the key factor that determines a successful harvesting cycle in the automation of apple harvesting for unmanned operations. In this regard, accurate depth sensing or positional information of apples is required for harvesting apples based on robotic systems, which is challenging in outdoor environments because of uneven light variations when using 3D cameras for the localization of apples. Therefore, this research attempted to overcome the effect of light variations for the 3D cameras during outdoor apple harvesting operations. Thus, integrated single-point laser sensors for the localization of apples using a state-of-the-art model, the EfficientDet object detection algorithm with an mAP@0.5 of 0.775 were used in this study. In the experiments, a RealSense D455f RGB-D camera was integrated with a single-point laser ranging sensor utilized to obtain precise apple localization coordinates for implementation in a harvesting robot. The single-point laser range sensor was attached to two servo motors capable of moving the center position of the detected apples based on the detection ID generated by the DeepSORT (online real-time tracking) algorithm. The experiments were conducted under indoor and outdoor conditions in a spindle-type apple orchard artificial architecture by mounting the combined sensor system behind a four-wheel tractor. The localization coordinates were compared between the RGB-D camera depth values and the combined sensor system under different light conditions. The results show that the root-mean-square error (RMSE) values of the RGB-D camera depth and integrated sensor mechanism varied from 3.91 to 8.36 cm and from 1.62 to 2.13 cm under 476~600 lx to 1023~1100 × 100 lx light conditions, respectively. The integrated sensor system can be used for an apple harvesting robotic manipulator with a positional accuracy of ±2 cm, except for some apples that were occluded due to leaves and branches. Further research will be carried out using changes in the position of the integrated system for recognition of the affected apples for harvesting operations.

9 May 2023 in Inventions
Verified
Journal Article
Open access
PDF file
Arkar MinnArkar Minn
Arkar Minn
RM Rasika D AbeyrathnaRM Rasika D Abeyrathna
RM Rasika D Abeyrathna
Victor Massaki NakaguchiVictor Massaki Nakaguchi
Victor Massaki Nakaguchi
Tofael AhamedTofael Ahamed
Tofael Ahamed
Developing countries in Asia widely use manual seed broadcasting methods due to a lack of appropriate seeding machinery. The agricultural sector is currently facing labor shortages and high labor costs, especially seasonal labor shortages for broadcasting and transplanting operations. However, the primary constraint in adopting existing broadcasting seeders for small-scale farmers in developing countries is the high initial purchase costs. Therefore, developing locally commercial accessible technology for small-scale farmers is an urgent requirement. In this regard, attempt was taken to develop a new low-cost 3D printed seeder that can be used for multi-crop seed broadcasting operations when integrated with an autonomous terrain vehicle. A new seed metering mechanism was proposed for seed broadcasting that can be controlled electronically from the autonomous terrain vehicle. Positional sensors based on the real time kinematics—global navigation satellite system (RTK-GNSS) were used to record positional information. The best observation was noted at a vehicle operational speed of 0.351 ms−1 and had a coefficient of variation (CV) referring to the distribution uniformity of seeds of 19% for green peas, 22% for cowpeas, and 25% for chickpeas. The developed seeder could spread multi-crop seeds and adjust the seed rates electronically at the different ranges of rotational speeds. Therefore, the use of 3D printed fabricated prototype seed broadcasting units with small-scale autonomous vehicles can be implemented to help in labor supplements and perform the broadcasting of different seeds.

11 April 2023
Verified
Book Chapter
Closed access
PDF file
MHMunirah Hayati Hamidon
Munirah Hayati Hamidon
MSMohammad Hussain Seyar
Mohammad Hussain Seyar
PKP. D. Kahandage
P. D. Kahandage
Victor Massaki NakaguchiVictor Massaki Nakaguchi
Victor Massaki Nakaguchi
AMArkar Minn
Arkar Minn
Tofael AhamedTofael Ahamed
Tofael Ahamed