Artificial intelligence (AI) has smoothly penetrated in a number of monitoring and control applications including the agriculture. However, research efforts towards low-power sensing devices with fully-functional AI on board are still fragmented. In this work, we present an embedded system enriched with the AI ensuring the continuous analysis and in-situ prediction of the growth dynamics of plant leaves. The embedded solution is grounded on a low-power embedded sensing system with a Graphics Processing Unit (GPU) and is able to run the neural networks-based AI on board. We use a Recurrent Neural Network (RNN) called the Long-Short Term Memory network (LSTM) as a core of AI in our system. The proposed approach guarantees the system autonomous operation for 180 days using a standard Li-ion battery. We rely on the state-of-the-art mobile graphical chips for ‘smart’ analysis and control of autonomous devices. This pilot study opens up wide vista for a variety of intelligent monitoring applications, especially in the agriculture domain. Also, we share with the research community the Tomato Growth dataset.
Artificial Intelligence (AI) has been recently applied to a number of sensing scenarios for realizing the prediction, control and/or recognition tasks. However, its integration to embedded systems is still limited. We propose a low-power sensing system with the AI on board with a special focus on the application in agriculture. For this reason we designed a Convolutional Neural Network (CNN) which achieves 83% of average Intersection over Union (IoU) score on the test dataset and 97% of seeds recognition accuracy on the validation dataset. The proposed solution is able to perform the seeds recognition, and germination detection through the images processing. For training the CNN we collect a dataset of images of seed germination process at different stages. The entire system is assessed in an industrial facility. The experimental results demonstrate that the proposed system opens up wide vista for smart applications in the context of Internet of Things requiring the intelligent and autonomous operation from ’things’.
We present Internet of Things (IoT) deployment in a tomato greenhouse in Russia. The IoT enabling technologies applied for this deployment comprise a wireless sensor network, cloud computing, and artificial intelligence. They are to help in monitoring and controlling of both plants and greenhouse conditions as well as predicting the growth rate of tomatoes.
19 February 2021 in IEEE Transactions on Computers
The Hogweed of Sosnowskyi (lat. Heracleum Sosnowskyi) is poisonous for humans, dangerous for farming crops, and local ecosystems. This plant is fast-growing and has already spread all over Eurasia: from Germany to the Siberian part of Russia, and its distribution expands year-by-year. In-situ detection of this harmful plant is a tremendous challenge for many countries. Meanwhile,there are no automatic systems for detection and localization of hogweed. In this work, we report on an approach for fast and accurate detection of hogweed. The approach includes the Unmanned Aerial Vehicle (UAV) with an embedded system on board running various Fully Convolutional Neural Networks (FCNN). We propose the optimal architecture of FCNN for the embedded system relying on the trade-off between the detection quality and frame rate. We propose a model that achieves ROC AUC 0.96 in the hogweed segmentation task, which can process 4K frames at 0.46 FPS on NVIDIA Jetson Nano. The developed system can recognize the hogweed on the scale of individual plants and leaves. This system opens up a wide vista for obtaining comprehensive and relevant data about the spreading of harmful plants allowing for the elimination of their expansion.
Estimation of terrestrial carbon balance is one of the key tasks in the understanding and prognosis of climate change impacts and the development of tools and policies according to carbon mitigation and adaptation strategies. Forest ecosystems are one of the major pools of carbon stocks affected by controversial processes influencing carbon stability. Therefore, monitoring forest ecosystems is a key to proper inventory management of resources and planning their sustainable use. In this survey, we discuss which computer vision techniques are applicable to the most important aspects of forest management actions, considering the wide availability of remote sensing (RS) data of different resolutions based both on satellite and unmanned aerial vehicle (UAV) observations. Our analysis applies to the most occurring tasks such as estimation of forest areas, tree species classification, and estimation of forest resources. Through the survey, we also provide a necessary technical background with a description of suitable data sources, algorithms’ descriptions, and corresponding metrics for their evaluation. The implementation of the provided techniques into routine workflows is a significant step toward the development of systems of continuous actualization of forest data, including real-time monitoring. It is crucial for diverse purposes on both local and global scales. Among the most important are the implementation of improved forest management strategies and actions, carbon offset projects, and enhancement of the prediction accuracy of system changes under different land-use and climate scenarios.
1 May 2020 in Ecotoxicology and Environmental Safety