Small-scale farming can benefit from the usage of information and communication technology (ICT) to improve crop and soil management and increase yield. However, in order to introduce digital farming in rural areas, related ICT solutions must be viable, seamless and easy to use, since most farmers are not acquainted with technology. With that in mind, this paper proposes an Internet of Things (IoT) sensing platform that provides information on the state of the soil and surrounding environment in terms of pH, moisture, texture, colour, air temperature, and light. This platform is coupled with computer vision to further analyze and understand soil characteristics. Moreover, the platform hardware is housed in a specifically designed robust casing to allow easy assembly, transport, and protection from the deployment environment. To achieve requirements of usability and reproducibility, the architecture of the IoT sensing platform is based on low-cost, off-the-shelf hardware and software modularity, following a do-it-yourself approach and supporting further extension. In-lab validations of the platform were carried out to finetune its components, showing the platform’s potential for application in rural areas by introducing digital farming to small-scale farmers, and help them delivering better produce and increasing income.
Glaucoma is a heterogeneous group of diseases characterised by cupping of the optic nerve head and visual field damage, starting with a progressive loss of vision that leads to permanent blindness. When diagnosed in time, Glaucoma can be delayed by adequate treatment. More efficient processes for diagnosis are being proposed, and the role of artificial intelligence in the field is growing. This work presents a pipeline to evaluate the impact of generative modelling in Computer-Aided Diagnosis (CADx) of Glaucoma based on Deep Learning, particularly focused on the optic disc region. The methodology relies on transforming retinal fundus images to improve and degrade their quality to augment the training data and assess the diagnostic performance. The objective evaluation of the proposed model based on Generative Adversarial Networks revealed quantitative and qualitative improvements in image quality. To support this, we propose a new model to evaluate the quality of fundus images, which can also be used within the pipeline to reject samples with lower image quality for diagnosis. Its performance surpassed related work, achieving a balanced accuracy of 0.929. Concerning Glaucoma CADx, the results obtained in public datasets point to a considerable gain in Sensitivity, Specificity, and Accuracy, achieving scores of 0.883 (+0.054), 0.957 (+0.019), and 0.931 (+0.031), respectively, after image data augmentation when compared with previous work targeted at offline inference in mobile devices. Considering the restriction of choosing simpler backbone networks that can run on edge devices, our findings support the importance of image quality diversity and realistic augmentation.
The direct effect of global warming on viticulture is already apparent, with unexpected pests and diseases as one of the most concerning consequences. Deploying sticky traps on grape plantations to attract key insects has been the backbone of conventional pest management programs. However, they are time-consuming processes for winegrowers, conducted through visual inspection via the manual identification and counting of key insects. Additionally, winegrowers usually lack taxonomy expertise for accurate species identification. This paper explores the usage of deep learning on the edge to identify and quantify pest counts automatically. Different mobile devices were used to acquire a dataset of yellow sticky and delta traps, consisting of 168 images with 8966 key insects manually annotated by experienced taxonomy specialists. Five different deep learning models suitable to run locally on mobile devices were selected, trained, and benchmarked to detect five different insect species. Model-centric, data-centric, and deployment-centric strategies were explored to improve and fine-tune the considered models, where they were tested on low-end and high-end mobile devices. The SSD ResNet50 model proved to be the most suitable architecture for deployment on edge devices, with accuracies per class ranging from 82% to 99%, the F1 score ranging from 58% to 84%, and inference speeds per trap image of 19.4 s and 62.7 s for high-end and low-end smartphones, respectively. These results demonstrate the potential of the approach proposed to be integrated into a mobile-based solution for vineyard pest monitoring by providing automated detection and the counting of key vector insects to winegrowers and taxonomy specialists.
Due to the increasingly alarming consequences of climate change, pests are becoming a growing threat to grape quality and viticulture yields. Estimating the quantity and type of treatments to control these diseases is particularly challenging due to the unpredictability of insects’ dynamics and intrinsic difficulties in performing pest monitoring. Conventional pest monitoring programs consist of deploying sticky traps on vineyards, which attract key insects and allow human operators to identify and count them manually. However, this is a time-consuming process that usually requires in-depth taxonomic knowledge. This scenario motivated the development of EyesOnTraps, a novel AI-powered mobile solution for pest monitoring in viticulture. The methodology behind the development of the proposed system merges multidisciplinary research efforts by specialists from different fields, including informatics, electronics, machine learning, computer vision, human-centered design, agronomy and viticulture. This research work resulted in a decision support tool that allows winegrowers and taxonomy specialists to: (i) ensure the adequacy and quality of mobile-acquired sticky trap images; (ii) provide automated detection and counting of key insects; (iii) register local temperature near traps; and (iv) improve and anticipate treatment recommendations for the detected pests. By merging mobile computing and AI, we believe that broader technology acceptance for pest management in viticulture can be achieved via solutions that work on regular sticky traps and avoid the need for proprietary instrumented traps.
Quality control procedures in the manufacturing of tableware ceramics require a demanding, monotonous, subjective, and faulty human manual inspection. This paper presents two machine learning strategies and the results of a semi-automated visual inspection of ceramics tableware applied to a private dataset acquired during the VAICeramics project. In one method, an anomaly detection step was integrated to pre-select possible defective patches before passing through an object detector and defects classifier. In the alternative one, all patches are directly provided to the object detector and then go through the classification phase. Contrary to expectations, the inclusion of the anomaly detector demonstrated a slight reduction in the performance of the pipeline, which may result from error propagation. Regarding the proposed methodology for defect detection, it exhibits average performance in monochromatic images with more than 600 real defects in total, efficiently identifying the most common defect classes in highly reflective surfaces. However, when applied to newly acquired images, the pipeline encounters challenges revealing a lack of generalization ability and experiencing limitations in detecting specific defect classes, due to their appearance and limited available samples used for training. Only two defect types presented high classification performance, namely Dots and Cracked defects.