Remote sensing (RS) plays an important role gathering data in many critical domains (e.g., global climate change, risk assessment and vulnerability reduction of natural hazards, resilience of ecosystems, and urban planning). Retrieving, managing, and analyzing large amounts of RS imagery poses substantial challenges. Google Earth Engine (GEE) provides a scalable, cloud-based, geospatial retrieval and processing platform. GEE also provides access to the vast majority of freely available, public, multi-temporal RS data and offers free cloud-based computational power for geospatial data analysis. Artificial intelligence (AI) methods are a critical enabling technology to automating the interpretation of RS imagery, particularly on object-based domains, so the integration of AI methods into GEE represents a promising path towards operationalizing automated RS-based monitoring programs. In this article, we provide a systematic review of relevant literature to identify recent research that incorporates AI methods in GEE. We then discuss some of the major challenges of integrating GEE and AI and identify several priorities for future research. We developed an interactive web application designed to allow readers to intuitively and dynamically review the publications included in this literature review.
3 September 2018 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Asphalt roads are the basic component of a land transportation system, and the quality of asphalt roads will decrease during the use stage because of the aging and deterioration of the road surface. In the end, some road pavement distresses may appear on the road surface, such as the most common potholes and cracks. In order to improve the efficiency of pavement inspection, currently some new forms of remote sensing data without destructive effect on the pavement are widely used to detect the pavement distresses, such as digital images, light detection and ranging, and radar. Multispectral imagery presenting spatial and spectral features of objects has been widely used in remote sensing application. In our study, the multispectral pavement images acquired by unmanned aerial vehicle (UAV) were used to distinguish between the normal pavement and pavement damages (e.g., cracks and potholes) using machine learning algorithms, such as support vector machine, artificial neural network, and random forest. Comparison of the performance between different data types and models was conducted and is discussed in this study, and indicates that a UAV remote sensing system offers a new tool for monitoring asphalt road pavement condition, which can be used as decision support for road maintenance practice.
Water features (e.g., water quantity and water quality) are one of the most important environmental factors essential to improving climate-change resilience. Remote sensing (RS) technologies empowered by artificial intelligence (AI) have become one of the most demanded strategies to automating water information extraction and thus intelligent monitoring. In this article, we provide a systematic review of the literature that incorporates artificial intelligence and computer vision methods in the water resources sector with a focus on intelligent water body extraction and water quality detection and monitoring through remote sensing. Based on this review, the main challenges of leveraging AI and RS for intelligent water information extraction are discussed, and research priorities are identified. An interactive web application designed to allow readers to intuitively and dynamically review the relevant literature was also developed.
This paper investigates recent research on active learning for (geo) text and image classification, with an emphasis on methods that combine visual analytics and/or deep learning. Deep learning has attracted substantial attention across many domains of science and practice, because it can find intricate patterns in big data; but successful application of the methods requires a big set of labeled data. Active learning, which has the potential to address the data labeling challenge, has already had success in geospatial applications such as trajectory classification from movement data and (geo) text and image classification. This review is intended to be particularly relevant for extension of these methods to GISience, to support work in domains such as geographic information retrieval from text and image repositories, interpretation of spatial language, and related geo-semantics challenges. Specifically, to provide a structure for leveraging recent advances, we group the relevant work into five categories: active learning, visual analytics, active learning with visual analytics, active deep learning, plus GIScience and Remote Sensing (RS) using active learning and active deep learning. Each category is exemplified by recent influential work. Based on this framing and our systematic review of key research, we then discuss some of the main challenges of integrating active learning with visual analytics and deep learning, and point out research opportunities from technical and application perspectives—for application-based opportunities, with emphasis on those that address big data with geospatial components.
Artificial intelligence (AI) and machine learning (ML) have been applied to solve various remote sensing problems. To fully leverage the power of AI and ML to tackle impactful remote sensing problems, it is essential to enable researchers and practitioners to understand how AI and ML models actually work and thus to improve the model performance strategically. Accurate and timely land cover maps are essential components for informed land management decision making. To address the ever-increasing need for high spatial and temporal resolution maps, this paper developed an interactive and open-source online tool, in Python, to help interpret and improve the ML models used for land cover mapping with Google Earth Engine (GEE). The tool integrates the workflow of both land cover classification and land cover change dynamics, which requires the generation of a time series of land cover maps. Three feature importance metrics are reported, including impurity-based, permutation-based, and SHAP (Shapley additive explanations) value-based feature importance. Two case studies are presented to showcase the tool’s capability and ease of use, enabling a globally accessible and free convergent application of remote sensing technologies. This tool may inspire researchers to facilitate explainable AI (XAI)-empowered remote sensing applications with GEE.