Detection and identification of macroplastic debris in aquatic environments is crucial to understand and counter the growing emergence and current developments in distribution and deposition of macroplastics. In this context, close-range remote sensing approaches revealing spatial and spectral properties of macroplastics are very beneficial. To date, field surveys and visual census approaches are broadly acknowledged methods to acquire information, but since 2018 techniques based on remote sensing and artificial intelligence are advancing. Despite their proven efficiency, speed and wide applicability, there are still obstacles to overcome, especially when looking at the availability and accessibility of data. Thus, our review summarizes state-of-the-art research about the visual recognition and identification of different sorts of macroplastics. The focus is on both data acquisition techniques and evaluation methods, including Machine Learning and Deep Learning, but resulting products and published data will also be taken into account. Our aim is to provide a critical overview and outlook in a time where this research direction is thriving fast. This study shows that most Machine Learning and Deep Learning approaches are still in an infancy state regarding accuracy and detail when compared to visual monitoring, even though their results look very promising.

Riparian zones fulfill diverse ecological and economic functions. Sustainable management requires detailed spatial information about vegetation and hydromorphological properties. In this study, we propose a machine learning classification workflow to map classes of the thematic levels Basic surface types (BA), Vegetation units (VE), Dominant stands (DO) and Substrate types (SU) based on multispectral imagery from an unmanned aerial system (UAS). A case study was carried out in Emmericher Ward on the river Rhine, Germany. The results showed that: (I) In terms of overall accuracy, classification results decreased with increasing detail of classes from BA (88.9%) and VE (88.4%) to DO (74.8%) or SU (62%), respectively. (II) The use of Support Vector Machines and Extreme Gradient Boost algorithms did not increase classification performance in comparison to Random Forest. (III) Based on probability maps, classification performance was lower in areas of shaded vegetation and in the transition zones. (IV) In order to cover larger areas, a gyrocopter can be used applying the same workflow and achieving comparable results as by UAS for thematic levels BA, VE and homogeneous classes covering larger areas. The generated classification maps are a valuable tool for ecologically integrated water management.

Over the Hahnöfer Nebenelbe, a part of the Elbe estuary near Hamburg, Germany, a combined aerial survey with an unmanned aerial system (UAV) and a gyrocopter was conducted to acquire information about the water surface temperatures. The water temperature in the estuary is important for biological processes and living conditions of riverine organisms. This study aimed to develop a workflow that allows for comparing and analysing surface temperatures acquired by two different remote sensing systems. The thermal infrared (TIR) datasets were compared with in situ measurements gathered during the data acquisition, where both TIR datasets showed a varying bias. Potential error sources regarding the absolute and relative accuracy were investigated and modelled based on the available measurements, including emissivity, atmosphere, skin effect at the water surface, camera flat field correction and calibration. The largest effects on the observed TIR water temperature had the camera calibration and the modelled atmospheric effects. After the correction steps, both datasets could be combined to create a multitemporal representation of the temperature pattern and profiles over the survey area’s wadden flats.

The unique vegetation in riparian zones is fundamental for various ecological and socio-economic functions in these transitional areas. Sustainable management requires detailed spatial information about the occurring flora. Here, we present a Deep Learning (DL)-based approach for processing multimodal high-resolution remote sensing data (aerial RGB and near-infrared (NIR) images and elevation maps) to generate a classification map of the tidal Elbe and a section of the Rhine River (Germany). The ground truth was based on existing mappings of vegetation and biotope types. The results showed that (I) despite a large class imbalance, for the tidal Elbe, a high mean Intersection over Union (IoU) of about 78% was reached. (II) At the Rhine River, a lower mean IoU was reached due to the limited amount of training data and labelling errors. Applying transfer learning methods and labelling error correction increased the mean IoU to about 60%. (III) Early fusion of the modalities was beneficial. (IV) The performance benefits from using elevation maps and the NIR channel in addition to RGB images. (V) Model uncertainty was successfully calibrated by using temperature scaling. The generalization ability of the trained model can be improved by adding more data from future aerial surveys.