Most existing sewer pipeline condition assessment methods determine the presence and types of faults via examination of videos, which is a time-consuming and labor-intensive process. A few automatic methods based on image processing techniques can be used to detect specific faults. However, these methods have limitations due to the presence of unpredictable sewer pipeline fault patterns. Deep learning methods have also been applied to sewer pipeline fault detection. However, these methods require a large amount of annotated data to obtain reliable results. In this paper, we propose a fault detection method that applies unsupervised machine learning based anomaly detection algorithms with feature extraction to videos recorded by new sewer pipeline visual inspection equipment. The recorded videos are regarded as sequence signals, which are converted into feature vectors, followed by application of an anomaly detection algorithm. Unlike existing methods, the proposed method is computationally efficient as it does not require an annotated fault sample database for training fault detection models. We evaluate various anomaly detection algorithms and feature combinations on real sewer pipeline data collected in Shenzhen, with an overall accuracy result of above 90%. The proposed method provides a new and fast technique for surveying urban sewer pipelines, and to facilitate further research in this area, we have made the code and data used in this paper publicly available.
7 July 2021 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Cloud removal in optical remote sensing imagery is essential for many Earth observation applications. To recover the cloud obscured information, some preconditions must be satisfied. For example, the cloud must be semitransparent or relationships between contaminated and cloud-free pixels must be assumed. Due to the inherent imaging geometry features in satellite remote sensing, it is impossible to observe the ground under the clouds directly; therefore, cloud removal algorithms are always not perfect owing to the loss of ground truth. Recently, the use of passenger aircraft as a platform for remote sensing has been proposed by some researchers and institutes, including Airbus and the Japan Aerospace Exploration Agency. Passenger aircraft have the advantages of short visitation frequency and low cost. Additionally, because passenger aircraft fly at lower altitudes compared to satellites, they can observe the ground under the clouds at an oblique viewing angle. In this study, we examine the possibility of creating cloud-free remote sensing data by stacking multiangle images captured by passenger aircraft. To accomplish this, a processing framework is proposed, which includes four main steps: first, multiangle image acquisition from passenger aircraft, second, cloud detection based on deep learning semantic segmentation models, third, cloud removal by image stacking, and fourth, image quality enhancement via haze removal. This method is intended to remove cloud contamination without the requirements of reference images and predetermination of cloud types. The proposed method was tested in multiple case studies, wherein the resultant cloud- and haze-free orthophotos were visualized and quantitatively analyzed in various land cover type scenes. The results of the case studies demonstrated that the proposed method could generate high quality, cloud-free orthophotos. Therefore, we conclude that this framework has great potential for creating cloud-free remote sensing images when the cloud removal of satellite imagery is difficult or inaccurate.