A new crack detection approach based on local binary patterns (LBP) with support vector machine (SVM) was proposed in this paper. The propsed algorithm can extract the LBP feature from each frame of the video taken from the road. Then, the dimension of the LBP feature spaces can be reduced by Principal Component Analysis(PCA). The simplified samples are trained to be decided the type of crack using Support Vector Machine(SVM). In order to reflect the directional imformation in detail, the LBP processed image is devided into nine sub-blocks. In this paper, driving tests were performed 10 times and 12,000 image data were applied to the proposed algorithm. The average accuracy of the proposed algorithm with sub-blocks is 91.91%, which is about 6.6% higher than the algorithm without sub-blocks. The LBP-PCA with SVM applying sub-blocks reflects the directional information of the crack so that it has high accuracy of 89.41% and 88.24%, especially in transverse and longitudinal cracks. In the performance analysis of different crack classifiers, the F-Measure, which considered balance between the precision and the recall, of alligator cracks classifier was the highest at 0.7601 and hence crack detection performance is higher than others.
Automatic damage detection using deep learning warrants an extensive data source that captures complex pavement conditions. This paper proposes a thermal-RGB fusion image-based pavement damage detection model, wherein the fused RGB-thermal image is formed through multi-source sensor information to achieve fast and accurate defect detection including complex pavement conditions. The proposed method uses pre-trained EfficientNet B4 as the backbone architecture and generates an argument dataset (containing non-uniform illumination, camera noise, and scales of thermal images too) to achieve high pavement damage detection accuracy. This paper tests separately the performance of different input data (RGB, thermal, MSX, and fused image) to test the influence of input data and network on the detection results. The results proved that the fused image’s damage detection accuracy can be as high as 98.34% and by using the dataset after augmentation, the detection model deems to be more stable to achieve 98.35% precision, 98.34% recall, and 98.34% F1-score.
2 October 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their restricted receptive fields, while ViTs face challenges due to their quadratic complexity. Recently, the Mamba model, featuring linear complexity and a global receptive field, has gained extensive attention for vision tasks. In such tasks, images need to be serialized to form sequences compatible with the Mamba model. Numerous research efforts have explored scanning strategies to serialize images, aiming to enhance the Mamba model's understanding of images. However, the effectiveness of these scanning strategies remains uncertain. In this research, we conduct a comprehensive experimental investigation on the impact of mainstream scanning directions and their combinations on semantic segmentation of remotely sensed images. Through extensive experiments on the LoveDA, ISPRS Potsdam, ISPRS Vaihingen, and UAVid datasets, we demonstrate that no single scanning strategy outperforms others, regardless of their complexity or the number of scanning directions involved. A simple, single scanning direction is deemed sufficient for semantic segmentation of high-resolution remotely sensed images. Relevant directions for future research are also recommended.
15 January 2022 in Signal, Image and Video Processing
In this paper, a potential crack region method is proposed to detect road pavement cracks by using the adaptive threshold. To reduce the noises of the image, the pre-treatment algorithm was applied according to the following steps: grayscale processing, histogram equalization, filtering traffic lane. From the image segmentation methods, the algorithm combines the global threshold and the local threshold to segment the image. According to the grayscale distribution characteristics of the crack image, the sliding window is used to obtain the window deviation, and then, the deviation image is segmented based on the maximum inter-class deviation. Obtain a potential crack region and then perform a local threshold-based segmentation algorithm. Real images of pavement surface were used at the Su Tong Li road in Suzhou, China. It was found that the proposed approach could give a more explicit description of pavement cracks in images. The method was tested on 509 images of the German asphalt pavement distress (Gap) dataset: The test results were found to be promising (precision = 0.82, recall = 0.81, F1 score = 0.83).
24 June 2021 in International Journal of Pavement Engineering
This paper proposes a novel pavement transverse crack detection model based on time–frequency analysis and convolutional neural networks. The accelerometer and smartphone installed in the vehicle collect the vibration response between the wheel and the road, such as pavement transverse cracks, manholes, and normal pavement. Since the original vibration signal can only contain a one-dimensional domain (time–acceleration). Time–frequency analysis, including Short-Time Fourier Transform and Wavelet Transform, can transfer the one-dimensional vibration signal into a two-dimensional time–frequency-energy spectrum matrix. The energy spectrum matrix obtained from STFT and WT can effectively obtain different signal features in terms of time and frequency features. If STFT and WT are further combined with CNN models, STFT-CNN and WT-CNN, respectively, pavement transverse cracks can be detected more accurately. In this study, the reliability of the developed pavement transverse cracks detection model was evaluated based on the data collected by conducting a road driving test. Analysis results of the developed model show that the accuracies of WT-CNN and STFT-CNN are 97.2% and 91.4%, respectively. The F1 scores to analyse the practicability and the adaptability of the crack detection model of WT-CNN and STFT-CNN are 96.35% and 89.56%, respectively.
In the era of the first Industrial Revolution, many buildings were built with red bricks, and the heritage buildings built at that time are more than 100 years old. In these old heritage buildings, damage is bound to occur due to chemical and physical effects. Technologies such as automatic damage detection can effectively manage damage, but they can be affected by other categories present in heritage buildings. Therefore, this paper proposes a CNN algorithm that can automatically detect cracks and damage that occur in heritage buildings, as well as multi-label classification, such as doors, windows, arches, artwork, brick walls, stonewalls, and vents. A total of 2400 thermal infrared images are collected for 8 categories and automatic classification was performed using the CNN algorithm. The average precision and average sensitivity for the eight categories of heritage buildings are 97.72% and 97.43%, respectively. This paper defines the causes of misclassification as the following two causes: misclassification by multiple objects and misclassification by the perception of the CNN algorithm.