Accuracy metrics have been widely used for the evaluation of predictions in machine learning. However, the selection of an appropriate accuracy metric for the evaluation of a specific prediction has not yet been specified. In this study, seven of the most used accuracy metrics in machine learning were summarized, and both their advantages and disadvantages were studied. To achieve this, the acoustic emission data of damage locations were collected from a pile hit test. A backpropagation artificial neural network prediction model for damage locations was trained with acoustic emission data using six different training algorithms, and the prediction accuracies of six algorithms were evaluated using seven different accuracy metrics. Test results showed that the training algorithm of “TRAINGLM” exhibited the best performance for predicting damage locations in deep piles. Subsequently, the artificial neural networks were trained using three different datasets collected from three acoustic emission sensor groups, and the prediction accuracies of three models were evaluated with the seven different accuracy metrics. The test results showed that the dataset collected from the pile body-installed sensors group exhibited the highest accuracy for predicting damage locations in deep piles. Subsequently, the correlations between the seven accuracy metrics and the sensitivity of each accuracy metrics were discussed based on the analysis results. Eventually, a novel selection method for an appropriate accuracy metric to evaluate the accuracy of specific predictions was proposed. This novel method is useful to select an appropriate accuracy metric for wide predictions, especially in the engineering field.
The lining crack is common for the tunnel in the stage of operation, which has seriously influenced the service life and safety of tunnel engineering. It is a new trend to use computer vision to detect tunnel cracks over the past few years in China and foreign countries. By image processing technology and intelligent algorithm, the computer has a hominine visual perception system which understands, analyzes, and determines input image information, thus recognizing and detecting specific objectives. However, the effect of image recognition for tunnel crack now cannot satisfy the demands of practical engineering. SSD algorithm has been used when analyzing features of lining surface image, while comparison analysis has been made from image recognition results, error rate, and running time. The results indicate that the SSD algorithm can accurately and rapidly detect and mark the position of the tunnel crack. The tunnel information obtained from image recognition is subsequently imported into the team independently developed software GeoSMA‐3D, which is useful for determining tunnel grade.
2 January 2021 in Geomechanics and Geophysics for Geo-Energy and Geo-Resources