Although lidar is a powerful active remote sensing technology, lidar echo signals are easily contaminated by noise, particularly in strong background light, which severely affects the retrieval accuracy and the effective detection range of the lidar system. In this study, a coupled variational mode decomposition (VMD) and whale optimization algorithm (WOA) for noise reduction in lidar signals is proposed and demonstrated completely. The combination of optimal VMD parameters of decomposition mode number K and quadratic penalty α was obtained by using the WOA and was critical in acquiring satisfactory analysis results for VMD denoising technology. Then, the Bhattacharyya distance was applied to identify the relevant modes, which were reconstructed to achieve noise filtering. Simulation results show that the performance of the proposed VMD-WOA method is superior to that of wavelet transform, empirical mode decomposition, and its variations. Experimentally, this method was successfully used to filter a lidar echo signal. The signal-to-noise ratio of the denoised signal was increased to 23.92 dB, and the detection range was extended from 6 to 10 km.
Reliable estimation of the atmospheric boundary layer height (ABLH) is critical for a range of meteorological applications, including air quality assessment and weather forecasting. Several algorithms have been proposed to detect ABLH from aerosol LiDAR backscatter data. However, most of these focus on cloud-free conditions or use other ancillary instruments due to strong interference from clouds or residual layer aerosols. In this paper, a machine learning method named the Mahalanobis transform K-near-means (MKnm) algorithm is first proposed to derive ABLH under complex atmospheric conditions using only LiDAR-based instruments. It was applied to the micro pulse LiDAR data obtained at the Southern Great Plains site of the Atmospheric Radiation Measurement (ARM) program. The diurnal cycles of ABLH from cloudy weather were detected by using the gradient method (GM), wavelet covariance transform method (WM), K-means, and MKnm. Meanwhile, the ABLH obtained by these four methods under cloud or residual layer conditions based on micropulse LiDAR data were compared with the reference height retrieved from radiosonde data. The results show that MKnm was good at tracking the diurnal variation of ABLH, and the ABLHs obtained by it have remarkable correlation coefficients and smaller mean absolute error and mean deviation with the radiosonde-derived ABLHs than those measured by other three methods. We conclude that MKnm is a promising algorithm to estimate ABLH under cloud or residual layer conditions.
1 December 2020 in Journal of Quantitative Spectroscopy and Radiative Transfer
The signal-to-noise ratio of lidar signals decreases rapidly with an increase in distance, which seriously affects the application of lidar detection technology. Variational mode decomposition (VMD) has performed optimality in dealing with noise, but the number of modes, $K$ , and the penalty parameter, $\alpha $ , must be preset. Therefore, a novel lidar signal denoising method that combines VMD with machine learning online optimization (MLOO) and the interval thresholding (IT) technique, named VMD-MLOO-IT, is proposed in this article. The proposed method defines new fitness functions to evaluate the result of VMD-based denoising, and selects the optimal parameters by the model which development by MLOO. In addition, IT is used to deal with the recovered signal. The experimental results demonstrate the superiority of the presented method over the other empirical mode decomposition-based and VMD-based denoising methods.
The echo signal of light detection and ranging (LiDAR) system is easily disturbed by various noises under the influence of intense background light. The signal to noise ratio (SNR) decreases with increasing distance, which seriously affects the retrieval accuracy of the LiDAR system. This paper combines local mean decomposition and an improved thresholding method (LMD-ITM) to process the Lidar signal with a lot of noise, so as to avoid the loss of useful information. In this research, the correlation coefficient and energy entropy are used to distinguish between the relevant and irrelevant components decomposed by the local mean decomposition. Subsequently, the improved thresholding method is applied to process the irrelevant components. It can extract the effective signals which are difficult to be separated from the high-frequency signals. Finally, all components are reconstructed to get the denoising signal. The experimental results demonstrate that this method can effectively avoid the short-range migration, suppress the long-range noise, and adapt to different weather conditions. Compared with the previous denoising method, the proposed method increases the SNR by about 15%.