Total focus method (TFM) is an ultrasonic phased array imaging method and has a larger dynamic focusing range and higher spatial resolution than traditional imaging methods. But TFM needs to process a large amount of data, resulting in a long imaging time, which greatly limits its application and development in the industrial field. The sparse method can improve the computing efficiency by reducing the amount of data, but the resolution and intensity of sparse image are very low. This paper proposes a virtual source sparse TFM (VSSTFM) method based on phase coherent weighting (PCW) to improve the spatial resolution and intensity of the sparse TFM imaging. The layout of virtual sources in the virtual source array is designed and optimized by genetic algorithm. According to the phase distribution characteristics of the ultrasonic testing signal, a phase coherence factor is constructed to weight the VSSTFM image to further improve the image quality. Experimental results show that compared with conventional TFM, the proposed method can improve the imaging efficiency by 66.56 % while providing significantly higher image quality than TFM imaging.
The binocular stereo matching method based on deep learning has limited cross-domain generalization ability, and it is a tricky problem to obtain a large amount of data from real scenes for training. The most advanced stereo matching network is difficult to apply to new real scenes. In this paper, we propose a real-scene stereo matching method based on a convolutional neural network and computer graphics. A virtual binocular imaging system is constructed by introducing graphics software, and a high-quality semi-synthetic dataset close to the texture characteristics of the real scene is constructed for training the network. A feature standardization layer is embedded in the feature extraction module of the proposed network to further reduce the feature space difference between semi-synthetic data and real scene data. Three small 4D cost volumes are constructed to replace one large 4D cost volume, which reduces GPU memory consumption and improves the matching performance of the network. The experimental results show that compared with the traditional stereo matching method, the matching accuracy of the proposed method is significantly improved by about 60%. Compared with other learning-based methods, the matching accuracy is increased by about 30%, the matching speed is increased by 38%, and it has good robustness to the interference of defocus blur and Gaussian noise.
14 July 2023 in IEEE Transactions on Geoscience and Remote Sensing
Studies on three-dimension change detection (3DCD) become a research hotspot with the development of 3D sensors. However, most of 3D change detection works are focused on remote sensing data. In the field of street level 3D data, the related works are under investigation. The two main challenges are the lack of point-wise annotated datasets and universal detection framework. In this paper, we proposed an end-to-end point-based network named 3DCDNet and a new dataset named street level point cloud change detection (SLPCCD) dataset to deliver street level 3DCD task. To structure the proposed 3DCDNet, a local feature aggregation (LFA) module and a nearest feature difference module (NFD) are introduced. The LFA is capable of extracting point features and aggregating local information, which is an effective neural module for embedding point cloud features. By stacking multiple of LFA blocks, the proposed network can be good at establishing relationships between different points and embedding semantically rich features. Different from the change detection in images, another crucial point in 3DCD is how to identify changes since point clouds are unstructured data. In order to deliver this challenge, the NFD module is introduced to identify change results using nearest query operation. Extensive experiments were implemented on the manually annotated SLPCCD dataset as well as another benchmark called Urb3DCD to validate the effectiveness and efficiency of the introduced network. It demonstrates that the proposed network outperforms popular existing approaches. The source code and the annotated dataset are available at: https://github.com/wangle53/3DCDNet.
6 September 2024 in Journal of Nondestructive Evaluation
The detection capability of deep learning-based stereo matching in industrial applications is inherently limited due to challenges posed by weak texture and inconsistent reflectance, making it difficult to accurately recover complex surface details. To achieve accurate measurements, this paper presents an end-to-end speckle stereo matching network that incorporates fringe, Gray code, and speckle projection patterns. The model is trained using a high-precision dataset consisting of thousands of pairs generated through binocular Gray code-assisted phase shifting. After establishing local correspondences between the left and right images using speckle patterns, the images are used as inputs to the network. The proposed network consists of two siamese 2D feature extraction networks. One network is dedicated to cost volume computation, while the other focuses on weight refinement feature extraction. The former network incorporates a lightweight module for extracting high-dimensional fusion features. These features are obtained from different dilation scales and randomly concatenated along the channel dimension. Patch convolution is utilized to effectively adapt to pixel features at various levels, reducing redundancy within the cost volume and improving the network’s capacity to learn from ill-posed regions. Experimental results demonstrate that the proposed network achieves a significant improvement of approximately 10.7% in matching accuracy compared to state-of-the-art networks on public datasets. Furthermore, this method exhibits outstanding matching results when applied to diverse industrial scenarios. The reconstruction error for the radius of optical standard spheres is below 0.06-mm, which meets the demands of the majority of industrial applications.
Optical 3D measurement technology has the advantages of being noncontact, having high precision and fast speed, and being applicable to static and dynamic measurements; it is widely used in fields such as machine vision, industrial inspection, biometrics, and reverse engineering.1–4 Binocular vision and structured light are important methods of optical 3D measurement technology.