Battery technology is a key component in current electric vehicle applications and an important building block for upcoming smart grid technologies. The performance of batteries depends largely on quality control during their production process. Defects introduced in the production of electrodes can lead to degraded performance and, more importantly, to short circuits in final cells, which is highly safety-critical. In this paper, we propose an inspection system architecture that can detect defects, such as missing coating, agglomerates, and pinholes on coated electrodes. Our system is able to acquire valuable production quality control metrics, like surface roughness. By employing photometric stereo techniques (PS), a shape from shading algorithm, our system surmounts difficulties that arise while optically inspecting the black to dark gray battery coating materials. We present in detail the acquisition concept of the proposed system architecture, and analyze its acquisition-, as well as, its surface reconstruction performance in experiments. We carry these out utilizing two different implementations that can operate at a production speed of up to 2000 mm/s at a resolution of 50 µm per pixel. In this work we aim to provide a system architecture that can provide a reliable contribution to ensuring optimal performance of produced battery cells.
We investigated optimal implementation strategies for industrial inspection systems aiming to detect cracks on ground steel billets’ surfaces by combining state-of-the-art AI-based methods and classical computational imaging techniques. In 2D texture images, the interesting patterns of surface irregularities are often surrounded by visual clutter, which is to be ignored, e.g., grinding patterns. Even neural networks struggle to reliably distinguish between actual surface disruptions and irrelevant background patterns. Consequently, the image acquisition procedure already has to be optimised to the specific application. In our case, we use photometric stereo (PS) imaging to generate 3D surface models of steel billets using multiple illumination units. However, we demonstrate that the neural networks, especially in high-speed scenarios, still suffer from recognition deficiencies when using raw photometric stereo camera data, and are unable to generalise to new billets and image acquisition conditions. Only the additional application of adequate state-of-the-art image processing algorithms guarantees the best results in both aspects. The neural networks benefit when appropriate image acquisition methods together with image processing algorithms emphasise relevant surface structures and reduce overall pattern variation. Our proposed combined strategy shows a 9.25% better detection rate on validation data and is 14.7% better on test data, displaying the best generalisation.
We address the problem of depth-normals fusion under conditions where the input depth map contains holes and the photometric stereo (PS) normals are degraded by modeling and calibration imperfections. To improve depth inpainting within these holes-where reconstruction depends entirely on surface normals-we introduce a joint optimization approach that reconstructs the depth while simultaneously computing a parametric correction for the surface gradients derived from the PS normals. This correction is estimated from pixel locations where reliable depth information is available but is applied globally, ensuring the gradients used for inpainting inside the holes are also corrected. We formulate the correction as the sum of a global polynomial in gradient space and a spatially smooth polynomial in image coordinates, targeting only the low-frequency component of the PS gradients. The resulting bi-convex objective function is solved by alternating between a convex depth reconstruction step and a closed-form least squares update for the correction parameters. We demonstrate the performance of our approach both on real data from our own sensor system and on data derived from the DiLiGenT-MV dataset.
Fast track article for IS&T International Symposium on Electronic Imaging 2020: Intelligent Robotics and Industrial Applications using Computer Vision proceedings.
We address the problem of reconstructing 3D surfaces from depth and surface normal maps acquired by a sensor system based on a single perspective camera. Depth and normal maps can be obtained through techniques such as structured-light scanning and photometric stereo, respectively. We propose a perspective-aware log-depth fusion approach that extends existing orthographic gradient-based depth-normals fusion methods by explicitly accounting for perspective projection, leading to metrically accurate 3D reconstructions. Additionally, the method handles missing depth measurements by leveraging available surface normal information to inpaint gaps. Experiments on the DiLiGenT-MV data set demonstrate the effectiveness of our approach and highlight the importance of perspective-aware depth-normals fusion.