20 April 2020 in IEEE Access
The accurate detection of cracks in paintings, which generally portray rich and varying content, is a challenging task. Traditional crack detection methods are often lacking on recent acquisitions of paintings as they are poorly adapted to high-resolutions and do not make use of the other imaging modalities often at hand. Furthermore, many paintings portray a complex or cluttered composition, significantly complicating a precise detection of cracks when using only photographic material. In this paper, we propose a fast crack detection algorithm based on deep convolutional neural networks (CNN) that is capable of combining several imaging modalities, such as regular photographs, infrared photography and X-Ray images. Moreover, we propose an efficient solution to improve the CNN-based localization of the actual crack boundaries and extend the CNN architecture such that areas where it makes little sense to run expensive learning models are ignored. This allows us to process large resolution scans of paintings more efficiently. The proposed on-line method is capable of continuously learning from newly acquired visual data, thus further improving classification results as more data becomes available. A case study on multimodal acquisitions of the Ghent Altarpiece, taken during the currently ongoing conservation-restoration treatment, shows improvements over the state-of-the-art in crack detection methods and demonstrates the potential of our proposed method in assisting art conservators.
31 October 2017 in MATEC Web of Conferences
In this paper, we consider a method for defects detection in a video sequence, which consists of three main steps; frame compensation, preprocessing by a detector, which is base on the ranking of pixel values, and the classification of all pixels having anomalous values using convolutional neural networks. The effectiveness of the proposed method shown in comparison with the known techniques on several frames of the video sequence with damaged in natural conditions. The analysis of the obtained results indicates the high efficiency of the proposed method. The additional use of machine learning as postprocessing significantly reduce the likelihood of false alarm.
1 July 2022 in Journal of Electronic Imaging
Cracks (craquelure) and paint losses are the main types of deterioration of master paintings as they are ageing. We explore the potential of deep-learning-based methods for virtual restoration of paintings focusing on crack detection and their digital inpainting. For the crack detection stage, we develop a model that combines the benefits of multimodal convolutional (MCN) and autoencoder neural networks based on U-Net. The proposed model, dubbed U-Net multimodal convolutional, proves to outperform both MCN and U-Net architectures as well as the benchmark machine learning models for multimodal crack detection, both visually and in terms of objective performance measures. The second stage in our virtual restoration framework, the digital crack inpainting, is an adaptive adversarial network. The obtained virtual restoration results show clear improvement in comparison with the reference methods in this domain. Also, we propose an original way of training an adversarial neural network, which allows us to apply it more successfully in practice. A series of experiments shows encouraging results compared to the current state-of-the-art and confirms the huge potential of deep learning in crack detection and virtual restoration of master paintings.
1 November 2019 in IOP Conference Series: Materials Science and Engineering
In this paper proposed a system for automatic defects detection in images. The solution to this problem is widely used in practice. Automatic detection is found in the challenge of detecting defects on the road surface, in the textile industry, as well as virtual restoration of archival photo images. The solution to this range of problems allows speeding up work in these areas, and in some cases, completely solving. To solve the first two problems (search for defects on the pavement and textiles), it is enough to create a mask that localizes defects in the image with maximum reliability, while photo restoration requires additional algorithms to restore the detected damaged areas. The proposed method is based on the latest achievements in the field of machine learning and allows solve the main disadvantages of traditional methods. Automatic defect detection is performed using a neural network with compound descriptor. A series of experiments confirmed the high efficiency of the proposed method in comparison with traditional methods for detecting defects.