Existing general image inpainting works require the user to customize a mask to indicate the region to be inpainted. However, the mask is often hard to calibrate accurately in real-world applications, e.g., graffiti removal. Blind image inpainting aims to automatically restore the degraded image into the visually reasonable one without a priori mask to indicate the area to be repaired. So far, most proposed blind inpainting methods convert the task into general inpainting by predicting the mask before inpainting. However, these methods are highly dependent on mask prediction results, which may produce inferior inpainting results if the prediction is inaccurate. To address this issue, we propose a two-stage blind inpainting framework with two novel designs: (1) cross-space contrastive learning, to remove the noise in the degraded images and realize the automatic inpainting in the latent space by reducing the distance of the degraded images and the corresponding complete images in the latent space; and (2) mask-aware adversarial training, to minimize the mutual information between the inpainted feature and the noise. Extensive experiments prove that our blind inpainting framework performs better on multiple datasets than the state-of-the-art methods.
To address the limitations of existing optimization-based 3D style transfer methods in terms of visual quality, 3D consistency, and real-time rendering performance, we propose a novel 3D Gaussian scene style transfer method based on 2D priors and iterative optimization. Our approach introduces a progressive training pipeline that alternates between fine-tuning the 3D Gaussian field and updating a set of supervised stylized images. By gradually injecting style information into the 3D scene through iterative refinement, the method effectively preserves the geometric structure and spatial coherence across viewpoints. Furthermore, we incorporated a pre-trained stable diffusion model as a 2D prior to guide the style adaptation of the 3D Gaussian representation. The combination of diffusion priors and differentiable 3D Gaussian rendering enables high-fidelity style transfer while maintaining real-time rendering capability. Extensive experiments demonstrate that our method significantly improves the visual quality and multi-view consistency of 3D stylized scenes, offering an effective and efficient solution for real-time 3D scene stylization.
Collecting a large-scale and well-annotated dataset for image processing has become a common practice in computer vision. However, in the ancient painting area, this task is not practical as the number of paintings is limited and their style is greatly diverse. We, therefore, propose a novel solution for the problems that come with ancient painting processing. This is to use domain transfer to convert ancient paintings to photo-realistic natural images. By doing so, the ancient painting processing problems become natural image processing problems and models trained on natural images can be directly applied to the transferred paintings. Specifically, we focus on Chinese ancient flower, bird and landscape paintings in this work. A novel Domain Style Transfer Network (DSTN) is proposed to transfer ancient paintings to natural images which employ a compound loss to ensure that the transferred paintings still maintain the color composition and content of the input paintings. The experiment results show that the transferred paintings generated by the DSTN have a better performance in both the human perceptual test and other image processing tasks than other state-of-art methods, indicating the authenticity of the transferred paintings and the superiority of the proposed method.