The paper addresses the generalization of the half-quadratic minimization method for the restoration of images having values in a complete, connected Riemannian manifold. We recall the half-quadratic minimization method using the notation of the $c$-transform and adapt the algorithm to our special variational setting. We prove the convergence of the method for Hadamard spaces. Extensive numerical examples for images with values on spheres, in the rotation group $SO(3)$, and in the manifold of positive definite matrices demonstrate the excellent performance of the algorithm. In particular, the method with $SO(3)$-valued data shows promising results for the restoration of images obtained from Electron Backscattered Diffraction which are of interest in material science.
13 August 2018 in Journal of Mathematical Imaging and Vision
Colorization of gray-scale images relies on prior color information. Exemplar-based methods use a color image as source of such information. Then the colors of the source image are transferred to the gray-scale target image. In the literature, this transfer is mainly guided by texture descriptors. Face images usually contain few texture so that the common approaches frequently fail. In this paper, we propose a new method taking the geometric structure of the images rather their texture into account such that it is more reliable for faces. Our approach is based on image morphing and relies on the YUV color space. First, a correspondence mapping between the luminance Y channel of the color source image and the gray-scale target image is computed. This mapping is based on the time discrete metamorphosis model suggested by Berkels, Effland and Rumpf. We provide a new finite difference approach for the numerical computation of the mapping. Then, the chrominance U,V channels of the source image are transferred via this correspondence map to the target image. A possible postprocessing step by a variational model is developed to further improve the results. To keep the contrast special attention is paid to make the postprocessing unbiased. Our numerical experiments show that our morphing based approach clearly outperforms state-of-the-art methods.
Recently variational models with priors involving first and second order derivatives resp. differences were successfully applied for image restoration. There are several ways to incorporate the derivatives of first and second order into the prior, for example additive coupling or using infimal convolution (IC), as well as the more general model of total generalized variation (TGV). The later two methods give also decompositions of the restored images into image components with distinct "smoothness" properties which are useful in applications. This paper is the first attempt to generalize these models to manifold-valued images. We propose both extrinsic and intrinsic approaches. The extrinsic approach is based on embedding the manifold into an Euclidean space of higher dimension. Models following this approach can be formulated within the Euclidean space with a constraint restricting them to the manifold. Then alternating direction methods of multipliers can be employed for finding minima. However, the components within the infimal convolution or total generalized variation decomposition live in the embedding space rather than on the manifold which makes their interpretation difficult. Therefore we also investigate two intrinsic approaches. For manifolds which are Lie groups we propose three priors which exploit the group operation, an additive one, another with IC coupling and a third TGV like one. For computing the minimizers of the intrinsic models we apply gradient descent algorithms. For general Riemannian manifolds we further define a model for infimal convolution based on the recently developed second order differences. We demonstrate by numerical examples that our approaches works well for the circle, the 2-sphere, the rotation group, and the manifold of positive definite matrices with the affine invariant metric.
The paper addresses the generalization of the half-quadratic minimization method for the restoration of images having values in a complete Riemannian manifold. We recall the half-quadratic minimization method using the notation of the c-transform and adapt the algorithm to our special variational setting. We prove the convergence of the method for Hadamard spaces. Extensive numerical examples for images with values on spheres, in the rotation group SO(3) and in the manifold of positive definite matrices demonstrate the excellent performance of the algorithm. In particular, the method with SO(3)-valued data shows promising results for the restoration of images obtained from Electron Backscattered Diffraction which are of interest in material science.