Computational image aesthetic evaluation is a computable human aesthetic perception and judgment realized by machines, which has a significant impact on a variety of applications such as image advanced search and promotional exhibition of painting arts. Various approaches have been proposed in copious literature trying to solve this challenging problem. However, there have been few attempts in reviewing works from different types of visual arts, due to their significant differences in visual features and aesthetic principles. In this survey, we present a comprehensive listing of the reviewed works on aesthetic assessment of photographs and paintings, mainly highlighting the contributions and innovations of the existing approaches. We firstly introduce aesthetic assessment benchmark datasets in different categories. Then, conventional aesthetic evaluation approaches based on handcrafted features are reviewed. Besides, we systematically evaluate recent deep learning techniques that are useful for developing robust models for aesthetic prediction tasks in scoring, distribution, attribute, and description. Moreover, the possibility of aesthetic-aware color enhancement, recomposition of photo images, and automatic generation of aesthetic-guided art paintings through computational approaches are summarized. Finally, challenges and potential future directions for this field are discussed. We hope that our survey could serve as a comprehensive reference source for future research on computational aesthetics in visual media.
Assessing the aesthetic appeal of artworks has become an active research direction recently. However, previous works mainly focus on photographs and oil paintings, there have been few attempts in predicting aesthetics of Chinese ink paintings, due to their significant differences in visual features, semantic features, and aesthetic principles. Aiming at this problem, we propose a comprehensive framework, named Inkthetics, to quantify aesthetics of Chinese ink paintings based on deep learning. Firstly, an aesthetic assessment dataset is built for Chinese ink painting images. Secondly, a deep multi-view parallel convolutional neural network (DMVCNN) is designed by extracting global attribute images and multi-patches as inputs to jointly learn aesthetic features. Finally, we build a comprehensive aesthetic evaluation model by fusing the deeply-learned features with handcrafted features that rely on art expert knowledge. Experimental results show that our proposed deep network significantly outperforms existing methods on the dataset, and our proposed model can predict human aesthetic judgment with Pearson highly significant correlation of 0.843, which indicates an improvement up to 5.7% than the DMVCNN model when the handcrafted features are fused with activation from DMVCNN. Our work not only provides a deep-learning-based reference framework for computational aesthetic evaluation of Chinese paintings, but also explores to what extent can handcrafted features aid learning-based features in predicting human aesthetic perceptions.
1 January 2003 in Journal of Computer Science and Technology
Computational aesthetics, which bridges science and art, is emerging as a new interdisciplinary field. This paper concentrates on two main aspects of computational aesthetics: aesthetic measurement and quantification, generative art, and then proposes a design generation framework. On aesthetic measurement and quantification, we review different types of features used in measurement, the currently used evaluation methods, and their applications. On generative art, we focus on both fractal art and abstract paintings modeled on well-known artists’ styles. In general, computational aesthetics exploits computational methods for aesthetic expressions. In other words, it enables computer to appraise beauty and ugliness and also automatically generate aesthetic images. Computational aesthetics has been widely applied to many areas, such as photography, fine art, Chinese hand-writing, web design, graphic design, and industrial design. We finally propose a design generation methodology, utilizing techniques from both aesthetic measurements and generative art.
Recoloring 3D models is a challenging task that often requires professional knowledge and tedious manual efforts. In this article, we present the first deep-learning framework for exemplar-based 3D model recolor, which can automatically transfer the colors from a reference image to the 3D model texture. Our framework consists of two modules to solve two major challenges in the 3D color transfer. First, we propose a new feed-forward Color Transfer Network to achieve high-quality semantic-level color transfer by finding dense semantic correspondences between images. Second, considering 3D model constraints such as UV mapping, we design a novel 3D Texture Optimization Module which can generate a seamless and coherent texture by combining color transferred results rendered in multiple views. Experiments show that our method performs robustly and generalizes well to various kinds of models.