12 November 2021 in International Journal of Intelligent Systems
Grayscale image colorization, especially for ethnic costume images, is highly challenging due to its rich and complex color features. The existing image colorization methods usually take the costume image as a whole in practical applications that lead to the ignorance of the semantic information of different parts of the costume. It is known that each part's color distribution of the ethnic costume is different. So, the color mapping of other parts is also diverse, which is determined by distinctive ethnic characteristics. This study introduces fine-grained level semantic information and proposes a high-resolution image colorization model for ethnic costumes targeting enhancement, inspired by semantic-level colorization. The semantic information of different regions of ethnic costumes has a significant impact on the performance of the coloring task. Using Pix2PixHD as the backbone network, we create a new network architecture that maintains color distribution correspondence and spatial consistency of costume images using fine-grained semantic information. In our network, we take the splice result of fine-grained semantic for ethnic costume and grayscale image as the conditions and then feed them into the generative adversarial networks. We also discuss and analyze the influences of the grayscale channel and fine-grained semantics on discriminator. Extensive experiments demonstrate that our method performs well compared with other state-of-the-art automatic colorization methods.
4 February 2022 in International Journal of Intelligent Systems
Clothing attribute prediction is a fundamental image classification task in the field of computer vision. Motivated by the human recognition system, we investigate the task relationship and spatial importance where people usually utilize these useful clues to assist in recognizing clothing attributes. In this paper, we propose a novel Holistic Relation Network (HRNet) for clothing attribute recognition, considering the fusion of multiple relations, including spatial and spatial relation via a spatial relation module, spatial and task relation via a task attention module, and task and task relation via a graph context reasoning module. Specifically, we first use the backbone network to extract features from the input image, two types of attention models followed will further learn the features, then the graph context reasoning module will be used to further enhance the features, and finally, a classifier exploited to classify the clothing attributes with the learned representation information. Without using manual image feature filtering methods, this paper aims to achieve clothing attribute recognition by deeply exploring the relationships among different clothing attribute recognition tasks. In this paper, we use double-branches of the attention model to model the relevance of spatial context information and learn more discriminative feature representations from multitask features for clothing attribute prediction. Derived from the prior knowledge learned from the two above-mentioned attention models, we further propose a graph-relation model constructing relationships among different clothing attribute tasks by integrating the spatial association relationships among multitask. The proposed HRNet only uses image-level annotation but it owns a good ability for obtaining distinguishing feature representations. We obtain state-of-the-art performance, which is demonstrated by extensive experiments on three mainstream benchmarks, for example, woman clothing data set, man clothing data set, and shop-domain clothing data set.