Facial beauty prediction (FBP) has become an emerging area in the field of artificial intelligence. However, the lacks of data and accurate face representation hinder the development of FBP. Multi-task transfer learning can effectively avoid over-fitting, and utilize auxiliary information of related tasks to optimize the main task. In this paper, we present a network named Multi-input Multi-task Beauty Network (2M BeautyNet) and use transfer learning to predict facial beauty. In the experiment, beauty prediction is the main task, and gender recognition is the auxiliary. For multi-task training, we employ multi-task loss weights automatic learning strategy to improve the performance of FBP. Finally, we replace the softmax classifier with a random forest. We conduct experiments on the Large Scale Facial Beauty Database (LSFBD) and SCUT-FBP5500 database. Results show that our method has achieved good results on LSFBD, the accuracy of FBP is up to 68.23%. Our 2M BeautyNet structure is suitable for multiple inputs of different databases.

Owing to the complexity of finger vein patterns in shape and spatial dependence, the existing methods suffer from an inability to obtain accurate and stable finger vein features. This paper, so as to compensate this defect, proposes an end-to-end model to extract vein textures through integrating the fully convolutional neural network (FCN) with conditional random field (CRF). Firstly, to reduce missing pixels during ROI extraction, the method of sliding window summation is employed to filter and adjusted with self-built tools. In addition, the traditional baselines are endowed with different weights to automatically assign labels. Secondly, the deformable convolution network, through replacing the plain counterparts in the standard U-Net mode, can capture the complex venous structural features by adaptively adjusting the receptive fields according to veins’ scales and shapes. Moreover, the above features can be further mined and accumulated by combining the recurrent neural network (RNN) and the residual network (ResNet). With the steps mentioned above, the fully convolutional neural network is constructed. Finally, the CRF with Gaussian pairwise potential conducts mean-field approximate inference as the RNN, and then is embedded as a part of the FCN, so that the model can fully integrate CRF with FCNs, which provides the possibility to involve the usual back-propagation algorithm in training the whole deep network end-to-end. The proposed models in this paper were tested on three public finger vein datasets SDUMLA, MMCBNU and HKPU with experimental results to certify their superior performance on finger-vein verification tasks compared with other equivalent models including U-Net.

Face recognition (FR) with single sample per person (SSPP) is a challenge in computer vision. Since there is only one sample to be trained, it makes facial variation such as pose, illumination, and disguise difficult to be predicted. To overcome this problem, this paper proposes a scheme combined traditional and deep learning (TDL) method to process the task. First, it proposes an expanding sample method based on traditional approach. Compared with other expanding sample methods, the method can be used easily and conveniently. Besides, it can generate samples such as disguise, expression, and mixed variation. Second, it uses transfer learning and introduces a well-trained deep convolutional neural network (DCNN) model and then selects some expanding samples to fine-tune the DCNN model. Third, the fine-tuned model is used to implement experiment. Experimental results on AR face database, Extend Yale B face database, FERET face database, and LFW database demonstrate that TDL achieves the state-of-the-art performance in SSPP FR.

Because of the lack of discriminative face representations and scarcity of labeled training data, facial beauty prediction (FBP), which aims at assessing facial attractiveness automatically, has become a challenging pattern recognition problem. Inspired by recent promising work on fine-grained image classification using the multiscale architecture to extend the diversity of deep features, BeautyNet for unconstrained facial beauty prediction is proposed in this paper. Firstly, a multiscale network is adopted to improve the discriminative of face features. Secondly, to alleviate the computational burden of the multiscale architecture, MFM (max-feature-map) is utilized as an activation function which can not only lighten the network and speed network convergence but also benefit the performance. Finally, transfer learning strategy is introduced here to mitigate the overfitting phenomenon which is caused by the scarcity of labeled facial beauty samples and improves the proposed BeautyNet’s performance. Extensive experiments performed on LSFBD demonstrate that the proposed scheme outperforms the state-of-the-art methods, which can achieve 67.48% classification accuracy.

Facial beauty plays an important role in many fields today, such as digital entertainment, facial beautification surgery and etc. However, the facial beauty prediction task has the challenges of insufficient training datasets, low performance of traditional methods, and rarely takes advantage of the feature learning of Convolutional Neural Networks. In this paper, a transfer learning based CNN method that integrates multiple channel features is utilized for Asian female facial beauty prediction tasks. Firstly, a Large-Scale Asian Female Beauty Dataset (LSAFBD) with a more reasonable distribution has been established. Secondly, in order to improve CNN's self-learning ability of facial beauty prediction task, an effective CNN using a novel Softmax-MSE loss function and a double activation layer has been proposed. Then, a data augmentation method and transfer learning strategy were also utilized to mitigate the impact of insufficient data on proposed CNN performance. Finally, a multi-channel feature fusion method was explored to further optimize the proposed CNN model. Experimental results show that the proposed method is superior to traditional learning method combating the Asian female FBP task. Compared with other state-of-the-art CNN models, the proposed CNN model can improve the rank-1 recognition rate from 60.40% to 64.85%, and the pearson correlation coefficient from 0.8594 to 0.8829 on the LSAFBD and obtained 0.9200 regression prediction results on the SCUT dataset.

Convolutionneural network (CNN) has significantly pushed forward machine vision, which has achieved very significant results in face recognition, image classification and objection detection, and provides a new method for facial beauty prediction (FBP). Although the approach is widely applied in FBP, the research progress in FBP is relatively slow compared with face recognition. The first one is that there is less public database for FBP, and experiments for FBP are tested on small-scale database. The second one is that evaluation of facial beauty is subjective and lack of criterion, and CNN model is hard to train. In view of the problems of FBP, we expand Largescale database of Asian women's face database (LSAFBD) with data augmentation. A lighted deep convolution neural network (LDCNN) for FBP including 5650K parameters is constructed by both Inception model of GoogleNet and Max-Feature-Max activation layer, which can extract multi-scale features of an image, get compacted presentation and reduce parameters. Experiments on LSAFBD show that our LDCNN model has advantages of simple structure, small-scale parameters and is suitable for small embedded devices, with the best classification accuracy of 63.5%, which outperforms the other published CNN models for FBP.