Face recognition has been comprehensively studied. However, face recognition in the wild still suffers from unconstrained face directions. Frontal face synthesis is a popular solution, but some facial features are missed after synthesis. This paper presents a novel method for pose-invariant face recognition. It is based on face transformation with key points alignment based on generative adversarial networks (FT-GAN). In this method, we introduce CycleGAN for pixel transformation to achieve coarse face transformation results, and these results are refined by key point alignment. In this way, frontal face synthesis is modeled as a two-task process. The results of comprehensive experiments show the effectiveness of FT-GAN.

Image-based age estimation is a challenging task since there are ambiguities between the apparent age of face images and the actual ages of people. Therefore, data-driven methods are popular. To improve data utilization and estimation performance, we propose an image-based age estimation method. Theoretically speaking, the key idea of the proposed method is to integrate multi-modal features of face images. In order to achieve it, we propose a multi-modal learning framework, which is called Multiple Network Fusion with Low-Rank Representation (MNF-LRR). In this process, different deep neural network (DNN) structures, such as autoencoders, Convolutional Neural Networks (CNNs), Recursive Neural Networks (RNNs), and so on, can be used to extract semantic information of facial images. The outputs of these neural networks are then represented in a low-rank feature space. In this way, feature fusion is obtained in this space, and robust multi-modal image features can be computed. An experimental evaluation is conducted on two challenging face datasets for image-based age estimation extracted from the Internet Move Database (IMDB) and Wikipedia (WIKI). The results show the effectiveness of the proposed MNF-LRR.

The progress of Internet technology and the portability of mobile communication equipment have provided essential convenience for building an information society. Today, with networked and digital platforms as an important way of socializing, the information carrier is more based on images, videos, etc. The explosive growth of these multimedia data poses a huge challenge to efficient data storage and fast information retrieval. We design an algorithm combining Locality-sensitive Hashing (LSH) and Vision Transformer (ViT) to greatly improve the image matching rate and accuracy, and the algorithm is called ViT-LSH. The principle of LSH is to form the same hash value for points with similar distances in the data set. The results show that the LSH algorithm reduces space consumption and improves query processing efficiency compared with the other five schemes. Therefore, the LSH algorithm can help to quickly get the approximate nearest neighbor query results in a probabilistic manner, thereby ensuring the accuracy of the query results and the efficiency of time and space. The ViT divides the image into fixed-size image blocks ( Patch), uses Linear projection to project the Patch flatten to the specified dimension, gets the Tokens sequence, and adopts the sequence as the input of the feature to realize a new segmentation mode. The ViT does not employ down-sampling so that the image resolution is not reduced. The modeling of global information is a new semantic segmentation mode. The steps of ViT-LSH are as follows: first, preprocess the image, such as denoising, then segment the image, then extract features by ViT, and then reduce features' dimension. The LSH performs hash coding on the image features. After calculating the image's hash code, the image's similarity can be directly calculated by the Hamming distance, sorted according to the similarity, and the matching results are obtained. The experimental results exhibit that ViT-LSH can greatly enhance the efficiency and accuracy of image matching.