Vehicle re-identification, aiming to identify vehicles across images, has drawn a lot attention and has made significant achievements recent years. However, vehicle re-identification still remains a challenging task because of severe appearance changes of a vehicle due to different orientations. In practice, the result of re-identification is greatly influenced by the pose of vehicles and we call this influence as “pose-barrier”. In this paper, we propose to use pose-invariant features and pose-discriminative features to address the pose-barrier. Pose-invariant features are expert in exploring the overall characteristic of the appearance. Meanwhile, pose-discriminative features are prior to distinguish the difference between local details. The framework of our method can be divided into three steps: orientation estimation, pose-invariant feature learning and pose discriminative feature learning, so-called pose-based complementary features (PCF). The pose-discriminative feature is trained together with a orientation discriminator which tries to judge the orientation of input images. On the other hand, adversarial loss is applied in a pose to train a pose-discriminative feature which does not contain orientation information. By combining the two features, the method can alleviate the influence of pose-barrier. Extensive experiments on a series of challenging databases demonstrate that the proposed framework outperforms the state-of-the-art results on vehicle re-identification dataset: VeRi-776.
Person re-identification (re-ID) is a widely studied yet still challenging problem in computer vision. It aims to match images of the same pedestrian captured from different cameras. Recently, deep learning has been widely used for feature extraction and distance metric learning in re-ID. However, most of them only consider a certain aspect of the input data, and thus will make certain mistakes during the testing process. In this paper, group decision-making (GDM) theory is introduced for comprehensive decision. Furthermore, a novel Group Decision-making Network (GDMN) is proposed which consists of two sub-networks. First, Proposal Generation Network (PGN) can generate proposals based on baseline networks for the following decision-making process. Then, Decision Evaluation Network (DEN) evaluates all the proposals and make the comprehensive decision. The proposed GDMN can analyze the merits and drawbacks of existing methods, and make a better decision. The experimental results on public re- ID benchmarks show that our approach significantly improves the performance of the baseline methods, and achieves competitive results compared with other state-of-the-art methods.
Person image generation aims to synthesize realistic person images that follow the same distribution as the given dataset. Previous attempts can be generally categorized into two classes: conditional GAN and unconditional GAN. The former usually uses pose information as condition to make pose transfer using GAN. The generated person have the same identity as the source person. The latter generates person images from scratch, and the real person images are only used as references for the discriminator. While conditional GAN is widely studied, unconditional GAN is also worth exploring because it can synthesize person image with new identity, which is a useful manner of data augmentation. These two types of generating methods have their different advantages and disadvantages, and sometimes they are complementary. This paper proposes a CoGAN to cooperatively train two types of GANs in an end‐to‐end framework. The two GANs serve different purposes, and can learn from each other during the cooperative learning procedure. The experimental results on public datasets show that the proposed CoGAN improves the performance of both baseline methods, and achieves competitive results compared with state‐of‐the‐art methods.
The person re-identification (re-ID) problem has attracted growing interest in the computer vision community. Most public re-ID datasets are captured by multiple non-overlapping cameras, and the same person may appear dissimilar in different camera views due to variances of illuminations, viewpoints and postures. These differences, collectively referred to as camera style variance, make person re-ID still a challenging problem. Recently, researchers have attempted to solve this problem using generative models. The generative adversarial network (GAN) is widely used for the pose transfer or data augmentation to bridge the camera style gap. However, these methods, mostly based on image-level GAN, require huge computational power during the training of generative models. Furthermore, the training process of GAN is separated from the re-ID model, which makes it hard to achieve a global optimal for both models simultaneously. In this paper, the authors propose to alleviate camera style variance in the re-ID problem by adopting a feature-level Camera Style Transfer (CST) model, which can serve as an intra-class augmentation method and enhance the model robustness against camera style variance. Specifically, the proposed CST method transfers the camera style-related information of input features while preserving the corresponding identity information. Moreover, the training process can be embedded into the re-ID model in an end-to-end manner, which means the proposed approach can be deployed with much less time and memory cost. The proposed approach is verified on several different person re-ID baselines. Extensive experiments show the validity of the proposed CST model and its benefits for re-ID performance on the Market-1501 dataset.