Xiang Li

Dr. Xiang Li

Osaka University, Ōsaka, Japan
orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 February 2020 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Open access
CXChi Xu
Chi Xu
YMYasushi Makihara
Yasushi Makihara
Xiang LiXiang Li
Xiang Li
YYYasushi Yagi
Yasushi Yagi
JLJianfeng Lu
Jianfeng Lu
In this paper, we propose a pairwise spatial transformer network (PSTN) for cross-view gait recognition, which reduces unwanted feature mis-alignment due to view differences before a recognition step for better performance. The proposed PSTN is a unified CNN architecture that consists of a pairwise spatial transformer (PST) and subsequent recognition network (RN). More specifically, given a matching pair of gait features from different source and target views, the PST estimates a non-rigid deformation field to register the features in the matching pair into their intermediate view, which mitigates distortion by registration compared with the case of direct deformation from the source view to target view. The registered matching pair is then fed into the RN to output a dissimilarity score. Although registration may reduce not only intra-subject variations but also inter-subject variations, we can still achieve a good trade-off between them using a loss function designed to optimize recognition accuracy. Experiments on three publicly available gait datasets demonstrate that the proposed method yields superior performance for both verification and identification scenarios by combining any gait recognition network benchmarks with the PST.

21 December 2017 in IPSJ Transactions on Computer Vision and Applications
Verified
Journal Article
Open access
PDF file
CXChi Xu
Chi Xu
YMYasushi Makihara
Yasushi Makihara
GOGakuto Ogi
Gakuto Ogi
Xiang LiXiang Li
Xiang Li
YYYasushi Yagi
Yasushi Yagi
JLJianfeng Lu
Jianfeng Lu
In this paper, we describe the world’s largest gait database, the “OU-ISIR Gait Database, Large Population Dataset with Age (OULP-Age)” and its application to a statistically reliable performance evaluation of gait-based age estimation. Whereas existing gait databases include only 4016 subjects at most, we constructed an extremely large-scale gait database that includes 63,846 subjects (31,093 males and 32,753 females) with ages ranging from 2 to 90 years old. Benchmark algorithms of gait-based age estimation were then implemented to evaluate statistically significant performance differences. Additionally, the dependence of gait-based age estimation performance on gender and age group, in addition to the number of training subjects, was investigated to provide several insights for future research on the topic.

1 July 2017
Verified
Conference Paper
Closed access
YMYasushi Makihara
Yasushi Makihara
ASAtsuyuki Suzuki
Atsuyuki Suzuki
DMDaigo Muramatsu
Daigo Muramatsu
Xiang LiXiang Li
Xiang Li
YYYasushi Yagi
Yasushi Yagi
This paper describes a joint intensity metric learning method to improve the robustness of gait recognition with silhouette-based descriptors such as gait energy images. Because existing methods often use the difference of image intensities between a matching pair (e.g., the absolute difference of gait energies for the l1-norm) to measure a dissimilarity, large intrasubject differences derived from covariate conditions (e.g., large gait energies caused by carried objects vs. small gait energies caused by the background), may wash out subtle intersubject differences (e.g., the difference of middle-level gait energies derived from motion differences). We therefore introduce a metric on joint intensity to mitigate the large intrasubject differences as well as leverage the subtle intersubject differences. More specifically, we formulate the joint intensity and spatial metric learning in a unified framework and alternately optimize it by linear or ranking support vector machines. Experiments using the OU-ISIR treadmill data set B with the largest clothing variation and large population data set with bag, β version containing carrying status in the wild demonstrate the effectiveness of the proposed method.

30 May 2018 in IPSJ Transactions on Computer Vision and Applications
Verified
Journal Article
Open access
PDF file
ZUZasim Uddin
Zasim Uddin
TNThanh Trung Ngo
Thanh Trung Ngo
YMYasushi Makihara
Yasushi Makihara
NTNoriko Takemura
Noriko Takemura
Xiang LiXiang Li
Xiang Li
YYYasushi Yagi
Yasushi Yagi
In this paper, we describe the world’s largest gait database with real-life carried objects (COs), which has been made publicly available for research purposes, and its application to the performance evaluation of vision-based gait recognition. Whereas existing databases for gait recognition include at most 4007 subjects, we constructed an extremely large-scale gait database that includes 62,528 subjects, with an equal distribution of males and females, and ages ranging from 2 to 95 years old. Moreover, whereas existing gait databases consider a few predefined CO positions on a subject’s body, we constructed a database that contained unconstrained variations of COs being carried in unconstrained positions. Additionally, gait samples were manually classified into seven carrying status (CS) labels. The extremely large-scale gait database enabled us to evaluate recognition performance under cooperative and uncooperative settings, the impact of the training data size, the recognition difficulty level of the CS labels, and the possibility of the classification of CS labels. Particularly, the latter two performance evaluations have not been investigated in previous gait recognition studies.

11 January 2023 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Open access
CXChi Xu
Chi Xu
YMYasushi Makihara
Yasushi Makihara
Xiang LiXiang Li
Xiang Li
YYYasushi Yagi
Yasushi Yagi
Partial occlusion of the human body caused by obstacles or a limited camera field of view often occurs in surveillance videos, which affects the performance of gait recognition in practice. Existing methods for gait recognition against occlusion require a bounding box or the height of a full human body as a prerequisite, which is unobserved in occlusion scenarios. In this paper, we propose an occlusion-aware model-based gait recognition method that works directly on gait videos under occlusion without the above-mentioned prerequisite. Specifically, given a gait sequence that only contains non-occluded body parts in the images, we directly fit a skinned multi-person linear (SMPL)-based human mesh model to the input images without any pre-normalization or registration of the human body. We further use the pose and shape features extracted from the estimated SMPL model for recognition purposes, and use the extracted camera parameters in the occlusion attenuation module to reduce intra-subject variation in human model fitting caused by occlusion pattern differences. Experiments on occlusion samples simulated from the OU-MVLP dataset demonstrated the effectiveness of the proposed method, which outperformed state-of-the-art gait recognition methods by about 15% rank-1 identification rate and 2% equal error rate in the identification and verification scenarios, respectively.

22 April 2019 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Open access
Xiang LiXiang Li
Xiang Li
YMYasushi Makihara
Yasushi Makihara
CXChi Xu
Chi Xu
YYYasushi Yagi
Yasushi Yagi
MRMingwu Ren
Mingwu Ren
Clothing and carrying status variations are two key factors that affect the performance of gait recognition because people usually wear various clothes and carry all kinds of objects while walking in their daily life. These covariates substantially affect the intensities within conventional gait representations such as gait energy images. Hence, to properly compare a pair of input gait features, an appropriate metric for joint intensity is needed in addition to the conventional spatial metric. We therefore propose a unified joint intensity transformer network for gait recognition that is robust against various clothing and carrying statuses. Specifically, the joint intensity transformer network is a unified deep learning-based architecture containing three parts: a joint intensity metric estimation net, a joint intensity transformer, and a discrimination network. First, the joint intensity metric estimation net uses a well-designed encoder-decoder network to estimate a sample-dependent joint intensity metric for a pair of input gait energy images. Next, a joint intensity transformer module outputs the spatial dissimilarity of two gait energy images using the metric learned by the joint intensity metric estimation net. Third, the discrimination network is a generic convolution neural network for gait recognition. Additionally, the joint intensity transformer network is designed with different loss functions depending on the gait recognition task (i.e., a contrastive loss function for the verification task and a triplet loss function for the identification task). Experiments on the world’s largest datasets containing various clothing and carrying statuses demonstrate the state-of-the-art performance of the proposed method.