Matching contactless fingerprints or finger photos to contact-based fingerprint impressions has received increased attention in the wake of COVID-19 due to the superior hygiene of the contactless acquisition and the widespread availability of low cost mobile phones capable of capturing photos of fingerprints with sufficient resolution for verification purposes. This paper presents an end-to-end automated system, called C2CL, comprised of a mobile finger photo capture app, preprocessing, and matching algorithms to handle the challenges inhibiting previous cross-matching methods; namely i) low ridge-valley contrast of contactless fingerprints, ii) varying roll, pitch, yaw, and distance of the finger to the camera, iii) non-linear distortion of contact-based fingerprints, and vi) different image qualities of smartphone cameras. Our preprocessing algorithm segments, enhances, scales, and unwarps contactless fingerprints, while our matching algorithm extracts both minutiae and texture representations. A sequestered dataset of 9, 888 contactless 2D fingerprints and corresponding contact-based fingerprints from 206 subjects (2 thumbs and 2 index fingers for each subject) acquired using our mobile capture app is used to evaluate the cross-database performance of our proposed algorithm. Furthermore, additional experimental results on 3 publicly available datasets show substantial improvement in the state-of-the-art for contact to contactless fingerprint matching (TAR in the range of 96.67% to 98.30% at FAR=0.01%).
31 January 2022 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Cancelable biometrics is a powerful remedy for information leakage caused by the extensive usage of unprotected biometric data. Current measures usually suffer from deteriorated accuracy, which is known as the security–performance tradeoff. Motivated by these concerns, in this article, a novel cancelable fingerprint approach, i.e., Indexing-Min–Max (IMM) hashing, is proposed to securely transform a fixed-length fingerprint feature vector to a discrete index hashed code. IMM hashing is essentially established upon the min–max hash and further strengthened by the integration of the partial Hadamard transform, which alleviates performance deterioration while maintaining a high security level. Extensive experiments on FVC2002 and FVC2004 fingerprint datasets coupled with comprehensive theoretical analyses demonstrate the favorable accuracy and strong anti-attack resilience of the proposed method. Besides, compared to the unprotected counterpart, the matching precision of the protected templates yields little accuracy loss or even improved performance, which means the security–performance tradeoff is well handled. Furthermore, IMM hashing also meets the unlinkability and revocability requisites of cancelable biometrics.
30 September 2019 in Journal of Intelligent Manufacturing
3D object detection is one of the fundamental perception tasks for autonomous vehicles. Fulfilling such a task with a 4D millimeter-wave radar is very attractive since the sensor is able to acquire 3D point clouds similar to Lidar while maintaining robust measurements under adverse weather. However, due to the high sparsity and noise associated with the radar point clouds, the performance of the existing methods is still much lower than expected. In this paper, we propose a novel Semi-supervised Cross-modality Knowledge Distillation (SCKD) method for 4D radar-based 3D object detection. It characterizes the capability of learning the feature from a Lidar-radar-fused teacher network with semi-supervised distillation. We first propose an adaptive fusion module in the teacher network to boost its performance. Then, two feature distillation modules are designed to facilitate the cross-modality knowledge transfer. Finally, a semi-supervised output distillation is proposed to increase the effectiveness and flexibility of the distillation framework. With the same network structure, our radar-only student trained by SCKD boosts the mAP by 10.38% over the baseline and outperforms the state-of-the-art works on the VoD dataset. The experiment on ZJUODset also shows 5.12% mAP improvements on the moderate difficulty level over the baseline when extra unlabeled data are available.
Representing fingerprint templates in binary form can provide outstanding merits compared to the conventional minutiae-based fingerprint recognition system. The existing fixed-length fingerprint feature extraction methods either suffer from redundant feature magnitude or lack of template security. In this letter, we present a compact (128 bytes) and cancelable fingerprint binary codes generation scheme which enables accurate and efficient comparison as well as high security. This binary representation is also available for advanced encryption schemes (e.g., fuzzy commitment). Specifically, a kernel learning-based real-valued fingerprint feature is converted into compact and cancelable binary code via one permutation hashing. A partial Haar transform is deployed to further strengthen the irreversibility of the whole system. Experimental results on six benchmark datasets FVC2002 and FVC2004 coupled with security analysis demonstrate the superiority of the proposed method compared with several state-of-the-arts.
26 September 2022 in IEEE Transactions on Information Forensics and Security
With the decreasing size of fingerprint scanners in portable devices, e.g., mobile phone and smart watch, partial fingerprint recognition has become a challenging and urgently needed technique due to the limited features contained in small area as well as the large rotation and translation between query and reference images. Deep learning as a powerful modeling method has advanced the research progress of fingerprint recognition, but it still suffers from the lack of labeled data in the scenario of partial fingerprint matching. In this paper, we propose a novel partial fingerprint verification network (PFVNet) based on spatial transformer network (STN) and the local self-attention mechanism. Our model can be trained end-to-end and learn multi-level fingerprint features automatically. To alleviate the data annotation work, the model is trained in a self-supervision and domain adaptation manner with data generated from large fingerprint image matching. The experimental results compared with other methods on FVC2006 DB1 dataset and in-house datasets (i.e., ZJUPartial database) show that our method achieves state-of-the-art performance, and also robust to different types of scanners.