The research of external fingerprint collected by total internal reflection (TIR) has been carried out for decades and research of internal fingerprint of optical coherence tomography (OCT) has just begun. The internal fingerprint can be hardly affected by the finger surface status, due to its strong anti-interference and anti-spoofing ability, which can serve as a powerful supplement to external fingerprint. However, matching fingerprints acquired by different ways can lead to a drop in fingerprint recognition accuracy owing to the differences in fingerprint quality, distortions and detection areas. Whether the internal fingerprint can be used to replace the external fingerprint for direct identification has been hampered by lacking comparison tools to study potential correlation with each other. To study the connection between internal and external fingerprints, a synchronous acquisition system that achieves the same fingerprint area measurement at the same time is necessary. The integration of different optical paths of TIR and OCT as well as the consequent distortion correction of two totally different imaging ways are two challenging problems. This paper presents a fingerprint acquisition system that synchronously acquires the external fingerprint and internal fingerprint with TIR and OCT, respectively. By using a self-designed trapezoidal prism, optical paths of TIR and OCT were integrated. Furthermore, a distortion correction method based on a grid calibration plate is used to remove distortions caused by two imaging methods. The fingerprint quality statistics is illustrated in 264 sets of fingerprint datasets. Identification results show synchronous acquisition and distortion correction of proposed system is efficient.
7 July 2023 in IEEE Transactions on Information Forensics and Security
Presentation attack detection (PAD) is a critical component of automated fingerprint recognition systems (AFRSs). However, existing PAD technologies based on optical coherence tomography (OCT) mainly rely on local information, ignoring the global continuity and correlation of physiological structures. Furthermore, the lack of appropriate presentation attack instruments (PAIs) that cater to the unique OCT characteristics leads to the insufficient evaluation of PAD. The identification features, including external fingerprint (EF), internal fingerprint (IF), and subcutaneous sweat pore (SSP), provide valuable information about the intrinsic connections of physiological structures. Such intrinsic connections hold potential clues for PAD. Building upon this premise, this paper proposed a novel PAD method based on three OCT hand-crafted features: EF-IF self-matching score (SMS), SSP number (SN), and SSP coincidence rate (SCR). These simple yet effective PAD features offer a more precise and detailed description of the internal physiological structure, enabling accurate distinction between presentation attack (PA) and bona-fide. The proposed method achieves a 4% Equal Error Rate (EER), significantly outperforming other existing PAD methods. Additionally, the cross-device experiment demonstrates the generalization capability of the proposed method on both our dataset and the public OCT dataset.
28 November 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
External fingerprints (EFs) based only on epidermal information are vulnerable to spoofing attacks and non-ideal skin conditions. To solve such shortcomings, internal fingerprints (IFs) collected using optical coherence tomography (OCT) have been proposed and widely researched. However, the development of IF is limited by the lack of in-depth researches on the IF and the EF-IF interoperability, which is partially caused by the lack of public OCT database. The obvious gap in the applications of EF and IF recognition motivated us to design and publish a comprehensive fingerprint database containing both traditional EFs and OCT IFs, denoted as ZJUT-EIFD. To the best of our knowledge, ZJUT-EIFD is the first public database that combines OCT and total internal reflection (TIR) via synchronous acquisition, with 399 different fingers from 60 subjects. In this article, the composition of the database, the quality of EFs and IFs, and the verification performance of different types of fingerprints were detailed. In addition, potential application directions of ZJUT-EIFD were demonstrated. ZJUT-EIFD can serve benchmarks and interoperability tests for EF-IF research, which will promote the research and development of EF and IF. ZJUT-EIFD is available at https://github.com/ZJUT-ERCISS-home/ZJUT-EIFD/
2 June 2023 in IEEE Transactions on Information Forensics and Security
Anti-spoofing ability is vital for fingerprint identification systems. Conventional fingerprint scanning devices can only obtain information from the fingertip surfaces, and their performance is susceptible to skin conditions and presentation attacks (PAs). However, optical coherence tomography (OCT) can scan subcutaneous tissue and obtain 3D fingerprint structures, naturally enhancing its PA detection (PAD) ability from the perspective of hardware. Existing unsupervised PAD methods are based on image reconstruction. However, the reconstruction error is easily affected by OCT noise and the rich details of OCT images. Therefore we propose feature-based reconstruction to alleviate this problem, called the prototype-guided autoencoder. The model consists of a memory module and a denoising autoencoder without the requirement of PA fingerprints. As only bona fide fingerprints are available during the training phase, the memory module contains the prototype features of the bona fide fingerprints. During the inference phase, as the prototype memory module is frozen, the reconstructed representation of the bona fide input is close to the bona fide fingerprint features. Calculating the distance between the original features and the prototype reconstructed representation of the sample can achieve PAD. To obtain a better decision making boundary, we propose a representation consistency constraint, which reduces the bona fide representation reconstruction distance closer, so that it is easier to differentiate between fingerprints and PAs.
13 July 2023 in IEEE Transactions on Biometrics, Behavior, and Identity Science
As a non-invasive optical imaging technique, optical coherence tomography (OCT) has proven promising for automatic fingerprint recognition system (AFRS) applications. Diverse approaches have been proposed for OCT-based fingerprint presentation attack detection (PAD). However, considering the complexity and variety of PA samples, it is extremely challenging to increase the generalization ability with the limited PA dataset. To solve the challenge, this paper presents a novel supervised learning-based PAD method, denoted as internal structure attention PAD (ISAPAD). ISAPAD applies prior knowledge to guide network training. Specifically, the proposed dual-branch architecture in ISAPAD can not only learn global features from the OCT images, but also concentrate on the layered structure feature which come from the internal structure attention module (ISAM). The simple yet effective ISAM enables the network to obtain layered segmentation features exclusively belonging to Bonafide from noisy OCT volume data. By incorporating effective training strategies and PAD score generation rules, ISAPAD ensures reliable PAD performance even with limited training data. Extensive experiments and visualization analysis substantiate the effectiveness of the proposed method for OCT PAD.
Raman spectroscopy is a powerful tool for identifying substances, yet accurately analyzing mixtures remains challenging due to overlapping spectra. This study aimed to develop a deep learning-based framework to improve the identification of components in mixtures using Raman spectroscopy. We propose a three-branch feature fusion network that leverages spectral pairwise comparison and a multi-head self-attention mechanism to capture both local and global spectral features. To address limited data availability, traditional data augmentation techniques were combined with deep convolutional generative adversarial networks (DCGAN) to expand the dataset. Our framework significantly outperformed existing Raman spectroscopy-based methods in both qualitative and quantitative analyses. The model demonstrated superior accuracy compared to U-Net and ResNext, achieving higher detection accuracy for mixture components. This framework offers a promising solution for improving mixture identification in Raman spectroscopy, with potential applications in industries such as pharmaceuticals, food safety, and environmental monitoring.