Contactless palmprint recognition has recently made significant progress in palm-scanning payment and social security. However, most existing methods are based on handcrafted kernels and are sensitive to illumination and scale variations. To address this problem, a competitive convolutional neural network (CompNet) with constrained learnable Gabor filters is proposed for contactless palmprint recognition. The proposed CompNet is built on multisize competitive blocks, which are applied to effectively exploit the rich direction ordering information of the palmprint patterns by means of the ad-hoc softmax and channel-wise convolution operations. Compared to the current deep neural networks, the backbone of the proposed network contains only very few parameters, making it quite easy to train, especially on small-scale datasets. Experimental results obtained on four popular contactless palmprint datasets demonstrate that the proposed CompNet achieves the lowest equal error rate compared to the most commonly used methods.
12 March 2019 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Palm-related biometrics have been widely studied for a long time, as the palm contains many distinctive patterns. However, most of the existing systems are designed to work within an ideal environment, such as in front of a unicolor background or in a large enclosure. Those preconditions can avoid influences of ambient light and hand distance change, but at the same time, they also limit the applications of palm recognition. In the work reported in this paper, we designed a novel red-green-blue and depth-based four-camera system that can capture the palm-related images separately in real time. The techniques of region-of-interest (ROI) location, ROI alignment, and light-source intensity optimization were studied. The ROI location method is modified to increase the robustness of hand gesture variation. Based on the depth information, we proposed the coordinate mapping and inclination rectification methods to obtain aligned ROI pairs. Using this device, we collected a video-based multimodal palm image database. After the parameter optimization and information fusion, the equal-error-rate of our approach on this database is lower than 0.47%. The recognition rate obtained from the support-vector-machine-based fusion is higher than 99.8%. The experimental results prove that the proposed system achieves advantages of anti-spoofing, high speed, high accuracy, and small size.
8 February 2022 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Recently, contactless bimodal palmprint recognition technology has attracted increased attention due to the COVID-19 pandemic. Many dual-camera-based sensors have been proposed to capture palm vein and palmprint images synchronously. However, translations between captured palmprint and palm vein images differ depending on the distance between the hand and the sensors. To address this issue, we designed a low-cost method to align the bimodal palm regions for current dual-camera systems. In this study, we first implemented a contactless palm image acquisition device with a dual-camera module and a single-point time of flight (TOF) ranging sensor. Using this device, we collected a dataset named DCPD under different distances and light source intensities from 271 different palms. Then, a bimodal palm image alignment method is proposed based on the imaging and ranging models. After the system model is calibrated, the translation between the visible light and infrared light palm regions can be estimated quickly based on the palm distance. Finally, we designed a convolutional neural network (CNN) to effectively extract the fine- and coarse-grained palm features. Compared to widely used existing methods, the proposed networks achieved the lowest equal error rate (EER) on the Tongji, IITD, and DCPD datasets, and the average time cost of the system to perform one-time identification is approximately 0.15 s. The experimental results indicate that the proposed methods achieved high efficiency and comparable accuracy. In addition, the system’s EER and rank-1 on the DCPD dataset were 0.304% and 98.66%, respectively.
22 February 2023 in IEEE Journal of Selected Topics in Signal Processing
The usage of touchless palmprint recognition (PPR) increases due to its acceptant interaction mode. However, the region of interest (ROI) localization at a distance is quite challenging for touchless PPR in real-world scenarios with complex backgrounds and hand poses. To address this issue, we proposed a palm keypoint localization neural network (PKLNet) that combines information on the hand region, palm boundary, and finger valley edges to achieve accurate and robust keypoint localization. First, a two-stage neural network was proposed. It effectively adopted the transformer framework to capture global relations of the palm boundary points to perform palm region segmentation and ROI keypoint coordinate regression. Second, an image synthesis-based training strategy was developed based on conventional palmprint ROI localization methods. The obtained ROI localizer (namely PalmKit) can automatically generate palm region masks and keypoint coordinates, which can significantly simplify the data annotation process and hence liberate the heavy manual labor. Finally, extensive experiments were performed on various touchless palmprint datasets. The proposed PKLNet obtained an 82.1% success rate and a 7.7 pixels median localization error in the cross-dataset test. The results demonstrate that the proposed PKLNet is robust to palm rotation, translation, and inference from complex backgrounds, ensuring the usability of the touchless PPR technique in real-world application scenarios.
6 November 2023 in IEEE Transactions on Intelligent Vehicles
Deep convolutional neural networks (CNNs) can improve recognition rate in license plate to improve traffic. However, these methods may refer to big computational costs and a lot of parameters. In this paper, we propose a knowledge distillation with a fast CNN for license plate detection (KDNet). KDNet uses knowledge distillation to guide a CNN to optimize parameters and quickly obtain a detector for license plate. To overcome naive effect of local information, a non-local similarity mechanism is used into a CNN to enhance effect of global information for extracting salient information in license plate detection. Experimental results that this proposed KDNet is superior to detection speed for license plate. The code of KDNet can be obtained at https://github.com/hellloxiaotian/KDNet .