Finger vein recognition has been widely studied due to its advantages, such as high security, convenience, and living body recognition. At present, the performance of the most advanced finger vein recognition methods largely depends on the quality of finger vein images. However, when collecting finger vein images, due to the possible deviation of finger position, ambient lighting and other factors, the quality of the captured images is often relatively low, which directly affects the performance of finger vein recognition. In this study, we proposed a new model for finger vein recognition that combined the vision transformer architecture with the capsule network (ViT-Cap). The model can explore finger vein image information based on global and local attention and selectively focus on the important finger vein feature information. First, we split-finger vein images into patches and then linearly embedded each of the patches. Second, the resulting vector sequence was fed into a transformer encoder to extract the finger vein features. Third, the feature vectors generated by the vision transformer module were fed into the capsule module for further training. We tested the proposed method on four publicly available finger vein databases. Experimental results showed that the average recognition accuracy of the algorithm based on the proposed model was above 96%, which was better than the original vision transformer, capsule network, and other advanced finger vein recognition algorithms. Moreover, the equal error rate (EER) of our model achieved state-of-the-art performance, especially reaching less than 0.3% under the test of FV-USM datasets which proved the effectiveness and reliability of the proposed model in finger vein recognition.
Finger vein recognition has become a research hotspot in the field of biometrics due to its advantages of non-contact acquisition, unique information, and difficulty in terms of forging or pirating. However, in the real-world application process, the extraction of image features for the biometric remains a significant challenge when the captured finger vein images suffer from blur, noise, or missing feature information. To address the above challenges, we propose a novel deep reinforcement learning-based finger vein image recovery method, DRL-FVRestore, which trained an agent that adaptively selects the appropriate restoration behavior according to the state of the finger vein image, enabling continuous restoration of the image. The behaviors of image restoration are divided into three tasks: deblurring restoration, defect restoration, and denoising and enhancement restoration. Specifically, a DeblurGAN-v2 based on the Inception-Resnet-v2 backbone is proposed to achieve deblurring restoration of finger vein images. A finger vein feature-guided restoration network is proposed to achieve defect image restoration. The DRL-FVRestore is proposed to deal with multi-image problems in complex situations. In this paper, extensive experimental results are conducted based on using four publicly accessible datasets. The experimental results show that for restoration with single image problems, the EER values of the deblurring network and damage restoration network are reduced by an average of 4.31% and 1.71%, respectively, compared to other methods. For images with multiple vision problems, the EER value of the proposed DRL-FVRestore is reduced by an average of 3.98%.
Region of interest (ROI) extraction is a key step in finger vein recognition preprocessing. The current method takes the finger region in the vein image as the ROI, but this method cannot obtain better recognition accuracy because it only removes the background noise of the image and ignores factors such as the position and shape of the finger. To solve this problem, we limited the ROI to a fixed region between two finger joint cavities, proposed a new large receptive field gradient operator, and designed and implemented a new method for ROI extraction. It uses a large receptive field to search the target, which is similar to human vision, thus solving the problem of difficult ROI localization for images with large gradient areas. Moreover, for external factors such as noise and uneven illumination in the vein image, the interference factors can be eliminated by averaging them to a larger range with a larger size operator to improve the accuracy of the subsequent matching recognition. To verify the effectiveness of the proposed method, we conducted sufficient matching experiments on three public finger vein datasets. On various datasets, our method significantly reduced the identified EER value, with the lowest EER value reaching 0.96. The experimental results show that the proposed ROI extraction method can effectively eliminate the influence of finger position, finger shape, and other factors on the subsequent recognition performance, accurately locate the finger joint cavity, and effectively improve the recognition performance.