IEEE Project Abstract

At present, the fusion of different uni modal biometrics has attracted increasing attention from researchers, who are dedicated to the practical application of biometrics. In this paper, we explored a multi-biometric algorithm that integrates palm prints and dorsal hand veins (DHV). Palm print recognition has a rather high accuracy and reliability, and the most significant advantage of DHV recognition is the biopsy (Liveness detection). In order to combine the advantages of both and implement the fusion method, deep learning and graph matching were respectively introduced to identify palm print and DHV. Upon using the Deep Hashing Network (DHN), biometric images can be encoded as 128-bit codes. Then, the Hamming distances were used to represent the similarity of two codes. Biometric Graph Matching (BGM) can obtain three discriminative features for classification. In order to improve the accuracy of open-set recognition, in multi-modal fusion, the score-level fusion of DHN and BGM was performed and authentication was provided by support vector machine (SVM). Furthermore, based on DHN, all four levels of fusion strategies were used for multi-modal recognition of palm print and DHV. Evaluation experiments and comprehensive comparisons were conducted on various commonly used data sets, and the promising results were obtained in this case where the Equal Error Rates (EERs) of both palm print recognition and multi-biometrics equal 0, demonstrating the great superiority of DHN in biometric verification