1. bookVolume 9 (2019): Issue 3 (July 2019)
Journal Details
License
Format
Journal
eISSN
2449-6499
First Published
30 Dec 2014
Publication timeframe
4 times per year
Languages
English
access type Open Access

Score Level and Rank Level Fusion for Kinect-Based Multi-Modal Biometric System

Published Online: 09 May 2019
Volume & Issue: Volume 9 (2019) - Issue 3 (July 2019)
Page range: 167 - 176
Received: 06 Feb 2018
Accepted: 27 Sep 2018
Journal Details
License
Format
Journal
eISSN
2449-6499
First Published
30 Dec 2014
Publication timeframe
4 times per year
Languages
English
Abstract

Computational intelligence firmly made its way into the areas of consumer applications, banking, education, social networks, and security. Among all the applications, biometric systems play a significant role in ensuring an uncompromised and secure access to resources and facilities. This article presents a first multimodal biometric system that combines KINECT gait modality with KINECT face modality utilizing the rank level and the score level fusion. For the KINECT gait modality, a new approach is proposed based on the skeletal information processing. The gait cycle is calculated using three consecutive local minima computed for the distance between left and right ankles. The feature distance vectors are calculated for each person’s gait cycle, which allows extracting the biometric features such as the mean and the variance of the feature distance vector. For Kinect face recognition, a novel method based on HOG features has been developed. Then, K-nearest neighbors feature matching algorithm is applied as feature classification for both gait and face biometrics. Two fusion algorithms are implemented. The combination of Borda count and logistic regression approaches are used in the rank level fusion. The weighted sum method is used for score level fusion. The recognition accuracy obtained for multi-modal biometric recognition system tested on KINECT Gait and KINECT Eurocom Face datasets is 93.33% for Borda count rank level fusion, 96.67% for logistic regression rank-level fusion and 96.6% for score level fusion.

Keywords

[1] Gavrilova M., Monwar M., Multimodal Biometrics and Intelligent Image Processing for Security Systems, Hardcover, IGI Global, 350 pages, 201210.4018/978-1-4666-3646-0Search in Google Scholar

[2] Ross A., Nandakumar K., Jain A., Handbook of Multibiometrics, New York: Springer-Verlag, 2006Search in Google Scholar

[3] Kastaniotis D. et.al. A Framework for Gait-based Recognition Using Kinect, Pattern Recognition, Elsevier, Vol. 68(2), pp. 327-335, 201510.1016/j.patrec.2015.06.020Search in Google Scholar

[4] Leszek Rutkowski, Computational Intelligence: Methods and Techniques, 1st Ed, book, Springer, 2008Search in Google Scholar

[5] Y Wang et.al., Cognitive Intelligence: Deep Learning, Thinking, and Reasoning by Brain-Inspired Systems, IJCINI, vol. 10, no. 4, pp1-20, 2016Search in Google Scholar

[6] Paul P.P., Gavrilova M., Alhajj R., Decision Fusion for Multimodal Biometrics Using Social Network Analysis, IEEE Trans. On Systems, Man, and Cybernetics, vol. 44, no. 11, pp. 1522-1533, 201410.1109/TSMC.2014.2331920Search in Google Scholar

[7] Monwar M., Gavrilova M., Multimodal Biometric System using Rank-Level Fusion Approach, IEEE Trans. on Systems, Man, and Cybernetics, vol. 39, no. 4, pp. 867-878, 200910.1109/TSMCB.2008.200907119336340Search in Google Scholar

[8] Rahman M.W., Gavrilova M., Kinect Gait Skeletal Joint Feature Based Person Identification, 16th Int. Conference on Cognitive Informatics & Cognitive Computing (ICCICC), IEEE, pp. 423-430, 201710.1109/ICCI-CC.2017.8109783Search in Google Scholar

[9] Shakhnarovich G., Darrel T., On Probabilistic Combination of Face and Gait Cues for Identification, 5th International Conference on Automatic Face and Gesture Recognition, IEEE, pp. 1-6, 2002Search in Google Scholar

[10] Rahman M.W., Zohra F.T., Gavrilova M., Rank Level Fusion for Kinect Gait and Face Biometric Identification, Symposium Series on Computational Intelligence (SSCI), IEEE, pp. 2218-2224, 201710.1109/SSCI.2017.8280792Search in Google Scholar

[11] Kale A., Roychowdhury A., Chellappa R., Fusion of Gait and Face for Human Identification, International Conference on Acoustics, Speech and Signal Processing, IEEE, pp. 1-5, 2004Search in Google Scholar

[12] Ranganath T., Lee T., Sanei S., Fusion of Chaotic Measure into a New Hybrid Face-Gait System for Human Recognition, 18th International Conference on Pattern Recognition, IEEE, vol. 4, pp. 541-544, 2006Search in Google Scholar

[13] Zhou X., Bahanu B., Feature Fusion of Face and Gait for Human Recognition at a Distance in Video, 18th International Conference on Pattern Recognition (ICPR), IEEE, vol. 4, pp. 529-532, 2006Search in Google Scholar

[14] Zhou X., Bahanu B., Integrating Face and Gait for Human Recognition at a Distance in Video, IEEE Trans. on Systems, Man, and Cybernetics, vol. 37, no. 5, pp. 119-1137, 200710.1109/TSMCB.2006.889612Search in Google Scholar

[15] Geng X. et.al. Adaptive Fusion of Gait and Face for Human Identification in Video, Workshop on Application of Computer Vision, IEEE, pp. 1-6, 200810.1109/WACV.2008.4544006Search in Google Scholar

[16] Hossain E., Chetty G., Multimodal Face-Gait Fusion for Biometric Person Authentication, International Conference on Embedded and Ubiquitous Computing (EUC), IEEE, pp. 332-337, 201110.1109/EUC.2011.52Search in Google Scholar

[17] Hoffman M. et.al, Combined face and gait recognition using alpha matte preprocessing, 5th International Conference on Biometric (ICB), IEEE, pp. 390-395, 201210.1109/ICB.2012.6199782Search in Google Scholar

[18] Almohammod M., Salma G., Mahmoud T., Human identification system based on feature level fusion using face and gait biometrics, International Conference on Engineering and Technology (ICET), IEEE, pp. 1-5, 201210.1109/ICEngTechnol.2012.6396120Search in Google Scholar

[19] Xing X., Wang K., Lv Z., Fusion of Gait and Facial Features using Coupled Projections for People Identification at a Distance, IEEE Signal Processing Letters, vol. 22, no. 12, pp. 2349-2353, 201510.1109/LSP.2015.2481930Search in Google Scholar

[20] Zhang D. et.al., Ethnicity classification based on fusion of face and gait, International Conference on Biometric (ICB), IEEE, pp. 384-389, 201210.1109/ICB.2012.6199781Search in Google Scholar

[21] Zhang D., Wang Y., Gender recognition based on fusion on face and gait information, International Conference on Machine Learning and Cybernetics, IEEE, vol. 1, pp. 62-67, 2008Search in Google Scholar

[22] Ahmed F., Paul P.P., Gavrilova M., DTW based Kernel and Rank Level Fusion for 3D Gait Recognition using Kinect, The Visual Computer, vol. 31, no 6, pp. 915-924, 201510.1007/s00371-015-1092-0Search in Google Scholar

[23] Vondrick C. et. al. HOGgles: Visualizing Object Detection Features, International Journal on Computer Vision, pp. 1-9, 201310.1109/ICCV.2013.8Search in Google Scholar

[24] http://www.upcv.upatras.gr/personal/kastaniotis/datasets.html Last accessed: September 20, 2017Search in Google Scholar

[25] Min R., Kose N., Dugelay, J.L., KinectFaceDB: A Kinect database for face recognition, IEEE Transactions on Systems, Man and Cybernetics: Systems, vol. 44, no.11, pp. 1534-1548, 201410.1109/TSMC.2014.2331215Search in Google Scholar

[26] Paul P.P., Gavrilova M., Alhajj R., Decision Fusion for Multimodal Biometrics Using Social Network Analysis, Transactions on Systems, Man, and Cybernetics Systems, IEEE, vol. 44, no. 11, pp. 1522-1533, 201410.1109/TSMC.2014.2331920Search in Google Scholar

[27] Xing X., Wang K., Lv Z., Fusion of Gait and Facial Features using Coupled Projections for People Identification at a Distance, Signal Processing Letters, IEEE, vol. 22, no. 12, pp. 2349-2353, 201510.1109/LSP.2015.2481930Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo