Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Multimodal Biometric Using a Hierarchical Fusion of a Person's Face, Voice, and Online Signature

  • Elmir, Youssef (Dept. of Sciences, University of Bechar) ;
  • Elberrichi, Zakaria (EEDIS Lab, Dept. of Computer Science, Djillali Liabes University) ;
  • Adjoudj, Reda (EEDIS Lab, Dept. of Computer Science, Djillali Liabes University)
  • Received : 2013.08.19
  • Accepted : 2014.02.05
  • Published : 2014.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Biometric performance improvement is a challenging task. In this paper, a hierarchical strategy fusion based on multimodal biometric system is presented. This strategy relies on a combination of several biometric traits using a multi-level biometric fusion hierarchy. The multi-level biometric fusion includes a pre-classification fusion with optimal feature selection and a post-classification fusion that is based on the similarity of the maximum of matching scores. The proposed solution enhances biometric recognition performances based on suitable feature selection and reduction, such as principal component analysis (PCA) and linear discriminant analysis (LDA), as much as not all of the feature vectors components support the performance improvement degree.

Keywords

References

  1. S. Z. Li and A. k. Jain, Handbook of Face Recognition. New York, NY: Springer, 2005.
  2. A. A. Ross, Handbook of Multibiometrics. New York, NY: Springer, 2006.
  3. A. K. Jain, L. Hong, and Y, Kulkarni, "A multimodal biometric system using fingerprint, face and speech," in Proceedings of the 2nd International Conference on Audio- and Video-based Biometric Person Authentication, Washington, DC, 1999, pp. 182-187.
  4. E. Camlikaya, A. Kholmatov, and B. Yanikoglu, "Multi-biometric templates using fingerprint and voice," Proceedings of SPIE, vol. 6944, article no. 69440I, 2008.
  5. S. Ben-Yacoub, Y. Abdeljaoued, and E. Mayoraz, "Fusion of face and speech data for person identity verification," IEEE Transactions on Neural Networks, vol. 10, no. 5, pp. 1065-1074, 1999. https://doi.org/10.1109/72.788647
  6. Y. M. Fouda, "Fusion of face and voice: an improvement," International Journal of Computer Science and Network Security (IJCSNS), vol. 12, no. 4, p. 37, 2012.
  7. N. Poh and J. Kittler, "A family of methods for quality-based multimodal biometric fusion using generative classifiers," in Proceedings of 10th International Conference on Control, Automation, Robotics and Vision (ICCARV'08), Hanoi, Vietnam, 2008, pp. 1162-1167.
  8. V. Struc and N. Pavesic, "The complete Gabor-Fisher classifier for robust face recognition," EURASIP Journal on Advances in Signal Processing, vol. 2010, article no. 31, Feb. 2010.
  9. V. Struc and N. Pavesic, "Gabor-based kernel partial-least-squares discrimination features for face recognition," Informatica (Vilnius), vol. 20, no. 1, pp. 115-138, Jan. 2009.
  10. C. Liu, "Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 725-737, 2006. https://doi.org/10.1109/TPAMI.2006.90
  11. C. Liu and H. Wechsler, "Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition," IEEE Transactions on Image Processing, vol. 11, no. 4, p. 467-476, 2002. https://doi.org/10.1109/TIP.2002.999679
  12. Y. MAMI, "Reconnaissance de locuteurs par localisation dans un espace de locuteurs de reference," Ph.D. dissertation, Telecom ParisTech, Paris, 2003.
  13. M. N. Do, "An automatic speaker recognition system," Digital Signal Processing Laboratory, Federal Institute of Technology, Lausanne, Switzerland, 2001.
  14. C. Cornaz, U. Hunkeler, and V. Velisavljevic, "An automatic speaker recognition system," Digital Signal Processing Laboratory, Federal Institute of Technology, Lausanne, Switzerland, 2003.
  15. A. K. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognition, vol. 38, no. 12, pp. 2270-2285, 2005. https://doi.org/10.1016/j.patcog.2005.01.012
  16. A. A. Rossa and R. Govindarajanb, "Feature level fusion using hand and face biometrics," Proceedings of SPIE: Biometric Technology for Human Identification II, vol. 5779, pp. 196-204, 2005.
  17. A. Shukla, J. Dhar, C. Prakash, D. Sharma, R. K. Anand, and S. Sharma, "Intelligent biometric system using PCA and R-LDA," in Proceedings of WRI Global Congress on Intelligent Systems (GCIS'09), Xiamen, China, 2009, pp. 267-272.
  18. A. H. Boualleg, C. Bencheriet, and H. Tebbikh, "Automatic face recognition using neural network- PCA," in Proceedings of IEEE Information and Communication Technologies (ICTTA'06), Damascus, Syria, 2006, pp. 1920-1925.
  19. H. Kong, X. Li, L. Wang, E. K. Teoh, J. G. Wang, and R. Venkateswarlu, "Generalized 2D principal component analysis," in Proceedings of International Joint Conference on Neural Networks (IJCNN'05), Montreal, Canada, 2005, pp. 108-113.
  20. W. S. Yambor, "Analysis of PCA-based and Fisher discriminant-based image recognition algorithms," Master's thesis, Colorado State University, Fort Collins, CO, 2000.
  21. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 228-233, 2001. https://doi.org/10.1109/34.908974
  22. J. Yang, Y. Yu, and W. Kunz, "An efficient LDA algorithm for face recognition," in Proceedings of the 6th International Conference on Control, Automation, Robotics and Vision (ICARCV2000), Singapore, 2000, pp. 34-47.
  23. R. Beveridge, D. Bolme, M. Teixeira, and B. Draper, "The CSU face identification evaluation system user's guide: version 5," May 2003; http://www.cs.colostate.edu/evalfacerec/algorithms/version5/faceIdUsersGuide.pdf.
  24. C. Sanderson and B. C. Lovell, "Multi-region probabilistic histograms for robust and scalable identity inference," in Advances in Biometrics, Heidelberg: Springer, 2009, pp. 199-208.
  25. S. Al-maadeed, W. Ayouby, A. Hassaine, A. Almejali, A. Al-yazeedi, and R. Al-atiya, "Arabic signature verification dataset," in Proceedings of the 13th International Arab Conference on Information Technology, Amman, Jordan, 2012.
  26. L. Allano, A. C. Morris, H. Sellahewa, S. Garcia-Salicetti, J., Koreman, S., Jassim, B. Ly-Van, D. Wu, and B. Dorizzi, "Nonintrusive multibiometrics on a mobile device: a comparison of fusion techniques," Proceedings of SPIE: Biometric Technology for Human Identification III, vol. 6202, article no. 62020P, Apr. 2006.
  27. L. Fang-jun and L. Lan, "Fusing multi-biometrics authorization with PCA," in Proceedings of the 4th International Conference on Biomedical Engineering and Informatics (BMEI), Shanghai, China, 2011, pp. 757-761.

Cited by

  1. Multimodal fusion of the finger vein, fingerprint and the finger-knuckle-print using Kernel Fisher analysis vol.42, 2016, https://doi.org/10.1016/j.asoc.2016.02.008
  2. Two-stage multi-intent detection for spoken language understanding vol.76, pp.9, 2017, https://doi.org/10.1007/s11042-016-3724-4
  3. A bimodal empty space skipping of ray casting for terrain data vol.72, pp.7, 2016, https://doi.org/10.1007/s11227-015-1522-9
  4. Periocular-based biometrics robust to eye rotation based on polar coordinates vol.76, pp.9, 2017, https://doi.org/10.1007/s11042-015-3052-0
  5. Fusion in Multimodal Biometric System: A Review vol.10, pp.28, 2017, https://doi.org/10.17485/ijst/2017/v10i28/114382
  6. Special point representations for reducing data space requirements of finger-vein recognition applications vol.76, pp.9, 2017, https://doi.org/10.1007/s11042-016-3300-y
  7. Speaker diarization method of telemarketer and client for improving speech dictation performance vol.72, pp.5, 2016, https://doi.org/10.1007/s11227-015-1470-4
  8. The Fall of One, the Rise of Many: A Survey on Multi-Biometric Fusion Methods vol.5, 2017, https://doi.org/10.1109/ACCESS.2017.2694050
  9. Development of emotion recognition interface using complex EEG/ECG bio-signal for interactive contents vol.76, pp.9, 2017, https://doi.org/10.1007/s11042-016-4203-7
  10. Fusion in Multimodal Biometric System: A Review vol.10, pp.28, 2017, https://doi.org/10.17485/ijst/2017/v10i19/114382
  11. A Perspective Analysis of Handwritten Signature Technology vol.51, pp.6, 2019, https://doi.org/10.1145/3274658