The Journal of Korea Institute of Information, Electronics, and Communication Technology (한국정보전자통신기술학회논문지)

Korea Information Electronic Communication Technology (한국정보전자통신기술학회)
권호 표지
DOI QR코드

DOI QR Code

Heterogeneous Face Recognition Using Texture feature descriptors

텍스처 기술자들을 이용한 이질적 얼굴 인식 시스템

  • Received : 2021.06.14
  • Accepted : 2021.06.15
  • Published : 2021.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, much of the intelligent security scenario and criminal investigation demands for matching photo and non-photo. Existing face recognition system can not sufficiently guarantee these needs. In this paper, we propose an algorithm to improve the performance of heterogeneous face recognition systems by reducing the different modality between sketches and photos of the same person. The proposed algorithm extracts each image's texture features through texture descriptors (gray level co-occurrence matrix, multiscale local binary pattern), and based on this, generates a transformation matrix through eigenfeature regularization and extraction techniques. The score value calculated between the vectors generated in this way finally recognizes the identity of the sketch image through the score normalization methods.

최근 많은 지능형 보안 시나리오 및 범죄수사에서는 사진이 아닌 얼굴 영상과 다수의 정면 사진과의 매칭을 요구한다. 기존의 얼굴 인식 시스템은 이러한 요구를 충분히 충족시킬 수 없다. 본 논문에서는 동일 인물의 스케치와 사진 간의 양식 차이를 줄임으로써, 이질적 얼굴 인식 시스템의 성능을 향상시키는 알고리즘을 제안한다. 제안하는 알고리즘은 텍스처 기술자들(그레이 레벨 동시 발생 행렬, 멀티스케일 지역 이진 패턴)을 통하여 영상의 텍스처 특징들을 각각 추출하고, 이를 바탕으로 고유특징 정규화 및 추출기법을 통해 변환 행렬을 생성하게 된다. 이렇게 생성된 벡터들 간 계산된 스코어 값은 스코어 정규화 방식들을 통하여 최종적으로 스케치 영상의 신원을 인식하게 된다.

Keywords

References

  1. Tang, Xiaoou, and Xiaogang Wang. "Face sketch recognition." Circuits and Systems for Video Technology, IEEE Transactions on 14.1 (2004): 50-57. https://doi.org/10.1109/tcsvt.2003.818353
  2. Liu, Qingshan, et al. "A nonlinear approach for face sketch synthesis and recognition." Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. Vol. 1. IEEE, 2005.
  3. Wang, Xiaogang, and Xiaoou Tang. "Face photo-sketch synthesis and recognition." Pattern Analysis and Machine Intelligence, IEEE Transactions on 31.11 (2009): 1955-1967. https://doi.org/10.1109/TPAMI.2008.222
  4. Tu, Ching-Ting, and J-JJ Lien. "Facial sketch synthesis using direct combined model." Multimedia and Expo (ICME), 2010 IEEE International Conference on. IEEE, 2010.
  5. Gao, Xinbo, et al. "Face sketch synthesis algorithm based on E-HMM and selective ensemble." Circuits and Systems for Video Technology, IEEE Transactions on 18.4 (2008): 487-496. https://doi.org/10.1109/TCSVT.2008.918770
  6. Zhang, Wei, Xiaogang Wang, and Xiaoou Tang. "Lighting and pose robust face sketch synthesis." Computer Vision-ECCV 2010. Springer Berlin Heidelberg, 2010. 420-433.
  7. Li, Yung-hui, Marios Savvides, and Vijayakumar Bhagavatula. "Illumination tolerant face recognition using a novel face from sketch synthesis approach and advanced correlation filters." Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings. 2006 IEEE International Conference on. Vol. 2. IEEE, 2006.
  8. Liao, Shengcai, et al. "Heterogeneous face recognition from local structures of normalized appearance." Advances in Biometrics. Springer Berlin Heidelberg, 2009. 209-218.
  9. Klare, Brendan, and Anil K. Jain. "Heterogeneous face recognition: Matching NIR to visible light images." Pattern Recognition (ICPR), 2010 20th International Conference on. IEEE, 2010.
  10. Yi, Dong, et al. "Partial face matching between near infrared and visual images in mbgc portal challenge." Advances in Biometrics. Springer Berlin Heidelberg, 2009. 733-742.
  11. Lei, Zhen, and Stan Z. Li. "Coupled spectral regression for matching heterogeneous faces." Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009.
  12. Bhatt, Himanshu S., et al. "On matching sketches with digital face images." Biometrics: Theory Applications and Systems (BTAS), 2010 Fourth IEEE International Conference on. IEEE, 2010.
  13. Klare, Brendan F., Zhifeng Li, and Anil K. Jain. "Matching forensic sketches to mug shot photos." Pattern Analysis and Machine Intelligence, IEEE Transactions on 33.3 (2011): 639-646. https://doi.org/10.1109/TPAMI.2010.180
  14. Verma, Manisha, and Balasubramanian Raman. "Center symmetric local binary co-occurrence pattern for texture, face and bio-medical image retrieval." Journal of Visual Communication and Image Representation 32 (2015): 224-236. https://doi.org/10.1016/j.jvcir.2015.08.015
  15. Jiang, Xudong, Bappaditya Mandal, and Alex Kot. "Eigenfeature regularization and extraction in face recognition." Pattern Analysis and Machine Intelligence, IEEE Transactions on 30.3 (2008): 383-394. https://doi.org/10.1109/TPAMI.2007.70708
  16. Jain, Anil, Karthik Nandakumar, and Arun Ross. "Score normalization in multimodal biometric systems." Pattern recognition 38.12 (2005): 2270-2285. https://doi.org/10.1016/j.patcog.2005.01.012