Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Development of Rotation Invariant Real-Time Multiple Face-Detection Engine

회전변화에 무관한 실시간 다중 얼굴 검출 엔진 개발

  • Han, Dong-Il (Dept. of Computer Engineering, Sejong University) ;
  • Choi, Jong-Ho (Dept. of Computer Engineering, Sejong University) ;
  • Yoo, Seong-Joon (Dept. of Computer Engineering, Sejong University) ;
  • Oh, Se-Chang (Dept. of Information & Communication, Sejong Cyber University) ;
  • Cho, Jae-Il (Robot Research Department, ETRI)
  • 한동일 (세종대학교 컴퓨터공학과) ;
  • 최종호 (세종대학교 컴퓨터공학과) ;
  • 유성준 (세종대학교 컴퓨터공학과) ;
  • 오세창 (세종사이버대학교 정보통신학과) ;
  • 조재일 (한국전자통신연구원 로봇연구부)
  • Received : 2010.10.16
  • Accepted : 2011.04.08
  • Published : 2011.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose the structure of a high-performance face-detection engine that responds well to facial rotating changes using rotation transformation which minimize the required memory usage compared to the previous face-detection engine. The validity of the proposed structure has been verified through the implementation of FPGA. For high performance face detection, the MCT (Modified Census Transform) method, which is robust against lighting change, was used. The Adaboost learning algorithm was used for creating optimized learning data. And the rotation transformation method was added to maintain effectiveness against face rotating changes. The proposed hardware structure was composed of Color Space Converter, Noise Filter, Memory Controller Interface, Image Rotator, Image Scaler, MCT(Modified Census Transform), Candidate Detector / Confidence Mapper, Position Resizer, Data Grouper, Overlay Processor / Color Overlay Processor. The face detection engine was tested using a Virtex5 LX330 FPGA board, a QVGA grade CMOS camera, and an LCD Display. It was verified that the engine demonstrated excellent performance in diverse real life environments and in a face detection standard database. As a result, a high performance real time face detection engine that can conduct real time processing at speeds of at least 60 frames per second, which is effective against lighting changes and face rotating changes and can detect 32 faces in diverse sizes simultaneously, was developed.

본 논문에서는 기존의 방법에 비해서 사용되는 메모리의 증가가 없이, 혹은 메모리의 증가를 최소화하는 영상 메모리의 회전 변환 기법을 개발하여 얼굴 회전 변화에 강인한 고성능 실시간 얼굴 검출 엔진 구조를 제안하였으며 FPGA 구현을 통하여 제안 구조의 타당성을 검증하였다. 고성능 얼굴 검출을 위해 기존에 사용하던 조명 변화에 강인한 MCT(Modified Census Transform) 변환 기법과 최적화된 학습데이터 생성을 위한 Adaboost 학습 기법 이외에 얼굴 회전 변환에 강인함을 위한 영상 회전 기법을 이용하였다. 제안한 하드웨어 구조는 색좌표 변환부, 잡음 제거부, 메모리 인터페이스부, 영상 회전부, 크기 조정부, MCT 생성부, 얼굴 후보 검출부/ 신뢰도 비교부, 좌표 재조정부, 데이터 검증부, 검출 결과 표시부/컬러 기반 검출 결과 표시부로 구성되어있다. 구현 및 검증을 위해 Virtex5 LX330 FPGA 보드와 QVGA급 CMOS 카메라, LCD Display를 이용하였으며, 다양한 실생활 환경 및 얼굴 검출 표준 데이터베이스에 대해서 뛰어난 성능을 나타냄을 검증하였다. 결과적으로 실생활 환경에서 초당 60프레임 이상의 속도로 실시간 처리가 가능하며, 조명 변화 및 얼굴 회전 변화에 강인하고, 동시에 32개의 다양한 크기의 얼굴 검출이 가능한 고성능 실시간 얼굴 검출 엔진을 개발하였다.

Keywords

References

  1. Samir Nanavat, Michael Thieme and Raj Nanavati. "Biometrics", Wiley, pp.63-75, 2002.
  2. Bongjin Jun, Daijin Kim, "Robust real-time face detection using face certainty map", Lecture Notes in Computer Science, Springer Berlin / Heidelberg, pp. 29-38, 2009.
  3. P. Viola and M. Jones, "Fast and robust classification using asymmetric AdaBoost and a detector cascade", in NIPS 14, 2002, pp. 1311-1318.
  4. Jianxin Wu, S. Charles Brubaker, Matthew D. Mullin, and James M. Rehg, Member, "Face Asymmetric Learning for Cascade Face Detection", IEEE Transaction on Pattern Analysis and Machine Intelligence,p. 1-13, 2008.
  5. Junguk Cho, Shahnam Mirzaei, Jason Oberg, Ryan Kastner, "Fpga-based face detection system using Haar classifiers", Proceeding of the ACM/SIGDA international symposium on Field programmable gate arrays, Portal.acm.org, p. 103-112, 2009.
  6. Yoav Freund and Robert E. Schapire. "A decision-theoretic generalization of on-line learning and an application to boosting" in Journal of Computer and System Sciences, pp. 119-139, 1997.
  7. Sung, K.K., Poggio, T, "Example-based learning for view-based human face detection", IEEE Transactions on Pattern Analysis and Machine Intelligence 20, p. 39-51, 1998. https://doi.org/10.1109/34.655648
  8. S. Romdhani, P. Torr, B. Schoelkopf, and A. Blake, "Computationally efficient face detection", in Proc. ICCV, 2001, pp. 695-700.
  9. Ming-Hsuan Yang, Dan Roth and Narendra Ahuja. "A snow-based face detector". In Advances in Neural Information Processing Systems 12 (NIPS 12), pp.855-861. MIT Press, 2000.
  10. Chang Huang, Haizhou Ai, Yuan Li, and Shihong Lao, "High-Performance Rotation Invariant Multiview Face Detection", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 4, pp. 671-686, April, 2007. https://doi.org/10.1109/TPAMI.2007.1011
  11. Paul Viola and Michael J. Jones, "Robust real-time face detection" In International Journal of Computer Vision, pp. 137-154, 2004.
  12. Bernhard Fröba and Andreas Ernst, "Face detection with the Modified Census Transform", IEEE International Conf. On Automatic Face and Gesture Recognition(AFGR), pp. 91-96, Seoul, Korea, May. 2004.
  13. 이수현, 정용진, "얼굴 검출을 위한 SoC 하드웨어구현 및 검증", 전자공학회 논문지 제44권 SD 편, 제 4호, 대한전자공학회, 2007년 4월.
  14. Najwa Aaraj, Srivaths Ravi, Anand Raghunathan and Niraj K. Jha, "Hybrid architectures for efficient and secure face authentication in embedded systems", IEEE Transaction on VLSI Systems, Vol.15, no. 3, pp.296-308, March 2007. https://doi.org/10.1109/TVLSI.2007.893608
  15. 한동일, 조현종, 최종호, 조재일, "고성능 실시간 얼굴 검출 엔진의 설계 및 구현", 전자공학회 논문지, 제47권 SP 편, 제 3호, 대한전자공학회, 2010년 3월
  16. Georghiades, A. : Yale Face Database, Center for computational Vision and Control at Yale University, http:// cvc.yale.edu/ projects/yalefaces/ yalefaces.html
  17. CMU/VASC Image Database, http: // asc.ri.cmu. edu /idb /html/ face/index.html
  18. The BioID face database:[http://www.bioid. com/ downloads /facedb /facedatabase. html]
  19. R. McCready, "Real-time face detection on a configurable hardware platform, " M.S. thesis, Dept. Elect. Comput. Eng., Univ. Toronto, Toronto, On, Canada, 2000.
  20. Duy Nguyen, David Halupka, Parham Aarabi, and Ali Sheikholeslami, "Real time Face detection and Lip feature extraction using Field-Programmable Gate Arrays", IEEE Transactions on SYSTEMS, MAN AND CYBERNETICS-ART B: CYBERNETICS, Vol. 36, no. 4, pp.902-912, AUGUST 2006. https://doi.org/10.1109/TSMCB.2005.862728
  21. Q. Wang, W. Yang, H. Wang, J. Yang and Y. Jheng, "Face Detection Using Binary Template Matching and SVM", Pacific Rim International Conference on Artificial Intelligence (PRICAI), pp. 1237-1241, China, Aug. 2006.
  22. Yea-Shuan Huang and Wei-Cheng Lie, "Face Detector with Oriented Multiple Templates", International MultiConference of Engineers and Computer Scientists, Hong Kong, March, 2008.
  23. Ermioni Marami and Anastasios Tefas, "Face Detection Using Particle Swarm Optimizations and Support Vector Machines", Hellenic Conference on Artificial Intelligence (SETN), pp. 369-374, Greece, May. 2010.