Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

A Euclidean Reconstruction of 3D Face Data Using a One-Shot Absolutely Coded Pattern

단일 투사 절대 코드 패턴을 이용한 3차원 얼굴 데이터의 유클리디안 복원

  • Kim, Byoung-Woo (Dept of Electrical and Electronic Eng. Yonsei University) ;
  • Yu, Sun-Jin (Dept of Electrical and Electronic Eng. Yonsei University) ;
  • Lee, Sang-Youn (Dept of Electrical and Electronic Eng. Yonsei University)
  • 김병우 (연세대학교 전기및전자공학부, 생체인식연구센터) ;
  • 유선진 (연세대학교 전기및전자공학부, 생체인식연구센터) ;
  • 이상윤 (연세대학교 전기및전자공학부, 생체인식연구센터)
  • Published : 2005.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a rapid face shape acquisition system. The system is composed of two cameras and one projector. The technique works by projecting a pattern on the object and capturing two images with two cameras. We use a 'one shot' system which provides 3D data acquired by single image per camera. The system is good for rapid data acquisition as our purpose. We use the 'absolutely coded pattern' using the hue and saturation of pattern lines. In this 'absolutely coded pattern' all patterns have absolute identification numbers. We solve the correspondence problem between the two images by using epipolar geometry and absolute identification numbers. In comparison to the 'relatively coded pattern' which uses relative identification numbers, the 'absolutely coded pattern' helps obtain rapid 3D data by one to one point matching on an epipolar line. Because we use two cameras, we obtain two images which have similar hue and saturation. This enables us to have the same absolute identification numbers in both images, and we can use the absolutely coded pattern for solving the correspondence problem. The proposed technique is applied to face data and the total time for shape acquisition is estimated.

본 논문에서는 3차원 얼굴 인식기에서의 입력 데이터로 적합한 얼굴 데이터의 유클리디안 복원 시스템을 제안한다. 카메라 영상을 통한 유클리디안 복원을 위해서는 카메라의 보정정보와 복원할 특징 점의 대응 쌍 정보가 필요한데, 보정정보는 시스템의 변경이 없다면 불변한다. 따라서 고속의 유클리디안 복원을 위해서는 스테레오 영상간의 대응 쌍 정보 획득이 가장 중요하다. 시스템은 두 개의 카메라와 프로젝터 한 대로 구성하며, 피사체에 패턴을 투사하고 두 개의 카메라로부터 영상을 획득함으로써 동작한다. 사용 패턴은 단일 투사 줄무늬 패턴을 사용하며 줄무늬의 색도 정보와 채도 정보를 이용하여 '절대 코드 패턴'을 생성한다. 사용 시스템은 두 개의 카메라를 사용하기 때문에 색도 정보와 채도 정보가 비슷한 두 개의 영상을 얻을 수 있으며 이것은 획득한 두 개의 영상에 있는 줄무늬들에 대해 동일한 절대 라벨을 얻을 수 있게 한다. 절대 라벨링 된 줄무늬는 에피폴라 라인(epipolar line)상의 점들과 일대일 정합을 통해 고속의 3차원 데이터 복원을 가능하게 한다. 제안 방식은 얼굴 데이터에 적용되었으며 정확도와 총 소요 시간의 측정을 통해 제안 방식이 기존 방식에 비해 정확도 면에서 뒤지지 않으면서도 복원 속도 면에서 장점을 가짐을 확인할 수 있었다.

Keywords

References

  1. A. Blake, D. McCowen, H. R. Lo, and P. J. Lindsey, 'Trinocular Active Range-Sensing', IEEE Trans. On Pattern Analysis and Machine Intelligence, Vol. 15, no.5, pp 477-483, May 1993 https://doi.org/10.1109/34.211467
  2. Peiyi Niu, Xiang He, and Andrew K.C. Wong 'Dense Depth Map Acquisition by Hierarchic Structured Light', Proceedings of the 2002 IEEE international conference on Intelligent Robots and Systems, pp 165-171, October 2002 https://doi.org/10.1109/IRDS.2002.1041383
  3. Chin-Seng Chua, Yeong Khing Ho, and Y.Liang, 'Rejection of mismatched correspondences along the affine epipolar line', Image and Vision Computing 18 (2000), pp 445-462 https://doi.org/10.1016/S0262-8856(99)00027-X
  4. Nicolas Alvertos, Dragana Brzakovic, and Ravael C. Gonzalez, 'Camera Geometries for Image Matching in 3-D Machine Vision', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, no.9, pp 897-915, September 1989 https://doi.org/10.1109/34.35494
  5. Yuichi Ohta, Takeo Kanade, 'Stereo by Intra and Inter Scanline Search Using Dynamic Programming', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI 7, no.2, March 1985
  6. Thomas P.Koninckx, Andreas Griesser, and Luc Van Gool, 'Real-time Range Scanning of Deformable Surface by Adaptively Coded Structured Light', Proceedings of the Fourth international conference on 3-D Digital Image Modeling, 2003 https://doi.org/10.1109/IM.2003.1240262
  7. J.Batlle, E. Mouaddib, and J,Salvi, 'Recent Progress in Coded Structured Light as a Technique to Solve the Correspondence Problem: A Survey', Pattern Recognition, Vol. 31, no.7, pp 963-982, 1998 https://doi.org/10.1016/S0031-3203(97)00074-5
  8. Li Zhang, Brian Curless, and Steven M. Seitz, 'Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming', Proceedings of the First international symposium on 3D Data Processing Visualization and Transmission https://doi.org/10.1109/TDPVT.2002.1024035
  9. J.Salvi, J.Batlle, and E.Mouaddib, 'A robust-coded pattern projection for dynamic 3D scene measurement', Pattern Recognition Letters 19 (1998), pp 1055-1065 https://doi.org/10.1016/S0167-8655(98)00085-3
  10. Chu-Song Chen, Yi-Ping Hung, Chiann-Chu Chiang, and Ja-Ling Wu, 'Range data acquisition using color structured lighting and stereo vision', Image and Vision Computing 15 (1997), pp 445-456 https://doi.org/10.1016/S0262-8856(96)01148-1
  11. Johnny Park, Guilherme N. DESouza, and Avinash C. Kak, 'Dual-Beam Structured-Light Scanning for 3-D Object Modeing', pp 65-72, 2001 IEEE https://doi.org/10.1109/IM.2001.924399
  12. Sonkp Osawa, Ryoshu Furutani, Kiyoshi Takamasu, Shigeo Ozono, and Hidemitsu Asano, '3-D shape measurement by self-referenced pattern projection method', Measurement 26 (1999), pp 157-166 https://doi.org/10.1016/S0263-2241(99)00029-9
  13. Joaquim Salvi, Xavier Armangue, and Joan Batlle, 'A comparative review of camera calibrating methods with accuracy evaluation', Pattern Recognition 35 (2002) pp 1617-1635 https://doi.org/10.1016/S0031-3203(01)00126-1
  14. Emanuele Trucco and Alessandro Verri, 'Introductory Techniques for 3-D Computer Vision', Prentice Hall, 1998
  15. Dongjoe Shin and Jaihie Kim. 'Point to Point Calibration Method of Structured Light for Facial Data Reconstruction', LNCS on International Conference on Biometric Authentication (ICBA). July. (2004) 200-206 https://doi.org/10.1007/b98225
  16. Dongjoe Shin.: The hard calibration of structured light for the Euclidian reconstruction of face data. Master's Thesis. Dept. of Electrical and Electronic Engineering. Yonsei University. (2004)
  17. Boyer, K.L. and A.C.Kak. 'Color-Encoded Structured Light for Rapid Active Ranging'. Pattern Analysis and Machine Intelligence 9(1), pp14-28, 1987 https://doi.org/10.1109/TPAMI.1987.4767869
  18. D. Caspi, N. Kiryati, J. Shamir, Range imaging with adaptive color structured light, Pattern analysis and machine intelligence 20 (5) pp.470-480, 1998 https://doi.org/10.1109/34.682177
  19. James Davis, Diego Nehab, Ravi Ramamoorthi, Szymon Rusinkiewicz. 'Spacetime Stereo: A Unifying Framework for Depth from Triangulation,' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 2. pp. 296-302, February 2005 https://doi.org/10.1109/TPAMI.2005.37
  20. J. Salvi, J. Pags, J. Batlle. 'Pattern Codification Strategies in Structured Light Systems'. Pattern Recognition 37(4), pp.827-849, April 2004 https://doi.org/10.1016/j.patcog.2003.10.002