Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Foreground object detection in projection display

프로젝션 화면에서 전경물체 검출

  • Kang Hyun (Dept. of Computer Engineering at Kyungpook National Univ.) ;
  • Lee Chang Woo (Dept. of Computer Engineering at Kyungpook National Univ.) ;
  • Park Min Ho (Computer Center at Kyungpook National Univ.) ;
  • Jung Keechul (College of Information Science at Soongsil Univ.)
  • 강현 (경북대학교 컴퓨터공학과) ;
  • 이창우 (경북대학교 컴퓨터공학과) ;
  • 박민호 (경북대학교 전산정보원) ;
  • 정기철 (숭실대학교 미디어학부)
  • Published : 2004.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

The detection of foreground objects in a projection display using color information can be hard due to changing lighting conditions and complex backgrounds. Accordingly, the current paper proposes a foreground object detection method using color information that is obtained from the input image to the Projector and an image captured by a camera above the projection display. After pixel correspondences between the two images are found by calibrating the geometry distortion and color distortion, the natural color variations are estimated for the projection display. Then, any pixel that has another variation not resulting from natural geometry or color distortion is considered a part of foreground objects, because a foreground object in a projection display changes the values of pixels. As shown by experimental results, the proposed foreground detection method is applicable to an interactive projection display system such as the DigitalDesk

색상 정보를 이용한 프로젝션 화면(projection display)상의 전경물체 검출(foreground object detection)은 조명 변화나 복잡한 배경 때문에 어렵다고 알려져 있다. 본 논문에서는 프로젝터의 입력 영상과 프로젝션 화면을 촬영한 카메라 영상들로부터 얻어진 색상 정보를 이용한 전경물체 검출 방법을 제안한다. 두 영상사이에 기하 왜곡과 색상 왜곡이 존재한다고 가정한다. 두 영상사이의 관련된 화소를 찾기 위해 투영변환방법(projective transformation)을 사용하여 기하 왜곡을 보정한다. 프로젝션화면상에 전경물체가 없을 때 관련된 화소사이의 색상 차이를 프로젝션 화면상의 자연스러운 왜곡으로 모델링한다. 이를 다항식 근사 방법(polynomial fitting)으로 모델링한다. 영상 내 어떤 위치에서 관련된 화소 사이의 차이가 주어진 다항식에서 예측된 색상차이보다 클 때 전경물체가 있는 것으로 간주한다. 실험 및 결과에서 제안된 전경물체 검출 방법이 디지털 데스크(DigitalDesk)같은 프로젝션 화면 시스템에 적용 가능하다는 것을 보였다.

Keywords

References

  1. E. H. Stupp and M. S. Brennesholtz, Projection Display, John Wiley & Son, pp. 1, 1999
  2. P. Wellner, 'Interacting with Paper on the DigitalDesk,' Communication of the ACM, vol. 35, no. 7, pp. 87-96, 1993 https://doi.org/10.1145/159544.159630
  3. P. Wellner, 'Self Calibration for the DigitalDesk,' EuroPARC Technical Report EPC, pp. 93-109, 1993
  4. P. Wellner, 'The DigitalDesk Calculator: Tactile Manipulation on a Desk Top Display,' Proceedings on ACM Symposium on User Interface Software and Technology, pp. 27-33, 1991
  5. J. Q. Stafford-Fraser, and P. Robinson, 'Bright Board: A Video-Augmented Environment,' Proceedings on CHI'96, ACM, pp. 134-141, 1996
  6. M.H. Coen, 'Design Principles for Intelligent Environments,' In Proceedings of the Fifteenth National Conference on Artificial Intelligence, Madison, WL, USA, 1998
  7. K. Oka, Y. Sato, and H. Koike, 'Real-time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems,' Proceedings on the 5th IEEE International Conference on Automatic Face and Gesture Recognition, 2002
  8. J. Rekimoto, 'SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces,' Proceedings on CHI 2002, Apr 20-25, 2002
  9. M. Ashdown and P. Robinson, 'The Escritoire: A Personal Projected Display,' Journal of WSCG, vol. 11, no. 1, pp. 33-40, 2003
  10. R. Kjeldsen, C. Pinhanez, G. Pingali, J. Hartman, T. Levas, and M. Podlaseck, 'Interacting with Steerable Projected Displays,' Proceedings on the 5th IEEE International Conference on Automatic Face and Gesture Recognition, 2002 https://doi.org/10.1109/AFGR.2002.1004187
  11. J. Whitaker and B. Benson, Standard Handbook of Video and Television Engineering, McGraw-Hill, 2000
  12. M. C. Stone, 'Color and Brightness Appearance Issues in Tiled Display,' IEEE Computer Graphics and Applications, pp. 58-66, Sep/Oct, 2001 https://doi.org/10.1109/38.946632
  13. Y. S. Kwak and L. W. MacDonald, 'Characterisation of a desktop LCD projector,' Displays, vol. 21, no. 5, pp. 179-194, Dec. 2000 https://doi.org/10.1016/S0141-9382(00)00049-4
  14. R. Sukthankar, R.G. Stockton, and M.D. Mullin, 'Smarter Presentations: Exploiting Homography in Camera-Projector Systems,' proceedings on ICCV, pp. 247-253, 2001 https://doi.org/10.1109/ICCV.2001.10045
  15. R. Hartley, and H. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2000
  16. G. Sharma, M.J. Vrhel, and H.J. Trussell, 'Color Imaging for Multimedia,' Proceedings of the IEEE, vol. 86, no. 6, June, 1998 https://doi.org/10.1109/5.687831
  17. D.C. Lay, Linear Algebra and Its Applications, Addision Wesley, pp.376-378, 1994
  18. J. Q. Stafford-Fraser, 'Video-Augmented Environments,' Thesis for the degree of doctor of philosophy in University of Cambridge, February, 1996