Pan-Tilt-Zoom 카메라를 이용한 파노라마 배경 생성과 객체 추적

Panorama Background Generation and Object Tracking using Pan-Tilt-Zoom Camera

  • 백인호 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 임재현 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 박경주 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 백준기 (중앙대학교 첨단영상대학원 영상공학과)
  • Paek, In-Ho (Dept. of Image Engineering, Graduate School of Advanced Imaging Science, Multimedia, and Film Chung-Ang University) ;
  • Im, Jae-Hyun (Dept. of Image Engineering, Graduate School of Advanced Imaging Science, Multimedia, and Film Chung-Ang University) ;
  • Park, Kyoung-Ju (Dept. of Image Engineering, Graduate School of Advanced Imaging Science, Multimedia, and Film Chung-Ang University) ;
  • Paik, Jun-Ki (Dept. of Image Engineering, Graduate School of Advanced Imaging Science, Multimedia, and Film Chung-Ang University)
  • 발행 : 2008.05.25

초록

본 논문은 전 방향을 감시할 수 있는 Pan-Tilt-Zoom(PTZ) 카메라를 이용한 파노라마 배경 생성과 객체 추적 방법을 제안한다. 제안된 방법은 연속되는 두 영상의 외곽 영역에서 미리 정한 지역만 위상정합(phase correlation)을 하여 카메라의 지역 움직임을 빠르게 추정하고 벡터 양자화를 통하여 움직임 추정 오차를 최소화 한다. 추정된 움직임 값을 이용하여 겹침 영역이 존재하는 영상들을 획득하여 실린더에 투영시키고 영상을 재 정렬함으로써 파노라마 배경 영상을 생성할 수 있다. 객체 추적은 미리 생성된 파노라마 배경과 입력 영상의 차분 방법을 이용하여 배경과 객체를 분리하고 객체의 움직임을 추적한다. 제안된 객체 추적 방법은 PTZ 카메라를 이용하여 빠르고 안정적인 배경 생성이 가능하고, 전방향의 객체를 지속적으로 추적하는 것이 가능하다. 제안된 방법은 실시간 처리가 가능하며 넓은 감시 지역에서 객체의 형태를 추적하거나 얼굴인식과 같은 분야에서 이용될 수 있을 것이다.

This paper presents a panorama background generation and object tracking technique using a Pan-Tilt-Zoom camera. The proposed method estimates local motion vectors rapidly using phase correlation matching at the prespecified multiple local regions, and it makes minimized estimation error by vector quantization. We obtain the required image patches, by estimating the overlapped region using local motion vectors, we can then project the images to cylinder and realign the images to make the panoramic image. The object tracking is performed by extracting object's motion and by separating foreground from input image using background subtraction. The proposed PTZ-based object tracking method can efficiently generated a stable panorama background, which covers up to 360 degree FOV The proposed algorithm is designed for real-time implementation and it can be applied to many commercial applications such as object shape detection and face recognition in various surveillance video systems.

키워드

참고문헌

  1. S. Peleg and J. Herman, "Panoramic Mosaics by manifold projection," Proc, Computer Society Conf.Computer Vision and Pattern Recognition, vol. 1, no. 1, pp. 338-343, June 1997
  2. S. Kang, J. Paik, A. Koschan, B. Abidi, and A. Abidi, "Real-time video tracking using PTZ cameras," Proc. SPIE 6th Interational Conference on Quality Control by Artificial Vision, vol. 5132, pp. 103-111, 2003
  3. P. Azzari, L. Stefano, and A. Bevilacqua, "An effective real-time mosaicing algorithm apt to detect motion through background subtraction using a PTZ camera," IEEE Conf. Advanced Video and Signal-Based Surveillance, pp. 511-516, 2005
  4. R. Canals, A. Roussel, H. Famechon, and S. Treuillet, "A biprocessor-oriented vision-based target tracking system," IEEE Trans. Industrial Electronics, vol. 49, no. 2, pp. 500-506, 2002 https://doi.org/10.1109/41.993283
  5. J. Paik, Y. Park, and D. Kim, "An adaptive motion decision system for digital image stabilizer based on edge pattern matching," IEEE Trans. Consumer Electronics, vol. 38, pp. 607-615, 1992 https://doi.org/10.1109/30.156744
  6. F. Vella, A. Castorina, Massimo, and G. Messina, "Digital image stabilization by adaptive block motion vectors filtering," IEEE Trans. Consumer Electronics, vol. 48, pp. 796-801, 2002 https://doi.org/10.1109/TCE.2002.1037077
  7. S. Erturk, "Digital Image Stabilization with sub-image phase correlation based global motion estimation," IEEE Trans. Consumer Electronics, vol. 49, pp. 1320-1325, 2003 https://doi.org/10.1109/TCE.2003.1261235
  8. L. Xu and X. Lin, "Digital image stabilization based on circular block matching," IEEE Trans. Consumer Electronics, vol. 52, no. 2, pp. 566-574, 2006 https://doi.org/10.1109/TCE.2006.1649681
  9. G. Scotti, L. Marcenaro, C. Coelho, F. Selvaggi, and C. Regazzoni, "Dual camera intelligent sensor for high definition 360 degrees surveillance," IEE Proc. Vision, Image and Signal Processing, vol. 152, no. 2, pp. 250-257, 2005 https://doi.org/10.1049/ip-vis:20041302
  10. Y. Yao, B. Abidi, and M. Abidi, "Fusion of Omni-directional and PTZ camera for accurate cooperative tracking," Proc. IEEE International Conference on Video and Signal Based Surveillance, pp. 46, 2006
  11. H. Foroosh, J. Zerubia, and M. Berthod, "Extension of phase correlation to sub-pixel registration," IEEE Trans. Image Processing, vol. 11, pp. 188-200, 2002 https://doi.org/10.1109/83.988953