DOI QR코드

DOI QR Code

호모그래피와 추적 알고리즘을 이용한 구면 파노라마 영상 생성 방법

Spherical Panorama Image Generation Method using Homography and Tracking Algorithm

  • 투고 : 2016.12.15
  • 심사 : 2017.02.26
  • 발행 : 2017.03.28

초록

파노라마 영상은 여러 시점에서 촬영한 영상들을 대응점들의 정합을 통해 합성하여 얻은 단일 영상을 말한다. 기존의 파노라마 영상 생성 방법들은 대응점들을 구할 때 각 영상에서 지역적 불변 특징점을 추출하여 서술자를 생성하고 매칭 알고리즘을 사용한다. 동영상의 경우, 프레임 수가 많아 기존의 방법으로 파노라마 영상을 생성하는 것이 상당한 시간을 소비하고 불필요한 계산을 한다. 본 논문에서는 동영상을 입력 받아 구면 파노라마 영상을 효과적으로 생성하는 기법을 제안한다. 동영상의 프레임 간의 변화가 지역적으로 크지 않으며 연속적이라는 전제 조건으로 반복성 및 계산속도가 높은 FAST 알고리즘을 사용하여 특징점들을 추출하고, Lucas-Kanade 알고리즘을 통해 각 특징점들을 추적하여 그 주변에서 대응점을 찾는다. 모든 영상에 대해서 호모그래피를 계산하면 가운데 영상을 중심으로 호모그래피를 변경하고 영상을 와핑하여 평면 파노라마 영상을 얻는다. 마지막으로 구면 좌표계 역변환식을 통해 구면 파노라마 영상을 변환하여 얻는다. 실험을 통하여 제안하는 방법이 기존의 방법들보다 파노라마 영상을 빠르고 효과적으로 생성하는 것을 확인하였다.

Panorama image is a single image obtained by combining images taken at several viewpoints through matching of corresponding points. Existing panoramic image generation methods that find the corresponding points are extracting local invariant feature points in each image to create descriptors and using descriptor matching algorithm. In the case of video sequence, frames may be a lot, so therefore it may costs significant amount of time to generate a panoramic image by the existing method and it may has done unnecessary calculations. In this paper, we propose a method to quickly create a single panoramic image from a video sequence. By assuming that there is no significant changes between frames of the video such as in locally, we use the FAST algorithm that has good repeatability and high-speed calculation to extract feature points and the Lucas-Kanade algorithm as each feature point to track for find the corresponding points in surrounding neighborhood instead of existing descriptor matching algorithms. When homographies are calculated for all images, homography is changed around the center image of video sequence to warp images and obtain a planar panoramic image. Finally, the spherical panoramic image is obtained by performing inverse transformation of the spherical coordinate system. The proposed method was confirmed through the experiments generating panorama image efficiently and more faster than the existing methods.

키워드

참고문헌

  1. R. Szeliski, Image alignment and stitching: A tutorial, Technical Report MSR-TR-2004-92, Microsoft Research, December 2004.
  2. A. Bartoli, N. Dalal, B. Bose, and R. Horaud. "From video sequences to motion panoramas," In IEEE Workshop on Motion and Video Computing, December 2002.
  3. Y. Li, L-Q. Xu, G. Morrison, C. Nightingale, and J. Morphett. "Robust panorama from mpeg video," In IEEE International Conference on Multimedia and Expo 2003 (ICME '03), pp.81-84, 2003.
  4. D. Steedly, C. Pal, and R. Szeliski, "Efficiently Registering Video into Panoramic Mosaics," Tenth IEEE International Conference on Computer Vision (ICCV'05) IEEE, Vol.1, pp.1300-1307, 2005.
  5. M. Brown and D. Lowe, "Automatic panoramic image stitching using invariant features," International Journal of Computer Vision, Vol.74, pp.59-73, 2007. https://doi.org/10.1007/s11263-006-0002-3
  6. P. H. S. Torr and A. Zisserman, "Feature Based Methods for Structure and Motion Estimation," Vision Algorithms: Theory and Practice, Springer, Vol.1883, pp.278-294, 2000.
  7. M. Irani and P. Anandan, "About direct methods," In B. Triggs, A. Zisserman, and R. Szeliski, editors, Vision Algorithms: Theory and Practice, number 1883 in LNCS, Springer-Verlag, Corfu, Greece, pp.267-277, September 1999.
  8. D. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, Vol.60, No.2, pp.91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  9. H. Bay, T. Tuytelaars, and L. V. Gool, "Surf: Speeded up robust features," European Conference on Computer Vision, Vol.3951, pp.404-417, 2006.
  10. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," In Proc. 9th European Conference on Computer Vision (ECCV'06), Graz, May 2006.
  11. B. D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," International Joint Conference on Artificial Intelligence, pp.674-679, 1981.
  12. J. Y. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm, Technical Report, Intel Microprocessor Research Labs, 1999.
  13. M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with application to image analysis and automated cartography," Communications of the ACM, Vol.24, pp.381-395, 1981. https://doi.org/10.1145/358669.358692
  14. M. Marius and D. Lowe, "Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration," International Conference on Computer Vision Theory and Applications, Vol.1, pp.331-340, 2009.
  15. O. Enqvist, F. Jiang, and F. Kahl, "A brute-force algorithm for reconstructing a scene from two projections," Computer Vision and Pattern Recognition(CVPR), 2011.