Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Improved Feature Descriptor Extraction and Matching Method for Efficient Image Stitching on Mobile Environment

모바일 환경에서 효율적인 영상 정합을 위한 향상된 특징점 기술자 추출 및 정합 기법

  • 박진양 (인하공업전문대학 컴퓨터정보과) ;
  • 안효창 (단국대학교 미디어콘텐츠연구원)
  • Received : 2013.10.04
  • Accepted : 2013.10.15
  • Published : 2013.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, the mobile industries grow up rapidly and their performances are improved. So the usage of mobile devices is increasing in our life. Also mobile devices equipped with a high-performance camera, so the image stitching can carry out on the mobile devices instead of the desktop. However the mobile devices have limited hardware to perform the image stitching which has a lot of computational complexity. In this paper, we have proposed improved feature descriptor extraction and matching method for efficient image stitching on mobile environment. Our method can reduce computational complexity using extension of orientation window and reduction of dimension feature descriptor when feature descriptor is generated. In addition, the computational complexity of image stitching is reduced through the classification of matching points. In our results, our method makes to improve the computational time of image stitching than the previous method. Therefore our method is suitable for the mobile environment and also that method can make natural-looking stitched image.

최근 모바일 산업이 발달하고 성능이 향상되어 생활 속에서 모바일 기기의 사용량이 늘고 있다. 현재 모바일 기기에는 고성능 카메라를 장착하고 있어 데스크톱에서 수행하던 영상 정합을 모바일 기기에서 수행할 수 있다. 그러나 모바일 기기는 제한된 하드웨어 자원을 가지고 있어 영상 정합을 수행하기에 연산량이 많다. 따라서 본 논문에서는 모바일 환경에서 효율적인 영상 정합을 위한 향상된 특징점 기술자 추출 및 정합 기법 제안한다. 특징점 기술자 생성시 방향 윈도우 확장 및 기술자의 차원을 줄여 정확도를 높이면서 연산량을 감소시킨다. 또한 정합점 분류 기법을 통하여 영상 정합의 연산량을 감소시킨다. 실험결과 기존의 방법보다 영상 정합 속도가 향상되어 모바일 환경에 적합하면서도 자연스러운 영상을 생성할 수 있었다.

Keywords

References

  1. G. Takacs, V. Chandrasekhar, N. Gelfand, Y. Xiong, W. Chen, T. Bismpigiannis, R. Grzeszczuk, K. Pulli, and B. Girod, "Outdoors Augmented Reality on Mobile Phone Using Loxel-Bbased Visual Feature Organization", Proc. of the 1st ACMinternational conference on Multimedia Information Retrieval, New York, NY, USA, pp. 427-434, Oct. 2008.
  2. W. Chen, Y. Xiong, J. Gao, N. Gelfand, and R. Grzeszczuk, "Efficient Extraction of Robust Image Features on Mobile Devices", Proc. of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Washington, DC, USA, pp. 1-2, Nov. 2007.
  3. Y. Xiong, K. Pulli, "Fast Image Stitching and Editing for Panorama Painting on Mobile Phones", IEEE International Workshop on Mobile Vision in Conjunction with CVPR'2010 (IWMV2010), San Francisco, USA, pp. 298-306, June 18, 2010.
  4. D. Chen, S. S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod, "Robust Image Retrieval Using Multiview Scalable Vocabulary Trees", in Visual Communications and Image Processing, Majid Rabbani and Robert L. Stevenson, Eds., vol. 7257, pp. 72570V, Jan. 2009.
  5. R. Szeliski, "Image Alignment and Stitching: A Tutorial", Preliminary draft, Jan. 2005.
  6. P. F. McLauchlan, A. Jaenicke, "Image Mosaicing Using Sequential Bundle Adjustment", Image Vision Computer, vol. 20, no. 9-10, pp. 751-759, Aug. 2002. https://doi.org/10.1016/S0262-8856(02)00064-1
  7. J. P. Snyder, "Geometry of Mapping Satellite", PE&RS, vol. 48, no. 10, pp. 1593-1602, Oct. 1982.
  8. R. Szeliski, "Image Alignment and Stitching: A Tutorial", Technical Report, MSR-TR-2004-92, Microsoft Research, Dec. 2004.
  9. Y. Xiong and K. Pulli, "Gradient Domain Iimage Blending and Implementation on Mobile Devices", In MobiCase, Oct. 2009.
  10. S. Rhee, "Efficient Image Stitching Using Fast Feature Descriptor Extraction and Matching", KIPS Transactions on Computer and Communication Systems, Vol.2, No.1, pp. 65-70, Jan. 2013. https://doi.org/10.3745/KTSDE.2013.2.1.065
  11. C. Tang and Y. Dong, "Automatic Registration based on Improved SIFT for Medical Microscopic Sequence Images", Second International Symposium on Intelligent Information Technology Application, vol. 1, pp. 580-583, Dec. 20-22, 2008.
  12. Y. Ke and R. Sukthankar, "PCA-SIFT: A More Distinctive Representation for Local Image Descriptors", Proc. Conf. Computer Vision and Pattern Recognition, pp. 511-517, June 27-July 2, 2004.
  13. H. Bay, T. Tuytelaars, "SURF: Speeded Up Robust Features", Computer Vision and Image Understanding (CVIU), vol. 110, no. 3, pp. 346-359, June 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  14. M. Brown, D. Lowe, "Invariant Features from Interest Point Groups", In BMVC, Sep. 2-5, 2002.
  15. T. Schenk, Digital photogrammetry, vol. 1, Terrascience, 1999.
  16. P. Viola, M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Feature", In CVPR(1), pp. 511-518, Dec. 8-14, 2001.
  17. Image Data Set, http://www.visualsize.com/