Browse > Article
http://dx.doi.org/10.5909/JBE.2017.22.1.51

Enhancement on 3 DoF Image Stitching Using Inertia Sensor Data  

Kim, Minwoo (Myongji University Computer Engineering Department)
Kim, Sang-Kyun (Myongji University Computer Engineering Department)
Publication Information
Journal of Broadcast Engineering / v.22, no.1, 2017 , pp. 51-61 More about this Journal
Abstract
This paper proposes a method to generate panoramic images by combining conventional feature extraction algorithms (e.g., SIFT, SURF, MPEG-7 CDVS) with sensed data from an inertia sensor to enhance the stitching results. The challenge of image stitching increases when the images are taken from two different mobile phones with no posture calibration. Using inertia sensor data obtained by the mobile phone, images with different yaw angles, pitch angles, roll angles are preprocessed and adjusted before performing stitching process. Performance of stitching (e.g., feature extraction time, inlier point numbers, stitching accuracy) between conventional feature extraction algorithms is reported along with the stitching performance with/without using the inertia sensor data.
Keywords
Image stitching; video stitching; panoramic video; ultra wide viewing video; sensor-based stitching;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Ahn, Yang-Keun, Hong, Ji-Man, "Nonlinear Optimization Method for Multiple Image Registration," Journal of Broadcast Engineering, Vol. 17, no. 4, pp. 634-639, 2012.   DOI
2 Kwon, Oh Seol, "Image Matching Based on Robust Feature Extraction for Remote Sensing Haze Images," Journal of Broadcast Engineering, Vol. 21, no. 2, pp. 272-275, 2016.   DOI
3 D. G. Lowe, "Distinctive Image Features from Scale-invariant Keypoints," International Journal of Computer Vision, 60, 2, 91-110, 05, 2004.   DOI
4 H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Speeded-Up Robust Features (SURF)," Similarity Matching in Computer Vision and Multimedia, 110, 3, 346-359, 06, 2008.
5 H. Bay, T. Tuytelaars, and L. V. Gool, "SURF: Speeded Up Robust Features," 9th European Conference on Computer Vision, 404-417, 05, 2006.
6 P. M. Panchal, S. R. Panchal, and S. K. Shah, "A Comparison of SIFT and SURF," International Journal of Innovative Research in Computer and Communication Engineering, 1, 2, 323-327, 04, 2013.
7 L. Juan and O. Gwun, "A Comparison of SIFT, PCA-SIFT and SURF," International Journal of Image Processing (IJIP), 3, 4, 143-152, 2009.
8 CDVS1, "Call for Proposals for Compact Descriptors for Visual Search," N12201, Turin, Italy, ISO/IEC JTC1/SC29/WG11, 2011.
9 Ling-Yu Duan, Feng Gao, Jie Chen, Jie Lin, and Tiejun Huang, "Compact Descriptors for Mobile Visual Search and MPEG CDVS Standardization," IEEE International Symposium on Circuits and Systems, 885-888, 05, 2013.
10 H. K. Kim, "MPEG-7 CDVS Standardization Media Searching under Mobile Environment," Telecommunications Technology Association, 144, 35-38, 2012.
11 M. A. Fischler and R. C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Communications of the ACM, 24, 6, 381-395, 06, 1981.   DOI
12 E. Dubrofsky, "Homography Estimation," University of British Columbia, 2009.
13 Y. H. Park and O. S. Kwon, "Multiple Homographies Estimation using a Guided Sequential RANSAC," The Korea Contents Association, 10, 7, 10-22, 2010, 07.
14 R. Szeliski, "Image Alignment and Stitching: A Tutorial," Foundations and Trends(R) in Computer Graphics and Vision, 2, 1, 1-104, 2006.   DOI
15 M. Brown and D. G. Lowe, "Automatic Panoramic Image Stitching using Invariant Features," International Journal of Computer Vision, 74, 1, 59-73, 2007, 12.   DOI
16 J. Heikkila and O. Silven, "A Four-step Camera Calibration Procedure with Implicit Image Correction," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1106-1112, 06, 1997
17 Panorama VR, from http://www.uok3d.com/bussiness/panorama.php
18 K. M. Park, W. H. Seok, and K. H. Lee, "Sensor Industry and Major Promising Sensor Market and Technology Trend," Electronics and Telecommunications Research Institute, 2015, 02.
19 S. H. Lee, "State and the Issues of IOT," Institute for Information & communications Technology Promotion, 2014, 04.
20 Park, Siyoung; Kim, Jongho; Yoo, Jisang, "Fast Stitching Algorithm by using Feature Tracking," Journal of Broadcast Engineering, Vol. 20, no 5 pp. 728-737, 2015.   DOI