Browse > Article
http://dx.doi.org/10.9723/jksiis.2017.22.3.027

Stitching Method of Videos Recorded by Multiple Handheld Cameras  

Billah, Meer Sadeq (서울과학기술대학교 전기정보공학과)
Ahn, Heejune (서울과학기술대학교 전기정보공학과)
Publication Information
Journal of Korea Society of Industrial Information Systems / v.22, no.3, 2017 , pp. 27-38 More about this Journal
Abstract
This Paper Presents a Method for Stitching a Large Number of Images Recorded by a Large Number of Individual Users Through a Cellular Phone Camera at a Venue. In Contrast to 360 Camera Solutions that Use Existing Fixed Rigs, these Conditions must Address New Challenges Such as Time Synchronization, Repeated Transformation Matrix Calculations, and Camera Sensor Mismatch Correction. In this Paper, we Solve this Problem by Updating the Transformation Matrix Using Time Synchronization Method Using Audio, Sensor Mismatch Removal by Color Transfer Method, and Global Operation Stabilization Algorithm. Experimental Results Show that the Proposed Algorithm Shows better Performance in Terms of Computation Speed and Subjective Image Quality than that of Screen Stitching.
Keywords
Stitching; Smartphone Video; Image Processing; 360 Degree Video;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Ko H.-S., “Cyberspace and Protection of Personal Data,” The Journal of Internet Electronic Commerce Research, Vol. 3, No. 2, pp. 37-63, 2003.
2 Joo J.-H., “The Development of a Cyber World Culture Expo and Electronic Tourism Market System,” The Journal of Information Systems, Vol. 9, No. 1, pp. 87-108, 2000.
3 Brown, M. and Lowe, D.G., “Automatic Panoramic Image Stitching Using Invariant Features,” International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007.   DOI
4 Collection of $360^{\circ}$ Video Rigs, https://thefulldomeblog.com/2015/11/17/collection-of-360-video-rigs/ (last access, 2017. May, 26)
5 PTGui, https://www.ptgui.com/(last access, 2017. May, 26)
6 Kolor, http://www.kolor.com/panotour/ (last access, 2017. May, 26)
7 Vahana Video-Stitch, http://www.video-stitch.com/(last access, 2017. May, 26)
8 ICoSOLE EU project, http://icosole.eu (last access, 2017. May, 26)
9 El-Saban, M.A., Refaat, M., Kaheel, A. and Abdul-Hamid, A., "Stitching Videos Streamed by Mobile Phones in Real-Time," The 17th ACM International Conference on Multimedia, pp. 1009-1010. 2007
10 Reinhard E., Ashikhmin M., Gooch B., and Shirley P., "Color Transfer between Images. In Applied Perception," IEEE Computer Graphics and Applications, September/October 2001.
11 Learning OpenCV: Color Transfer Between Images algorithm. available online http://www.programering.com/a/MzM4gDMwATU.html
12 Ruderman D.L., Cronin T.W., and Chiao C.C., "Statistics of Cone Responses to Natural Images: Implications for Visual Coding," J. Optical Soc. of America, Vol. 15, No. 8, pp. 2036-2045, 1988   DOI
13 Nghia Ho, Simple Video Stabilization Using OpenCV. At http://nghiaho.com/?p=2093
14 Shi J. and Tomasi. C. "Good Features to Track," IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, 1994.
15 Jean-Yves Bouguet. "Pyramidal Implementation of the Lucas Kanade Feature Tracker," Intel Corporation, Vol. 5, No. 4, 2001
16 Lucas, B., and Kanade, T. "An Iterative Image Registration Technique with an Application to Stereo Vision," the 7th International Joint Conference on Artificial Intelligence, pp. 674-679, 1981.
17 Bano, S., and Cavallaro, A., "ViComp: Composition of User-Generated Videos." Multimedia Tools and Applications Vol, 75, No. 12, pp. 7187-7210, 2016.   DOI
18 Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P., "Image Quality Assessment: from Error Visibility to Structural Similarity," IEEE Transactions on Image Processing, Vol. 13. No. 4, pp. 600-612, 2004.   DOI