Browse > Article
http://dx.doi.org/10.9717/kmms.2016.19.8.1329

High Resolution 360 degree Video Generation System using Multiple Cameras  

Jeong, Jinwook (Dept. of Embedded Systems Engineering., Incheon National University)
Jun, Kyungkoo (Dept. of Embedded Systems Engineering., Incheon National University)
Publication Information
Journal of Korea Multimedia Society / v.19, no.8, 2016 , pp. 1329-1336 More about this Journal
Abstract
This paper develops a 360 degree video system using multiple off-the-shelf webcams and a set of embedded boards. Existing 360 degree cameras have shortcomings that they do not support real-time video generation since recorded videos should be copied to computers or smartphones which then provide stitching. Another shortcoming is that wide FoV(Field of View) cameras are not able to provide sufficiently high resolution. Moreover, resulting images are visually distorted bending straight lines. By employing an array of 65 degree FoV webcams, we were able to generate videos on the spot and achieve over 6K resolution with much less distortion. We describe the configuration and algorithms of the proposed system. The performance evaluation results of our early stage prototype system are presented.
Keywords
Panorama; Real-time; Image stitching; Virtual Reality;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Camera & Photo Imaging Show, http://www.cpplus.jp/en/, (Accessed Apr., 5, 2016).
2 Consumer Electronics Show, https://www.ces.tech/, (Accessed Apr., 5, 2016).
3 Panono, https://www.panono.com/, (accessed Mar., 20, 2016).
4 Rotopan, http://rotopan.com/, (accessed Mar., 20, 2016).
5 Pelco, https://www.pelco.com/video-surveillance-camera-security-systems/panoramic-ip/, (accessed Mar., 20, 2016).
6 Samsung Gear 360, http://www.samsung.com/sec/consumer/mobile-tablet/gear/gearseries/SM-C200NZWAKOO/, (accessed Jun., 3, 2016).
7 LG 360 Cam, http://www.lgmobile.co.kr/mobile-phone/LG-R105/LG-R105/, (accessed Jun., 3, 2016).
8 SEESAW, http://www.seesawvision.com/, (accessed Jul., 27, 2016).
9 GoPro Omni, https://ko.gopro.com/omni/, (accessed Jun., 3, 2016).
10 Argon360, http://www.argondesign.com/products/argon360/, (accessed Jul., 27, 2016).
11 J. Luo, S. Shin, H.J. Park and O. Gwun, "Stitching for Panorama based on SURF and Multi-band Blending," Journal of Korea Multimedia Society, Vol. 14, No. 2, pp. 201-209, 2011.   DOI
12 Hugin, Panorama Photo Stitcher, http://hugin.sourceforge.net/, (accessed Jul., 1, 2016).
13 M. Brown and D.G. Lowe, "Automatic Panoramic Image Stitching using Invariant Features," International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007.   DOI
14 R. Szeliski, "Image Alignment and Stitching: A Tutorial," Journal of Foundations and Trends in Computer Graphics and Vision, Vol. 2, No. 1, pp. 1-104, 2006.   DOI
15 J. Jiaya and T. Chi-Keung, "Image Stitching using Structure Deformation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 4, pp. 617-631, 2008.   DOI
16 A. Mills and G. Dudek, "Image Stitching with Dynamic Elements," Journal of Image and Vision Computing, Vol. 27, No. 10, pp. 1593-1602, 2009.   DOI
17 Y. Li and L. Ma, "A Fast and Robust Image Stitching Algorithm," Proceeding of Intelligent Control and Automation, pp. 9604-9608, 2006.
18 K.Y. Choi and K.K. Jun, "Real-time Panorama Video Generation System using Multiple Networked Cameras," Journal of Korea Information Science Society, Vol. 8, No. 42, pp. 990-997, 2015.
19 K.C. Huang, P.Y. Chien, C.A. Chien, H.C. Chang, and J.I. Guo, "A 360 Degree Panoramic Video System Design," Proceeding of VLSL Design, Automation and Test, pp. 1-4, 2014.
20 M.Tennøe, E. Helgedagsrud, M. Næss, H.K. Alstad, H.K. Stensland, V.R. Gaddam, et al., Efficient Implementation and Processing of a Real-time Panorama Video Pipeline, Master's Thesis of Oslo University, 2013.
21 D. Elan, Homography Estimation, Master's Thesis of University of British Columbia, 2007.
22 H. Bay, A. Ess, T. Tuytelaars, and L. Gool, "SURF: Speeded-Up Robust Features," Proceeding of Lecture Notes in Computer Science, pp. 404- 417, 2006.
23 P.J. Burt and E.H. Adelson, "A Multiresolution Spline with Application to Image Mosaics," ACM Transactions on Graphics, Vol. 2, No. 4, pp. 217-236, 1983.   DOI
24 H.264, http://www.divx.com/en/software/technologies/h264/, (accessed Jun., 5, 2016).