Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.5.685

Parallax Distortion Detection and Correction Method for Video Stitching by using LDPM Image Assessment  

Rhee, Seongbae (Department of Electronic Engineering, Kyung Hee University)
Kang, Jeonho (Department of Electronic Engineering, Kyung Hee University)
Kim, Kyuheon (Department of Electronic Engineering, Kyung Hee University)
Publication Information
Journal of Broadcast Engineering / v.25, no.5, 2020 , pp. 685-697 More about this Journal
Abstract
Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.
Keywords
Video Stitching; Parallax Distortion; Seam Optimization; LDPM; Blending;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Wang, Zhou, et al. "Image quality assessment: from error visibility to structural similarity." IEEE transactions on image processing, Vol.13, No.4, pp.600-612, 2004.   DOI
2 Jeonho Kang, Junsik Kim, SangIL Kim, and Kyuheon Kim, "Method of Video Stitching based on Minimal Error Seam", The Korean Institute of Broadcast and Media Engineers, Vol.24, No.1, pp.142-152, January, 2019.
3 R. Szeliski, "Image Alignment and Stitching: A Tutorial." Foundations and Trends in Computer Graphics and Computer Vision, Vol. 2, No.1, 2006.
4 Kang, Jeonho, et al. "Minimum Error Seam-Based Efficient Panorama Video Stitching Method Robust to Parallax." IEEE Access 7 (2019): 167127-167140.   DOI
5 Wei, L. Y. U., et al. "A survey on image and video stitching." Virtual Reality & Intelligent Hardware Vol. 1, No.1 pp.55-83, 2019.   DOI
6 Levin, Anat, et al. "Seamless image stitching in the gradient domain." European Conference on Computer Vision. Springer, Berlin, Heidelberg, 2004.
7 Bujnak, Martin, and Radim Sara. "A robust graph-based method for the general correspondence problem demonstrated on image stitching." 2007 IEEE 11th International Conference on Computer Vision. IEEE, 2007.
8 Zaragoza, Julio, et al. "As-projective-as-possible image stitching with moving DLT." Proceedings of the IEEE conference on computer vision and pattern recognition. 2013.
9 Zhi, Qi, and Jeremy R. Cooperstock. "Toward dynamic image mosaic generation with robustness to parallax." IEEE Transactions on Image Processing, pp.366-378, Vol.21, No.1, 2011.   DOI
10 Qureshi, H. S., et al. "Quantitative quality assessment of stitched panoramic images." IET image processing, Vol.6, no.9, pp.1348-1358, 2012.   DOI
11 Zhang, Guofeng, et al. "Multi-viewpoint panorama construction with wide-baseline images." IEEE Transactions on Image Processing, Vol.25, No.7, pp.3099-3111, 2016.   DOI
12 Lin, Kaimo, et al. "Seagull: Seam-guided local alignment for parallax-tolerant image stitching." European conference on computer vision. Springer, Cham, 2016.
13 Gao, Junhong, et al. "Seam-Driven Image Stitching." Eurographics (Short Papers). 2013.
14 Abdukholikov, Murodjon, and Taegkeun Whangbo. "Fast image stitching method for handling dynamic object problems in Panoramic Images." KSII Transactions on Internet & Information Systems, Vol.11, No.11, 2017.
15 Rhee, Seongbae, Jeonho Kang, and Kyuheon Kim. "Local Differential Pixel Assessment Method for Image Stitching." Journal of Broadcast Engineering, Vol.24, No.5, pp.775-784, 2019   DOI
16 Kwatra, Vivek, et al. "Graphcut textures: image and video synthesis using graph cuts." ACM Transactions on Graphics (ToG), Vol.22, No.3, pp.277-286. 2003.   DOI