Browse > Article
http://dx.doi.org/10.3837/tiis.2014.10.015

A Novel Video Stitching Method for Multi-Camera Surveillance Systems  

Yin, Xiaoqing (College of Information System and Management, National University of Defense Technology)
Li, Weili (College of Information System and Management, National University of Defense Technology)
Wang, Bin (Facility Design and Instrumentation Institute, China Aerodynamics Research and Development Center)
Liu, Yu (College of Information System and Management, National University of Defense Technology)
Zhang, Maojun (College of Information System and Management, National University of Defense Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.10, 2014 , pp. 3538-3556 More about this Journal
Abstract
This paper proposes a novel video stitching method that improves real-time performance and visual quality of a multi-camera video surveillance system. A two-stage seam searching algorithm based on enhanced dynamic programming is proposed. It can obtain satisfactory result and achieve better real-time performance than traditional seam-searching methods. The experiments show that the computing time is reduced by 66.4% using the proposed algorithm compared with enhanced dynamic programming, while the seam-searching accuracy is maintained. A real-time local update scheme reduces the deformation effect caused by moving objects passing through the seam, and a seam-based local color transfer model is constructed and applied to achieve smooth transition in the overlapped area, and overcome the traditional pixel blending methods. The effectiveness of the proposed method is proved in the experiements.
Keywords
Video stitching; two-stage seam searching; local update of seam; seam-based local color transfer model; smooth transition;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Cuiyin Liu , Peng Cheng , Shu-qing Chen , Cuiwei Wang , Fenghong Xiang, "A Novel Multifocus Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform," KSII Transactions on Internet and Information Systems (TIIS), Vol.7 No.3, 539-557, 2013. Article (CrossRef Link).   과학기술학회마을   DOI   ScienceOn
2 Y. Boykov, O. Veksler and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 11, 1222 - 1239 , 2001. Article (CrossRef Link).   DOI   ScienceOn
3 M. Uyttendaele, A. Eden. and R. Szeliski, "Eliminating Ghosting and Exposure Artifacts in Image Mosaics," in Proc. of Proceedings of Conference on Computer Vision and Pattern Recognition (CVPR), 2, pp. 509-516, 2001. Article (CrossRef Link).
4 J. Davis, "Mosaics of scenes with moving objects," in Proc. of Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 354 - 360, 1998. Article (CrossRef Link).
5 Hua Gu, Yue Yu, and Weidong Sun, "A New Optimal Seam Selection Method for Airborne Image Stitching," in Proc. of Proceedings of International Workshop on Imaging Systems and Techniques, pp. 159-163, 2009. Article (CrossRef Link).
6 S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Transactions on Graphics, Vol. 26, No. 3, pp. 1-9, 2007. Article (CrossRef Link).
7 Alec Mills and Gregory Dudek, "Image stitching with dynamic elements," Image and Vision Computing, Vol. 27, No. 10, pp. 1593-1602, 2009. Article (CrossRef Link).   DOI
8 M. Brown and D. G. Lowe. "Recognising Panoramas," in Proc. of Proceedings of International Conference Computer Vision (ICCV), Vol. 2, pp. 1218-1225, 2003. Article (CrossRef Link).
9 Richard Szeliski, "Image Alignment and Stitching: A Tutorial," Technical Report MSR-TR-2004-92, pp. 1-68, 2004. Article (CrossRef Link).
10 Peter J. B. and Edward H. A., "A Multi-resolution Spline with Application to Image Mosaics," ACM Transactions on Graphics, Vol. 2, No. 4, pp. 217-236, 1983. Article (CrossRef Link).   DOI
11 Wei Xu and Jane Mulligan, "Panoramic video stitching from commodity HDTV cameras," Multimedia Systems, Vol. 19, No. 5, 407-426, 2013. Article (CrossRef Link).   DOI   ScienceOn
12 R. Szeliski, "Image mosaicing for tele-reality applications," in Proc. of Proceedings of 2nd IEEE Workshop on Applications of Computer Vision, 1994, pp. 44-53. Article (CrossRef Link).
13 D. Comaniciu and P. Meer, "Mean shift: A Robust Approach toward feature space analysis," IEEE transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 5, pp. 603-619, 2002. Article (CrossRef Link).   DOI   ScienceOn
14 Young-Seob Jeong, Chae-Gyun Lim, Byeong-Soo Jeong, Ho-Jin Choi, "Topic Masks for Image Segmentation," KSII Transactions on Internet and Information Systems (TIIS), Vol.7, No.12, 3274-3292, 2013. Article (CrossRef Link).   과학기술학회마을   DOI   ScienceOn
15 Jingbo Zhou, Shangbing Gao, Zhong Jin, "A New Connected Coherence Tree Algorithm For Image Segmentation," KSII Transactions on Internet and Information Systems (TIIS), VOL. 6, NO. 4, 547-565, 2012. Article (CrossRef Link).
16 M. El-Saban, M. Izz, A. Kaheel and M. Refaat, "Improved optimal seam selection blending for fast video stitching of videos captured from freely moving devices," in Proc. of Proceedings of 18th IEEE International Conference on Image Processing, pp. 1481 - 1484, 2011. Article (CrossRef Link).
17 Yong Yang , Wenjuan Zheng, Shuying Huang, "A Novel Automatic Block-based Multi-focus Image Fusion via Genetic Algorithm," KSII Transactions on Internet and Information Systems (TIIS), Vol.7 No.7, 1671-1689, 2013. Article (CrossRef Link).   과학기술학회마을   DOI   ScienceOn
18 Kwang Wook Lee, Seung Won Jung, Seung Kyun Kim, and Sung Jea KO, "A Novel Content-Aware Stitching Algorithm for Real-time Video Sequences," IEICE Transactions on Information and System, Vol. E94-D, No.2, pp. 357-362, 2011. Article (CrossRef Link).   DOI