Browse > Article
http://dx.doi.org/10.5909/JBE.2019.24.6.1096

Modified Seam Finding Algorithm based on Saliency Map to Generate 360 VR Image  

Han, Hyeon-Deok (Sejong University, Dept. of Electrical Engineering)
Han, Jong-Ki (Sejong University, Dept. of Electrical Engineering)
Publication Information
Journal of Broadcast Engineering / v.24, no.6, 2019 , pp. 1096-1112 More about this Journal
Abstract
The cameras generating 360 VR image are too expensive to be used publically. To overcome this problem, we propose a way to use smart phones instead of VR camera, where more than 100 pictures are taken by smart phone and are stitched into a 360 VR image. In this scenario, when moving objects are in some of the pictures, the stitched 360 VR image has various degradations, for example, ghost effect and mis-aligning. In this paper, we proposed an algorithm to modify the seam finding algorithms, where the saliency map in ROI is generated to check whether the pixel belongs to visually salient objects or not. Various simulation results show that the proposed algorithm is effective to increase the quality of the generated 360 VR image.
Keywords
360 VR; Image Stitching; Seam Finder;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Matthew Brown and David G. Lowe, "Automatic Panoramic Image Stitching using Invariant Features," International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007   DOI
2 Cheng-Ming Huang, Shu-Wei Lin, Jyun-Hong Chen, "Efficient Image Stitching of Continuous Image Sequence With Image and Seam Selections," IEEE Sensors Journal, Vol 15, no. 10, pp. 5910-5918, October 2015.   DOI
3 H. Bay, T.Tuytelaars, and L. Gool, "SURF : Speeded Up Robust Features," In: A.Leonardis, H. Bischof, A. Pinz(Eds.): ECCV 2006, Part 1, LNCS 3951, pp 404-417, Springer 2006
4 E. Rublee, V. Rabaud, K. Konolige, G. Bradski, "ORB: An efficient alternative to SIFT or SURF," Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 2564-2571, Nov. 2011
5 C. Bore, "The Algebra of Video Mixing: Alpha Blending and Color Keying," BORES Signal Processing, 2014
6 M. Afifi, K. F. Hussain, "MPB: A modified Poisson blending technique," Computational Visual Media, vol. 1, no. 4, pp.331-341, 2015   DOI
7 A. Levin, A. Zomet, S. Peleg, and Y. Weiss, "Seamless image stitching in the gradient domain," Proc. of Eur. Conf. Comput. Vis., Prague, Czech Republic, Vol. 4, pp 377-389, May 2004
8 Y.Wan, Z.Miao, "Automatic panorama image mosaic and ghost eliminating," Multimedia and Expo 2008 IEEE International Conference on, pp 509-516, 2001
9 B.-S.Kim, K.-A.Choi, W.-J.Park, S.-W.Kim, and S.-J.Ko, "Content-preserving video stitching method for multi-camera systems," IEEE Transactions on Consumer Electronics, vol. 63, no. 2, 2017
10 J. Yoon and D. Lee, "Real-time video stitching using camera path estimation and homography refinement," Symmetry, vol. 10, no. 1, pp 4, 2017   DOI
11 W. Jiang and J. Gu, "Video stitching with spatial-temporal content-preserving warping," in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 42-48, 2015
12 R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequencytuned Salient Region Detection," IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2009
13 Jun Pan, Mi Wang, Deren Li, and Jonathan Li, "Automatic Generation of Seamline Network Using Area Voronoi Diagrams With Overlap," IEEE Transactions on Geoscience and Remote Sensing , Vol. 47, Issue. 6, pp 1737-1744, April 2009   DOI
14 V. C. S. Chew, F. -L. Lian, "Panorama stitching using overlap area weighted image plan projection and dynamic programming for visual localization," Proc. IEEE/ASME Int. Conf. Adv. Intell. Mechatron. (AIM), Vol. 20, No. 5, pp 728-737, September 2015
15 Yuri Y. Boykov and Marie-Pierre Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images," International Conference on Computer Vision, Vol. 1, pp.105-112, July 2001
16 J. L. Crowley, O. Riff, and J. H. Piater, "Fast computation of characteristic scale using a half octave pyramid," International Conference on Scale-Space theories in Computer Vision, 2003
17 A. C. Harris, I. L. Weatherall, "Objective evaluation of colour variation in the sand-burrowing beetle Chaerodes trachyscelides White (Coleoptera : Tenebrionidae) by instrumental determination of CIELAB values," Journal of the Royal Society of New Zealand 20 (3), September 1990
18 Cao Congjun, Sun Jing, "Study on Color Space Conversion between CMYK and CIE L*a*b* Based on Generalized Regression Neural Network," International Conference on Computer Science and Software Engineering, 2008
19 Smith, Thomas; Guild, John, "The C.I.E. colorimetric standards and their use," Transactions of the Optical Society 33 (3), pp 73-134 1931-32   DOI
20 Speranskaya, N.I., "Determination of spectrum color coordinates for 27 normal observers," Optics and Spectroscopy 7, 1959