Browse > Article
http://dx.doi.org/10.5909/JBE.2012.17.5.838

Multi-view Image Generation from Stereoscopic Image Features and the Occlusion Region Extraction  

Lee, Wang-Ro (Kwangwoon University)
Ko, Min-Soo (Kwangwoon University)
Um, Gi-Mun (Electronics and Telecommunications Research Institute(ETRI))
Cheong, Won-Sik (Electronics and Telecommunications Research Institute(ETRI))
Hur, Nam-Ho (Electronics and Telecommunications Research Institute(ETRI))
Yoo, Ji-Sang (Kwangwoon University)
Publication Information
Journal of Broadcast Engineering / v.17, no.5, 2012 , pp. 838-850 More about this Journal
Abstract
In this paper, we propose a novel algorithm that generates multi-view images by using various image features obtained from the given stereoscopic images. In the proposed algorithm, we first create an intensity gradient saliency map from the given stereo images. And then we calculate a block-based optical flow that represents the relative movement(disparity) of each block with certain size between left and right images. And we also obtain the disparities of feature points that are extracted by SIFT(scale-invariant We then create a disparity saliency map by combining these extracted disparity features. Disparity saliency map is refined through the occlusion detection and removal of false disparities. Thirdly, we extract straight line segments in order to minimize the distortion of straight lines during the image warping. Finally, we generate multi-view images by grid mesh-based image warping algorithm. Extracted image features are used as constraints during grid mesh-based image warping. The experimental results show that the proposed algorithm performs better than the conventional DIBR algorithm in terms of visual quality.
Keywords
Image Domain Warping (IDW); Saliency map; Multi-View Video; Occlusion Region Extraction;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Nguyen Cao Truong Hai, Do-Yeon Kim, Hyuk-Ro Park, "Obtaining Object by Using Optimal Threshold for Saliency Map Thresholding,"(in Korean), JKCA, vol. 11, no. 6, pp.18-25, June, 2011.   과학기술학회마을   DOI
2 S. Montabone and A. Soto, "Human detection using a mobile platform and novel features derived from a visual saliency mechanism," Image and Vision Computing, vol. 28, no. 3, pp. 391-402, 2010.   DOI   ScienceOn
3 Che-han Chang, Chia-Kai Liang, and Yung-Yu Chuang, "Content-aware display adaptation and interactive editing for stereoscopic images." IEEE Transactions on Multimedia, vol. 13, no. 4, pp.589-601, Aug. 2011.   DOI   ScienceOn
4 J. H. Park and H. W. Park, "A mesh-based disparity representation method for view interpolation and stereo image compression," IEEE Transaction on Image Processing, vol.15, no. 7, pp.1751-1762. July 2006.   DOI   ScienceOn
5 Ilkwon Park and Hyeran Byun, "Efficient data representation of stereo images using edge-based mesh optimization," Journal of Broadcast Engineering, vol. 14, no. 3, pp.322-331, May 2009.   DOI   ScienceOn
6 Methodology for subjective assessment of the quality of television picture, ITU-R Recommendation BT.500-11
7 A. Mancini and J. Konrad, "Robust quad-tree based disparity estimation for the reconstruction of intermediate stereoscopic images," Proc. SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 3295, pp.53-64, Jan. 1998.
8 ISO/IEC JTC1/SC29/WG11, Draft call for proposals on 3D video coding technology, N11830, Daegu, Korea, Jan. 2011.
9 ISO/IEC JTC1/SC29/WG11, Applications and requirements on 3D video coding, N11829, Daegu, Korea, Jan. 2011.
10 ISO/IEC JTC1/SC29/WG11, Boundary noise removal and common hole filling method for VSRS 3.5, M19356, Daegu, Korea, Jan. 2011.
11 ISO/IEC JTC1/SC29/WG11, Image domain warping as alternative to DIBR for advanced 3DV applications, M19995, Geneva, Switzerland, March 2011.
12 David G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision(IJCV), vol. 60, pp.91-110, Nov. 2004   DOI   ScienceOn
13 M. Lang. A. Hornung, O. Wang. S. Poulakos, A. Smolic, and Gross, "Non-linear disparity mapping for stereoscopic 3D," ACM Transactions on Graph(SIGGRAPH 2010), vol. 29, July 2010.
14 R. Achanta, F. Estrada, P. Wils, and S. Susstrunk, "Salient region detection and segmentation," International Conference on Computer Vision Systems, vol. 5008, pp.66-75, 2008.
15 B. D. Lucas, T. Kanade, "An iterative image registration technique with an application to stereo vision", Proc. of the 1981 DARPA Imaging Understanding Workshop, pp. 121-130, 1981
16 B. Bartczak and R. Koch, "Dense depth maps from low resolution time-of-flight depth and high resolution color views," Proc. of 5th International Symposium on Visual Computing, pp.1-12, Nov. 2009.
17 O. Barinova, V. Lempitsky, E. Tretiak, and P. Kohli, "Geometric image parsing in man-made environments," in ECCV, 2010.
18 R.G. von Gioi, J. Jakubowicz, J. M. Morel, G. Randall, "LSD: A Fast Line Segment Detector with a False Detection Control," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. PAMI 32, no.4, pp. 722-732, April. 2010.