Browse > Article
http://dx.doi.org/10.5909/JBE.2013.18.6.859

Multi-view Image Generation using Grid-mesh based Image Domain Warping and Occlusion Region Information  

Lim, Jong-Myeong (Kwangwoon University, Department of Electronic Engineering)
Um, Gi-Mun (Electronics and Telecommunications Research Institute, ETRI)
Shin, Hong-Chang (Electronics and Telecommunications Research Institute, ETRI)
Lee, Gwangsoon (Electronics and Telecommunications Research Institute, ETRI)
Hur, Namho (Electronics and Telecommunications Research Institute, ETRI)
Yoo, Jisang (Kwangwoon University, Department of Electronic Engineering)
Publication Information
Journal of Broadcast Engineering / v.18, no.6, 2013 , pp. 859-871 More about this Journal
Abstract
In this paper, we propose an algorithm that generates multi-view images by grid-mesh based image domain warping using occlusion mask and various image features obtained from the stereoscopic images. In the proposed algorithm, we first extract image saliency map, line segments and disparity saliency map from stereo images and then get them through a process that improves the quality of extracted features. This process is accomplished in two steps. In the first step, reliability of disparity saliency map on object boundary regions is enhanced by using occlusion information. And in the second step, we enhance the quality of image features in terms of temporal consistency by using temporal consistency information for stereo images. With these enhanced features, multi-view images are generated by grid-mesh based image domain warping technique. Experimental results show that the proposed algorithm performs better than existing algorithms in terms of visual quality.
Keywords
View synthesis; Image Domain Warping; Multi-view generation; Occlusion information;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 B. Bartczak and R. Koch, "Dense depth maps from low resolution time-of-flight depth and high resolution color views," Proc. of 5th International Symposium on Visual Computing, pp.1-12, Nov. 2009.
2 ISO/IEC JTC1/SC29/WG11, Draft call for proposals on 3D video coding technology, N11830, Daegu, Korea, Jan. 2011.
3 ISO/IEC JTC1/SC29/WG11, Applications and requirements on 3D video coding, N11829, Daegu, Korea, Jan. 2011.
4 V S R S :http://w g11.s c29.org/svn/repos/M P EG -4/tes t/trunk/3D/view_synthesis/VSRS
5 W. R. Lee, M. S. Ko, K. M. Um, W. S. Cheong, N. Hur and J. Yoo, "Multi-view image generation from stereoscopic image features and the occlusion region extraction", The Journal of Korean Society of Broadcast Engineers, Vol. 17, No. 5, pp. 838-850, Sep. 2012   과학기술학회마을   DOI   ScienceOn
6 M. Lang. A. Hornung, O. Wang. S. Poulakos, A. Smolic, and Gross, "Non-linear disparity mapping for stereoscopic 3D," ACM Transactions on Graph(SIGGRAPH 2010), vol. 29, July 2010.
7 ISO/IEC JTC1/SC29/WG11, Boundary noise removal and common hole filling method for VSRS 3.5, M19356, Daegu, Korea, Jan. 2011.
8 ISO/IEC JTC1/SC29/WG11, Image domain warping as alternative to DIBR for advanced 3DV applications, M19995, Geneva, Switzerland, March 2011.
9 B. D. Lucas, and T. Kanade, "An iterative image registration technique with an application to stereo vision", Proc. of the 1981 DARPA Imaging Understanding Workshop, pp. 121-130, 1981.
10 David G. Lowe, "Distinctive image features from scale-invariant key-points," International Journal of Computer Vision(IJCV), vol. 60, pp.91-110, Nov. 2004   DOI   ScienceOn
11 R. Achanta, F. Estrada, P. Wils, and S. Susstrunk, "Salient region detection and segmentation," International Conference on Computer Vision Systems, vol. 5008, pp.66-75, 2008.
12 Nguyen Cao, Truong Hai, D. Y. Kim and H. R. Park, "Obtaining Object by Using Optimal Threshold for Saliency Map Thresholding", The Journal of Korea Contents Association, Vol. 11, No. 6, pp.18-25, Jun. 2011.   과학기술학회마을   DOI   ScienceOn
13 S. Montabone and A. Soto, "Human detection using a mobile platform and novel features derived from a visual saliency mechanism," Image and Vision Computing, vol. 28, no. 3, pp. 391-402, 2010.   DOI   ScienceOn
14 O. Barinova, V. Lempitsky, E. Tretiak, and P. Kohli, "Geometric image parsing in man-made environments," in ECCV, 2010.
15 R.G. von Gioi, J. Jakubowicz, J. M. Morel, and G. Randall, "LSD: A fast line segment detector with a false detection control," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. PAMI 32, no.4, pp. 722-732, Apr. 2010.
16 A. Frick, B. Bartczack and B. Koch, "3D-TV LDV content generation with a hybrid tof-multicamera rig", 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, pp. 1-4, June 2010
17 Ilkwon Park and Hyeran Byun, "Efficient data representation of stereo images using edge-based mesh optimization," Journal of Broadcast Engineering, vol. 14, no. 3, pp.322-331, May 2009.   과학기술학회마을   DOI   ScienceOn
18 Sang-Beom Lee and Yo-Sung Ho, "Multi-view depth map estimation enhancing temporal consistency", International Technical Conference on Circuits Systems, Computer and Communications, pp. 29-32, July 2008
19 Che-han Chang, Chia-Kai Liang, and Yung-Yu Chuang, "Content-aware display adaptation and interactive editing for stereoscopic images." IEEE Transactions on Multimedia, vol. 13, no. 4, pp.589-601, Aug. 2011.   DOI   ScienceOn
20 J. H. Park and H. W. Park, "A mesh-based disparity representation method for view interpolation and stereo image compression," IEEE Transaction on Image Processing, vol.15, no. 7, pp.1751-1762. July 2006.   DOI   ScienceOn
21 Methodology for subjective assessment of the quality of television picture, ITU-R Recommendation BT.500-11