Browse > Article
http://dx.doi.org/10.5909/JBE.2014.19.1.31

Analysis of Relationship between Objective Performance Measurement and 3D Visual Discomfort in Depth Map Upsampling  

Gil, Jong In (Dept. of Computer and Communications Engineering, Kangwon National University)
Mahmoudpour, Saeed (Dept. of Computer and Communications Engineering, Kangwon National University)
Kim, Manbae (Dept. of Computer and Communications Engineering, Kangwon National University)
Publication Information
Journal of Broadcast Engineering / v.19, no.1, 2014 , pp. 31-43 More about this Journal
Abstract
A depth map is an important component for stereoscopic image generation. Since the depth map acquired from a depth camera has a low resolution, upsamling a low-resolution depth map to a high-resolution one has been studied past decades. Upsampling methods are evaluated by objective evaluation tools such as PSNR, Sharpness Degree, Blur Metric. As well, the subjective quality is compared using virtual views generated by DIBR (depth image based rendering). However, works on the analysis of the relation between depth map upsampling and stereoscopic images are relatively few. In this paper, we investigate the relationship between subjective evaluation of stereoscopic images and objective performance of upsampling methods using cross correlation and linear regression. Experimental results demonstrate that the correlation of edge PSNR and visual fatigue is the highest and the blur metric has lowest correlation. Further, from the linear regression, we found relative weights of objective measurements. Further we introduce a formulae that can estimate 3D performance of conventional or new upsampling methods.
Keywords
Depth map; Upsampling; Objective measurement; 3D performance;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. Hou and H. Andrews, "Cubic splines for image interpolation and digital filtering," IEEE Trans. Acoust. Speech Signal Process., vol. 26, no. 6, pp. 508-517, Dec. 1978.   DOI
2 Tomasi, C., and Manduchi, R. "Bilateral filtering for gray and color images," In Proc. IEEE Int. Conf. on Computer Vision, pp. 836-846, 1998.
3 J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint Bilateral Upsampling," ACM Trans. on Graphics, vol. 26, no. 3, 2007.
4 C. Pham, S. Ha, and J. Jeon, "A local variance-based bilateral filtering for artifact-free detail- and edge-preserving smoothing," PSIVT, Part II, LNCS 7088, pp. 60-70, 2011.
5 S. Jang, D. Lee, S. Kim, H. Choi, M. Kim, "Depth Map Upsampling with Improved Sharpness," Jounal of Broadcast Engineering, Vol. 17, No. 6, pp. 933-944, Nov. 2012.   DOI   ScienceOn
6 Q. Thu and M. Ghanbari, "Scope of validity of PSNR in image/video quality assessment," Electronics Letters, vol. 44, no.13, pp. 800-801, Jun. 2008.   DOI   ScienceOn
7 C. Tsai, H. Liu, M. Tasi, "Design of a scan converter using the cubic convolution interpolation with canny edge detection," 2011 International Conference on Electric Information and Control Engineering (ICEICE), pp. 5813-5816, Apr. 2011.
8 P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "Perceptual blur and ringing metrics: application to JPEG2000," Int. Workshop Multimedia Signal Processing, pp. 403-408, Oct. 2008.
9 A. Redert, M. Op, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I. Sexton, P. Surman, "ATTEST-Advanced Three-dimensional Television System Techniques," Proc. of 3DPVT, pp. 313-319, 2002.
10 C. Fehn, "Depth-image-based Rendering (DIBR), Compression and Transmission for a New Approach on 3D TV," Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 5291, pp. 93- 104, 2004.
11 L. Zhang, W. J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Trans. on Broadcasting, vol. 51, pp. 191-199, 2005.   DOI   ScienceOn
12 G. Borgefors, "Hierarchical chamfer matching: a parametric edge matching algorithm," IEEE T. Patten Anal. Mach. Intell., vol. 10, no. 6, pp.849-865, 1988.   DOI   ScienceOn
13 "Subjective assessment of stereoscopic television picture", ITU-R Recommendation BT. 1438, 2000.
14 G. Nur, S. Dogan, H. Kodikara Arachchi, and A. M. Kondoz, "Impact of Depth Map Spatial Resolution on 3D Video Quality and Depth Perception," 3DTV-CON, pp, 1-4, 2010.
15 Chang, Kang-Tsung. "Computation for Bilinear Interpolation" Introduction to Geographic Information Systems 5th ed, 2009.
16 C. Phan, S. Ha, J. Jeon, "A local variance-based bilateral filtering for artifact-free detail and edge preserving smoothing," PSIVT, Part II, LNCS 7088, pp. 60-70, 2011.
17 R. Keys, "Cubic convolution interpolation for digital image processing," IEEE Trans on Signal Processing, Acoustics, Speech, and Signal Processing 29 (6), pp. 1153-1160, 1981.   DOI
18 C. Tomasi, R. Manduchi, "Bilateral filtering for gray and color images," In Proc. IEEE Int. Conf. on Computer Vision, pp. 836-846, 1998.
19 J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint Bilateral Upsampling," ACM Trans. on Graphics, vol. 26, no. 3, 2007.
20 D. Yeo, E. Hap, J. Kim, M. Baig, H. Shin, "Adaptive Bilateral Filtering for Noise Removal in Depth Upsampling," SoC Design Conf., pp. 36-39, 2010.
21 I. E. Sobel, "Camera Models and Machine Perception," Ph.D. dissertation, Stanford University, Palo Alto, Calif., 1970.