Browse > Article
http://dx.doi.org/10.5909/JBE.2015.20.2.204

Comparison of Objective Metrics and 3D Evaluation Using Upsampled Depth Map  

Mahmoudpour, Saeed (Dept. of Computer and Communications Engineering, Kangwon National University)
Choi, Changyeol (Dept. of Computer and Communications Engineering, Kangwon National University)
Kim, Manbae (Dept. of Computer and Communications Engineering, Kangwon National University)
Publication Information
Journal of Broadcast Engineering / v.20, no.2, 2015 , pp. 204-214 More about this Journal
Abstract
Depth map upsampling is an approach to increase the spatial resolution of depth maps obtained from a depth camera. Depth map quality is closely related to 3D perception of stereoscopic image, multi-view image and holography. In general, the performance of upsampled depth map is evaluated by PSNR (Peak Signal to Noise Ratio). On the other hand, time-consuming 3D subjective tests requiring human subjects are carried out for examining the 3D perception as well as visual fatigue for 3D contents. Therefore, if an objective metric is closely correlated with a subjective test, the latter can be replaced by the objective metric. For this, this paper proposes a best metric by investigating the relationship between diverse objective metrics and 3D subjective tests. Diverse reference and no-reference metrics are adopted to evaluate the performance of upsampled depth maps. The subjective test is performed based on DSCQS test. From the utilization and analysis of three kinds of correlations, we validated that SSIM and Edge-PSNR can replace the subjective test.
Keywords
Depth map; Upsampling; Objective metric; 3D subjective test; Correlation;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 H. R. Sheikh and A. C. Bovik, "Image information and image quality", IEEE Trans. On Image Processing, Vol. 12, No. 2, pp. 430-444, 2006.   DOI   ScienceOn
2 P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "Perceptual blur and ringing metrics:applicaation to JPEG2000", Int. Workshop on Multimedia Signal Processing, pp. 403-408, 2008.
3 A. K. Moorthy and A. Bovik, "A two-step framework for constructing blind image quality assessment", IEEE Signal Processing Letters, Vol. 17, No. 5, pp. 513-516, 2010   DOI   ScienceOn
4 A. Mittal, R. Soundararajan, and A. C. Bovik, "Making a completely blind' image quality analyzer", IEEE Signal Processing Letters, Vol. 20, No. 3, pp. 209-212, 2013.   DOI   ScienceOn
5 D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms", Int. J. of Computer Vision, Vol. 47, No.1-3, pp. 7-42, 2002.   DOI
6 C. Pham, S. Ha, and J. Jeon, "A local variance-based bilateral filtering for artifact-free detail and edge-preserving smoothing", PSIVT, Part Ⅱ, LNCS 7088, 99.60-70, 2011.
7 D. Yeo, E. Haq, J. Kim, M. Baig, H. Shin, "Adaptive Bilateral Filtering for Noise Removal in Depth Upsampling", SoC Design Conf., pp. 36-39, 2010.
8 A. B. Dehkordi, M. T. Pourazad, P. Nasiopoulos, "A study on the relationship between depth map quality and the overall 3D video quality of experience," IEEE 3DTV Conference, 2013.
9 C. Tomasi and R. Manduchi, "Bilateral Filtering for Gray and Color Image", In Proc. IEEE Int. Conf. on Computer Vision, pp.836-846(1998).
10 J. Kopf, M. F. Cohen, D. Lischinski and M. Uyttendaele, "Joint bilateral upsampling", ACM Trans. on Graphics, Vol. 26, No. 3, pp.1-6, 2007.   DOI   ScienceOn
11 E. Lee, H. Heo, and K. Park, "The comparative measurements of eye strain caused by 2D and 3D displays", IEEE Trans. on Consumer Electronics, Vol. 56, No. 3, pp. 1677-1683, 2010.   DOI   ScienceOn
12 D. Kim and K. Sohn, "Visual fatigue prediction for stereoscopic image", IEEE Trans. Circuits Syst. Video Technol., Vol. 21, No. 3, pp. 231-236, 2011.   DOI   ScienceOn
13 S. Jang, D. Lee, S. Kim, H. Choi, M. Kim, "Depth Map Upsampling with Improved Sharpness", Journal of Broadcast Engineering, Vol. 17, No. 6, pp. 933-944, 2012.   DOI   ScienceOn
14 J. Gil, S. Mahmoudpour and M. Kim, "Analysis of relationship between objective performance measurement and 3D visual discomfort in depth map upsampling", Journal of Broadcast Engineering, Vol. 19, No. 1, pp. 31-43, Jan. 2014.   DOI   ScienceOn
15 Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity", IEEE Trans. On Image Processing, Vol. 13, No. 4, 2004.   DOI   ScienceOn