Browse > Article
http://dx.doi.org/10.5392/JKCA.2015.15.02.031

Pattern-based Depth Map Generation for Low-complexity 2D-to-3D Video Conversion  

Han, Chan-Hee ((주)실리콘웍스)
Kang, Hyun-Soo (충북대학교 정보통신공학과)
Lee, Si-Woong (한밭대학교 정보통신공학과)
Publication Information
The Journal of the Korea Contents Association / v.15, no.2, 2015 , pp. 31-39 More about this Journal
Abstract
2D-to-3D video conversion vests 3D effects in a 2D video by generating stereoscopic views using depth cues inherent in the 2D video. This technology would be a good solution to resolve the problem of 3D content shortage during the transition period to the full ripe 3D video era. In this paper, a low-complexity depth generation method for 2D-to-3D video conversion is presented. For temporal consistency in global depth, a pattern-based depth generation method is newly introduced. A low-complexity refinement algorithm for local depth is also provided to improve 3D perception in object regions. Experimental results show that the proposed method outperforms conventional methods in terms of complexity and subjective quality.
Keywords
2D-to-3D Video Conversion; Depth Cue; Low-complexity Depth Fusion; Image Synthesis;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 L. Zhang, C. Vazquez, and S. Knorr, "3DTV content creation: automatic 2D-to-3D video conversion," IEEE Trans. Broadcast., Vol.57, No.2, pp.372-383, 2011(6).   DOI   ScienceOn
2 Y. Matsumoto, H. Terasaki, K. Sugimoto, and T. Arakawa, "Conversion system of monocular image conversion technologies," In Proc. of SPIE Photonic West, Vol.3012, pp.108-112, 1997(2).
3 T. Okino, G. Murata, K. Taima, T. Iinuma, and K. Oketani, "New television with 2D/3D image conversion techniques," In Proc. of SPIE Photonic West, Vol.2653, pp.96-100, 1996(1).
4 M. T. Pourazad, P. Nasiopoulos, and R. K. Ward, "An H.264-based scheme for 2D to 3D video conversion," IEEE Trans. Consumer Electron, Vol.55, No.2, pp.742-748, 2009(5).   DOI   ScienceOn
5 D. Kim, D. Min, and K. Sohn, "A stereoscopic video generation method using stereoscopic display characterization and motion analysis," IEEE Trans. Broadcast, Vol.54, No.2, pp.188-197, 2008(6).   DOI   ScienceOn
6 Z. Li, X. Cao, and Q. H. Dai, "A novel method for 2D-to-3D video conversion using bi-directional motion estimation," In Proc. of 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1429-1432, 2012(3).
7 W. J. Tam, A. S. Yee, J. Ferreira, S. Tariq, and F. Speranza, "Stereoscopic image rendering based on depth maps created from blur and edge information," In Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XII, Vol.5664, pp.104-115, 2005(1).
8 C. C. Cheng, C. T. Li, and L. G. Chen, "A 2D-to-3D Conversion System Using Edge Information," In Proc. of IEEE International Conference on Consumer Electronics(ICCE), pp.377-378, 2010(1).
9 Y. L. Chang, Y. P. Tsai, T. H. Chang, Y. R. Chen, and S. Lei, "A depth map refinement algorithm for 2D-to-3D conversion," In Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1437-1440, 2012(3).
10 L. Vosters and G. de Haan, "Efficient and Stable Sparse to Dense Conversion for Automatic 2D-to-3D Conversion," IEEE Trans. Circuits Syst. Video Technol., Vol.23, No.3, pp.373-386, 2013(3).   DOI   ScienceOn
11 X. Huang, L. Wang, J. Huang, D. Li, and M. Zhang, "A depth extraction method based on motion and geometry for 2D to 3D conversion," In Proc. of Third International Symposium on Intelligent Information Technology Application, Vol.3, pp.294-298, 2009(11).
12 S. Battiatoa, S. Curtib, M. L, Casciac, M. Tortorac, and E. Scordato, "Depth Map Generation by Image Classification," In Proc. of SPIE Electronic Imaging, Vol.5302, pp.95-104, 2004(1).
13 S. Battiato, A. Capra, S. Curti, and M. La Cascia, "3D stereoscopic image pairs by depth-map generation," In Proc. of Second International Symposium on 3D Date Processing, Visualization and Transmission, pp.124-131, 2004(9).
14 P. Ji, L. Wang, D. X. Li, and M. Zhang, "A novel 2D-to-3D conversion method based on blocks world," In Proc. of 2012 International Conference on Audio, Language and Image Processing (ICALIP), pp.541-545, 2012(6).
15 Y. L. Chang, J. Y. Chang, Y. M. Tsai, C. L. Lee, and L. G. Chen, "Priority depth fusion for the 2D-to-3D conversion system," In Proc. of SPIE Electronics Imaging, Vol.6805, pp.1-8, 2008(2).
16 S. F. Tsai, C. C. Cheng, C. T. Li, and L. G. Chen, "A real-time 1080p 2D-to-3D video conversion system," IEEE Trans. Consumer Electron, Vol.52, No.2, pp.915-922, 2011(5).
17 P. Ji, L. Wang, D. X. Li, and M. Zhang, "An automatic 2D to 3D conversion algorithm using multi-depth cues," In Proc. of 2012 International Conference on Audio, Language and Image Processing (ICALIP), pp.546-550, 2012(7).
18 Y. K. Lai, Y. F. Lai, and Y. C. Chen, "An Effective Hybrid Depth-Generation Algorithm for 2D-to-3D Conversion in 3D Displays," Journal of Display Technology, Vol.9, No.3, pp.154-161, 2013(5).   DOI   ScienceOn
19 한찬희, 최해철, 이시웅, "2차원 동영상의 3차원 변환을 위한 깊이 단서의 신뢰성 기반 적응적 깊이 융합", 한국콘텐츠학회논문지, 제12권, 제12호, pp.1-13, 2012.   과학기술학회마을   DOI   ScienceOn