Browse > Article

Multi-View Color Video and Depth Map Coding based on HEVC  

Yoo, Sun-Mi (Dept. of Computer Engineering, Kwangwoon University)
Nam, Jung-Hak (Dept. of Computer Engineering, Kwangwoon University)
Lim, Woong (Dept. of Computer Engineering, Kwangwoon University)
Sim, Dong-Gyu (Dept. of Computer Engineering, Kwangwoon University)
Cheong, Won-Sik (Department of Broadcasting System Research, Electronics and Telecommunications Research Institute)
Hur, Nam-Ho (Department of Broadcasting System Research, Electronics and Telecommunications Research Institute)
Publication Information
Abstract
This paper proposes a method to efficiently encode multi-view color videos and depth maps. The proposed coding method for multi-view color videos and depth maps can improve the coding efficiency by additional inter-view prediction, as well as inter-frame prediction. By means of the proposed method, we achieved the coding gain of approximately 55% for 2-view color videos and approximately 12% for 2-view depth maps. For 3-view case, we found that the proposed system yields 54% of coding gain from outer view color videos and 56% of coding gain from center view color videos, respectively. Moreover, for 3-view depth map case, approximately 11% of coding gain from outer view and 13% of coding gain from center view are obtained with the proposed coder, respectively.
Keywords
MVC; HEVC; Depth map; FTV; Inter-view prediction;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 박시내, 심동규, "다시점 비디오 코딩," 대한전자공학회 2008년 하계학술대회 논문집, 57-60쪽, 강원도 평창, 한국, 2008년 6월
2 심동규, 조현호, 남정학, "HEVC (High efficiency video coding) 최신 표준화 동향," 한국멀티미디어학회지, 제14권, 제2호, 1-15쪽, 2010년 6월
3 Philipp Merkle, Aljoscha Smolic, Karsten Müller, Thomas Wiegand, "Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process, pp. I-201-I-204, San Antonio, TX, USA, September 2007.
4 남정학, 황능주, 조광신, 심동규, 이수연, 방건, 허남호, "3차원 영상을 위한 깊이 영상 압축 방법," 방송공학회논문지, 제15권, 제5호, 703-706쪽, 2010년 9월
5 "Call for Proposals on 3D Video Coding Technology," ISO/IEC JTC1/SC29/WG11, Doc. N12036, 96th MPEG meeting, Geneva, Switzerland, March 2011.
6 박시내, 심동규, 전병우, "조명보상 기반 분산 다시점 비디오 코딩," 전자공학회 논문지, 제45권, SP 편, 제6호, 17-26쪽, 2008년 11월
7 박시내, 심동규, "다시점 비디오 부호화 기술," 방송공학회지, 제14권, 제2호, 45-52쪽, 2009년 6월
8 T. Wiegand, W.-J. Han, B. Bross, J.-R. Ohm, G. J. Sullivan, "WD2: Working draft 2 of high-efficiency video coding," Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-D503, Daegu, Korea, January 2011.
9 K. McCann, B. Bross, S. Sekiguchi, W. -J. Han, "High efficiency video coding (HEVC) test model 2 (HM 2) encoder description," Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-D502, Daegu, Korea, January 2011.
10 최해철, "HEVC 화면 내 예측 및 부호화," 전자공학회지, 제38권, 제8호, 609-615쪽, 2011년 8월
11 T. K. Tan, W.-J. Han, B. Bross, J.Jung, K. McCann, Y. Suzuki, G. Clare, H. Schwarz, A. Fujibayashi, "BoG report of CE9 : Motion vector coding," Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-D441, Daegu, Korea, January 2011.
12 Woong Lim, Junghak Nam, Hyomin Choi, Donggyu Sim, "High efficiency CODEC for multi-view video," Three dimensional systems and applications (3DSA) 2011, pp. 261-264, Seoul, Korea, June 2011.
13 HEVC reference software version 2.0, https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-2.0.
14 Marek Domanski, Tomasz Grajek, Krzysztof Klimaszewski, Maciej Kurc, Olgierd Stankiewicz, Jakub Stankowski, Krzysztof Wegner "Poznan Multiview Video Test Sequences and Camera Parameters," ISO/IEC JTC1/SC29/WG11, Doc. M17050, Xian, China, October 2009.
15 Masayuki Tanimoto, Toshiaki Fujii, Mehrdad Panahpour Tehrani, Menno Wildeboer, Norishige Fukushima, Hisayoshi Furihata, "Moving Multiview Camera Test Sequences for MPEG-FTV," ISO/IEC JTC1/SC29/WG11, Doc. M16922, Xian, China, October 2009.
16 Jun Zhang, Ri Li, Houqiang Li, Dmytro Rusanovskyy, Miska M. Hannuksela, "Ghost Town Fly 3DV sequence for purposes of 3DV standardization," ISO/IEC JTC1/SC29/WG11, Doc. M20027, Geneva, Switzerland, March 2011.
17 Payman Aflaki, Dmytro Rusanovskyy, Miska M. Hannuksela, "Undo Dancer 3DV sequence for purposes of 3DV standardization," ISO/IEC JTC1/SC29/WG11, Doc. M20028, Geneva, Switzerland, March 2011.
18 Gi-Mun Um, Gun Bang, Namho Hur, Jinwoong Kim, Yo-Sung Ho, "3D Video Test Material of Outdoor Scene," ISO/IEC JTC1/SC29/WG11, Doc. M15371, Archamps, France, April 2008.
19 Yo-Sung Ho, Eun-Kyung Lee, and Cheon Lee, "Multiview Video Test Sequence and Camera Parameters," ISO/IEC JTC1/SC29/WG11, Doc. M15419, Archamps, France, April 2008.
20 G. Bjontegaard, "Calculation of average PSNR differences between RD-Curves," ITU-T SG16/Q.6, Doc. VCEG-M33, Texas, The United States of America, April 2001.
21 S. Yoo, W. Lim, D. Sim, S.-J. Oh, "Performance evaluation of multi-view video and depth data with AVC and HEVC," ISO/IEC JTC1/SC29/WG11, Doc. M19594, Geneva, Switzerland, March 2011.