Browse > Article
http://dx.doi.org/10.5909/JBE.2015.20.5.756

Layered Coding Method for Scalable Coding of HDR and SDR videos  

Lim, Jeongyun (Dept. of Computer Engineering, Kwangwoon University)
Ahn, Yong-Jo (Dept. of Computer Engineering, Kwangwoon University)
Lim, Woong (Dept. of Computer Engineering, Kwangwoon University)
Park, Seanae (Dept. of Computer Engineering, Kwangwoon University)
Sim, Donggyu (Dept. of Computer Engineering, Kwangwoon University)
Kang, Jung-Won (ETRI)
Publication Information
Journal of Broadcast Engineering / v.20, no.5, 2015 , pp. 756-769 More about this Journal
Abstract
In this paper, we propose a scalable coding method for high dynamic range (HDR) and standard dynamic range (SDR) videos based on Scalable High Efficiency Video Coding (SHVC). The proposed method has multi-layer coding architecture that consists of base layer for SDR videos and enhancement layer for HDR videos to support the backward compatibility with legacy codec and display devices. Also, to improve coding efficiency of enhancement layers, a global inverse tone mapping is applied to the reconstructed SDR video and the compensated frames are referred for coding of the enhancement layer. The proposed method is found to achieve BD-Rate gain of 43.0% on average (maximum 76.3%) for the enhancement layer and 15.7% on average (maximum 31%) for dual-layer against the SHM 7.0 reference software.
Keywords
HEVC; SHVC; HDR; Tone mapping; Inverse tone mapping;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Society of Motion Picture and Television Engineers, FCD ST 2084 (2014), Electro-Optical Transfer Function for High Dynamic Range Reference Display.
2 ITU-R Recommendation BT.709-5, "Parameter values for the HDTV standards for production and international programme exchange," 2002.
3 ITU-R Recommendation BT.2020-1, "Parameter values for ultra-high definition television systems for production and international programme exchange," 2014.
4 Boitard, Ronan, et al, "Survey of temporal brightness artifacts in video tone mapping," HDRi2014-Second International Conference and SME Workshop on HDR imaging. 2014.
5 Vadim, Yong He, "Common SHM test conditions and software reference configurations," JCTVC-Q1009, Valencia, Es, 27 March - 4 April 2014.
6 K. Chiu, M. Herf, P. Shirley, S. Swamy, K. Zimmerman, "Spatially nonuniform scaling functions for high contrast images," in Graphics Interface, pp. 245-245, 1993.
7 S. N. Pattanaik, J. A. Ferwerda, M. D. Fairchild, and D. P. Greenberg, "A multiscale model of adaptation and spatial vision for realistic image display," In Proceedings of model of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH' 98, pp. 287-298, 1998.
8 Y. Li, L. Sharan, and H. E. Adelson, "Compressing and companding high dynamic range images with subband architectures," ACM Transactions on Graphics, 24(3):836, 2005.   DOI
9 Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-preserving decompositions for multi-scale tone and detail manipulation," In ACM SIGGRAPH 2008 papers on - SIGGRAPH'08, pp. 1, 2008.
10 P. Ledda, A. Chalmers, T. Troscianko, and H. Seetzen, "Evaluation of tone mapping operators using a high dynamic range display," In ACM SIGGRAPH 2005 papers on - SIGGRAPH'05, pp. 640-648, 2005.
11 Boitard, Ronan, et al. "Motion-guided quantization for video tone mapping," Multimedia and Expo (ICME), 2014 IEEE International Conference on. IEEE, 2014.
12 Akyuz, Ahmet Oguz, et al, "Do HDR displays support LDR content?: a psychophysical evaluation," In ACM Transactions of Graphics (TOG), Vol. 26, p. 38, 2007.
13 Banterle, Francesco, et al. "Inverse tone mapping," Processings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia, ACM, pp. 349-356, 2006.
14 S. Miller, M. Nezamabadi, and S. Daly, "Perceptual Signal Coding for More Efficient Usage of Bit Codes," SMPTE Motion Imaging Journal, vol. 122, no. 4, pp. 52-59, May-June 2013.   DOI
15 Banterle, Francesco, et al. Advanced high dynamic range imaging: theory and practice. CRC Press, 2011.
16 S.B. Kang, M. Uyttendale, S. Winder and R. Szeliski, "High dynamic range video," ACM Transactions on Graphics, vol.22, no. 3, pp. 319-325, July. 2003.   DOI
17 P.E. Devec and J. Malik, "Recovering high dynamic range radiance maps from photographs," Proc. ACM SIGGRAPH'97, pp. 369-378, 1997.
18 T. Mitsunaga and S. K. Nayar, "High dynamic range imaging: Spatially varying pixel exposures," Proc. CVRP' 2000, vol. 1, pp. 472-479, 2000.
19 S. Mann and R. W. Picard, "On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures," IS＆T's 48th Annual Conference, Society for Imaging Science and Yechnology, Washington D. C., pp. 422-428, 1995.
20 R. Mantiuk, G. Krawczyk, K. Myszkowski, and H-P Seidel, "Perception-motivated High Dynamic Range Video Encoding," Proc. of SIGGRAPH'2004, pp. 733-741, 2004.
21 Larson, Gregory Ward. "LogLuv encoding for full-gamut, high-dynamic range images," Journal of Graphics Tools 3.1, pp. 15-31, 1998.   DOI
22 Kainz, Florian, and Rod Bogart, "Technical introduction to OpenEXR," Industrial light and magic, Nov. 2009
23 J. Tumbin, and H. Rushmeier, "Tone reproduction for realistic images," Computer Graphics and Application IEEE, 1993.
24 E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, "Photographic tone reproduction for digital images," ACM Trans. Graph, pp. 267-276, 2002.
25 R. Mantiuk, S. Daly and L. Kerofsky, "Display adaptive tone maping," ACM Transactions on Graphics, 27(3):1, 2008.   DOI
26 A.K Ramasubramonian, J. Sole, M. Karczewicz, S. Lee, D. Rusanovskyy, D. Bugdayci, X. Li, "Dual layer non-normative (category 3b) response to the Call for Evideonce on HDR/WCG," M-36280, 112th MPEG meeting, June. 2015, Warsaw.
27 Jeongyun Lim, Woong Lim, Yong-jo Ahn, Seanea Park, Donggyu Sim, "Reporting: Coding efficiency of the scalable coding for HDR and SDR video using inverse tone mapping on SHVC," M-36463, 112th MPEG meeting June. 2015, Warsaw.
28 Jacob Strom, Jonatan Samuelsson, Martin Pettersson, Kenneth Andersson, Per Wennersten, Rickard Sjorberg, "Ericsson's response to CfE for HDR and WCG," M-36184, 112th MPEG meeting, June. 2015, Warsaw.
29 A. Cotton, T. Borer, M. Pindoria, S. Thompson, M. Naccari, S. Schwarz, M. Mark, "BBC's response to CfE for HDR Video Coding (Category 3a)," M-36249, 112th MPEG meeting, June. 2015, Warsaw.
30 D. Rusanovskyy, S. Lee, D. Bugdayci, A. Ramsubramonian, J. Sole, M. Karczewicz, A.M. Tourapis, Y. Su, D. Singer, C. Fogg, A. Duenas, F. Bossen, "Single layer non-normative (category 3a)NCL and CL responses to the Call for Evidence on HDR/WCG," M-36256, 112th MPEG meeting, June. 2015, Warsaw.
31 ITU-R BT.2246-2 (2012), "The present state of ultra-high definition television," http://www.itu.int/dms_pub/itu-r/opb/rep/R-REP-BT.2246-2-2012-PDF-E.pdf
32 Ajay Luthra, Edouard Francois, Walt Husak, "Draft Requirements and Explorations for HDR and WCG Content Distribution," M-36436, 110th MPEG meeting, Oct. 2014, Strasbourg.
33 Rocco Goris, Robert Brondijk, Rene van der Vleuten, "Philips response to CfE for HDR and WCG," M-36266, 112th MPEG meeting, June. 2015, Warsaw.
34 김경혜, 조현호, 심동규, 장영민, “Scalable HEVC 표준 기술 동향,” 한국통신학회지 (정보와 통신), 제30권, 제 9호, 49-57, 2013년 8월. Kyeong-Hye Kim, Hyunho Jo, Donggyu Sim, Youngmin Jang, "Trend of Scalable HEVC Standard technology," Information and Communications, vol. 30, no. 9, pp. 49-57, Aug. 2013.
35 Jonathan Hatchett, Kurt Debattista, Joshua McNamee, Alan Chalmers, "goHDR10+: A Category 1 HDR video compression method," M-36261, 112th MPEG meeting, June. 2015, Warsaw.
36 심동규, 조현호, HEVC 표준 기술의 이해, 홍릉과학출판사, 2014. Donggyu Sim, Hyunho Jo, "Understanding of HEVC Standard Technology," Hongrung publishing, 2014.
37 Yong-Jo Ahn, Tae-Jin Hwang, Dong-Gyu Sim and Woo-Jin Han, "Implementation of fast HEVC encoder based on SIMD and data-level parallelism," EURASIP Journal on Image and Video Processing 2014, 2014:16, Mar. 2014.
38 J. Chen, J. Boyce, Y. Ye, M. M. Hannuksela, G. J. Sullivan and Y. -K. Wang, "High efficiency video coding (HEVC) scalable extension Draft 6," Q-1008_v5, 17th JCT-VC meeting, Mar. 2014, Valencia.
39 MovieLabs Specification for Next Generation Video: http://www. movielabs.com/ngvideo
40 A. Luthra, E. Francois and W. Husak, "Call for Evidence (CfE) for HDR and WCG Video Coding," N-15083, February. 2015, Geneva.
41 D. Baylon, Z. Gu, A. Luthra, K. Minoo, P. Yin, F. Pu, T. Lu, T. Chen, W. Husak, Y. He, L. Kerofsky, Y. Ye, B. Yi, "Response to Call for Evidence for HDR and WCG Video Coding: Arris, Dolby and InterDigital," M-36264, 112th MPEG meeting, June. 2015, Warsaw.
42 S. Lasserre, F. Le Leannec, E. Francois, T. Poirier, "Technicolor's response to CfE for HDR and WCG (Category 1)," M-36263, 112th MPEG meeting, June. 2015, Warsaw.