Browse > Article
http://dx.doi.org/10.6109/jkiice.2013.17.4.935

Illumination Compensation Algorithm based on Segmentation with Depth Information for Multi-view Image  

Kang, Keunho (광운대학교)
Ko, Min Soo (광운대학교)
Yoo, Jisang (광운대학교 전자공학과)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.17, no.4, 2013 , pp. 935-944 More about this Journal
Abstract
In this paper, a new illumination compensation algorithm by segmentation with depth information is proposed to improve the coding efficiency of multi-view images. In the proposed algorithm, a reference image is first segmented into several layers where each layer is composed of objects with a similar depth value. Then we separate objects from each other even in the same layer by labeling each separate region in the layered image. Then, the labeled reference depth image is converted to the position of the distortion image view by using 3D warping algorithm. Finally, we apply an illumination compensation algorithm to each of matched regions in the converted reference view and distorted view. The occlusion regions that occur by 3D warping are also compensated by a global compensation method. Through experimental results, we are able to confirm that the proposed algorithm has better performance to improve coding efficiency.
Keywords
Illumination compensation; Layer image; Labeling; 3D warping; Pre-processing of encoding;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Lopez, J. Kim, A. Ortega, and G. Chen, "Block-based illumination compensation and search techniques for multiview video coding," in Proceeding of Picture Coding Symp. (PCS), Dec. 2004.
2 J. H. Kim, et al., "New coding tools for illumination and focus mismatch compensation in multiview video coding," IEEE Trans. on Circuits and Systems for Video Technology, vol.17, no.11, pp.1519-1534, Nov. 2007.   DOI   ScienceOn
3 P. L. Lai, A. Ortega, P. Pandit, P. Yin, and C. Gomila, "Adaptive Reference Filtering for MVC," JVT-W065.doc, pp.21-27, San Jose, USA, April 2007.
4 U. Fecker, M. Barkowsky, and A. Kaup, "Histogram-based pre-filtering for luminance and chrominance compensation of multi-view video," IEEE Trans. Circuits Syst. Video Technol., vol.18, no.9, pp.1258-1267, Sep. 2008.   DOI   ScienceOn
5 U. Fecker, M. Barkowsky, and A. Kaup, "Timeconstant histogram matching for colour compensation of multi-view video sequences," in Proceeding of Picture Coding Symp. (PCS), Nov. 2007.
6 박성희, 유지상, "다시점 비디오의 색상 성분 보정을 위한 특징점 기반의 전처리 방법," 한국정보통신학회 논문지, 제15권, 제12호, pp.2527-2533, 2011.   과학기술학회마을   DOI   ScienceOn
7 Dong-Seok Lee, Min-Soo Ko, Young-Ho Seo, Dong-Wook Kim, Jisang Yoo, "Illumination compensation for multi-view video based on layered histogram matching with depth information," optics communication, Vol.286, pp.74-84, Jan. 2013.   DOI   ScienceOn
8 황선규, "영상처리 프로그래밍 by Visual C++", 한빛미디어, 2007.
9 Y. Mori, N. Fukushima, T. Yendoa, T. Fujii and M. Tanimotoa, "View generation with 3D warping using depth information for FTV," ELSEVIER Signal Processing : Image Communication, vol. 24, no. 1-2, pp. 65-72, Jan. 2009.   DOI   ScienceOn
10 ISO/IEC JTC1/SC29/WG11, "Introduction to 3D video," M9784, May. 2008.
11 M. Tanimoto, M. P. Tehrani, T. Fujii, and T. Yendo, "Free-viewpoint TV," IEEE Signal Processing Magazine, vol.28, pp.67-76, Jan. 2011.   DOI   ScienceOn
12 ISO/IEC JTC1/SC29/WG11, "Applications and Requirments on FTV," N9466, Oct. 2007.
13 Y. Mori, N. Fukushima, T. Yendo, T. Fujii, and M. Tanimoto, "View generation with 3D warping using depth information for FTV," Signal Processing : Image Communication, vol.24, pp.65-72, Jan. 2009.   DOI   ScienceOn
14 D. Scharstein and R. Szeliski, "A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms," IEEE Workshop on Stereo and Multi-Baseline Vision, pp.131-140, 2001.
15 ITU-T RECOMMENDATION "H.264 Advanced Video Coding for Generic Audiovisual Services," May, 2003.
16 http://mpeg.chiariglione.org/standards.htm
17 Joint Video Team (JVT) ISO/IEC MPEG &ITU& T VCEG, "Joint draft 3 Multi-view video coding," JVT-V209-M, Jan. 2007.
18 Y. Su, A. Vetro, and A. Smolic, "Common test conditions for multiview video coding," Doc. JVT-U211, [Online]. Available: http://ftp3.itu.ch/ av-arch/jvt-site/, 2005.
19 ISO/IEC JTC1/SC29/WG11, "Call for proposals on 3D video coding technology," n12036, March 2011.
20 ISO/IEC JTC1/SC29/WG11, "Test model for AVC-based 3D video coding v2.0," n12743, July 2012.
21 ISO/IEC JTC1/SC29/WG11, "Test model under consideration for HEVC based 3D video coding v3.0," n12744, April 2012.
22 S. Yea and A. Vetro, "View synthesis prediction for multiview video coding," Signal Processing : Image Communication, vol.24, pp.89-100, Jan. 2009.   DOI   ScienceOn
23 C. Lee, B.H. Choi, and Y.S. Ho, "Efficient multiview depth video coding using depth synthesis prediction," Optical Engineering, vol.50, no.7, pp.1-14, July 2011.
24 H. Schwarz, C. Bartnik, S. Bosse, H. Brust, T. Hinz, H. Lakshman, D. Marpe, P. Merkle, K. Muller, H. Rhee, G. Tech, M. Winken, and T. Wiegand, "3D video coding using advanced prediction Depth modeling, and encoder control methods," Picture Coding Symposium, pp.1-4, May 2012.
25 M. Gilge, "Motion estimation by scene adaptive block matching and illumination correction," Image Process. Algorithms and Techni., R. J. Moorhead and K. S. Pennington, Eds., Canada, vol. 1244, pp. 355-366, June 1990.   DOI
26 K. Kamikura, H. Watanabe, H. Jozawa, H. Kotera, and S. Ichinose, "Global brightness-variation compensation for video coding," IEEE Trans. Circuits Syst. Video Technol., vol.8, no.8, pp.988-1000, Dec. 1998.   DOI   ScienceOn