Browse > Article
http://dx.doi.org/10.5909/JBE.2010.15.6.768

New Illumination compensation algorithm improving a multi-view video coding performance by advancing its temporal and inter-view correlation  

Lee, Dong-Seok (Electronic Engineering Dept. Kwangwoon University)
Yoo, Ji-Sang (Electronic Engineering Dept. Kwangwoon University)
Publication Information
Journal of Broadcast Engineering / v.15, no.6, 2010 , pp. 768-782 More about this Journal
Abstract
Because of the different shooting position between multi-view cameras and the imperfect camera calibration, Illumination mismatches of multi-view video can happen. This variation can bring about the performance decrease of multi-view video coding(MVC) algorithm. A histogram matching algorithm can be applied to recompensate these inconsistencies in a prefiltering step. Once all camera frames of a multi-view sequence are adjusted to a predefined reference through the histogram matching, the coding efficiency of MVC is improved. However the histogram distribution can be different not only between neighboring views but also between sequential views on account of movements of camera angle and some objects, especially human. Therefore the histogram matching algorithm which references all frames in chose view is not appropriate for compensating the illumination differences of these sequence. Thus we propose new algorithms both the image classification algorithm which is applied two criteria to improve the correlation between inter-view frames and the histogram matching which references and matches with a group of pictures(GOP) as a unit to advance the correlation between successive frames. Experimental results show that the compression ratio for the proposed algorithm is improved comparing with the conventional algorithms.
Keywords
multiview video coding (MVC); GOP; gaussian mixture model (GMM); histogram matching; illumination compensation (IC);
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 C. A. Bouman, "Cluster: An unsupervised algorithm for modeling gaussian mixtures," http://cobweb.ecn.purdue.edu/bouman/software/cluster/, this version was released in Jul.2005.
2 이동석, 유지상, "깊이 정보에 따른 레이어별 히스토그램 매칭을 이용한 조명 불일치 보상 기법", 한국통신학회 논문지, 8월개재예정   과학기술학회마을
3 ""Call for proposals on multi-viewvideo coding,"" ISO/IEC-JTC1/SC29/WG11 MPEG Document N7327, Jul. 2005.
4 M. Gilge, ""Motion estimation by scene adaptive block matching and illumination correction,"" in Proc. Image Process. Algorithms and Techn., R. J. Moorhead and K. S. Pennington, Eds., Canada, June 1990, vol. 1244, pp. 355-366.
5 K. Kamikura, H. Watanabe, H. Jozawa, H. Kotera, and S. Ichinose," "Global brightness-variation compensation for video coding,"" IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 8, Dec. 1998.
6 Y. Altunbasak, R. Mersereau, and A. Patti, ""A fast parametric motion estimation algorithm with illumination and lens distortion correction,"" IEEE Trans. Image Process., vol. 12, no. 4, pp. 395-408, Apr. 2003.   DOI   ScienceOn
7 J. Lopez, J. Kim, A. Ortega, and G. Chen, ""Block-based illumination compensation and search techniques for multiview video coding,"" in Picture Coding Symp. (PCS) 2004, Dec. 2004.
8 이동석, 서영호, 김동욱, 유지상, "다시점 비디오의 조명 보상을 위한 에지 방향성을 고려한 새로운 전처리 기법", 한국방송공학회 학술대회, Jul. 2010.   과학기술학회마을
9 U. Fecker, M. Barkowsky, and A. Kaup, "Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video," IEEE Trans. ,vol. 18, no 9, Sep. 2008.
10 ITU-T RECOMMENDATION H.264 ""Advanced Video Coding for Generic Audiovisual Services"". May 2003.
11 PL.Lai, A. Ortega, P. Pandit, P. Yin, C. Gomila, "Adaptive Reference Filtering for MVC", JVT-W065.doc, San Jose, USA, April 21-27, 2007.
12 이동석, 서영호, 김동욱, 유지상, "깊이 정보에 따라 여러 객체로 분리한 영상 단위의 히스토그램 매칭에 기반한 다시점 비디오의 조명 불일치 보상 기법," 한국방송공학회 학술대회, Jul. 2010.   과학기술학회마을
13 D.-S. Lee, Y.-H. Seo, D.-W. Kim, and J.-S. Yoo, "Depth-Dependent Histogram Matching for Illumination Compensation of Multiview Video," International Conference on 3D Systems and Application, pp. 227-230, May 2010.
14 Y. Su, A. Vetro, and A. Smolic, ""Common test conditions for multiview video coding,""(2006) Doc. JVT-U211, [Online]. Available: http://ftp3.itu.ch/av-arch/jvt-site/
15 이동석, 유지환, 유지상, "히스토그램 매칭을 이용한 다시점 비디오의 휘도와 색차 성분 보상 기법", 한국방송공학회 학술대회, Nov. 2009, pp. 191-194.   과학기술학회마을
16 Kim S, Park RH. A novel approach to scene change detection using a cross entropy. In: IEEE International Conference on Image Processing, vol. 3, Vancouver, Canada, September 2000. p. 937-40.
17 S.H. Kim and R-.H. Park, Efficient algorithm for video sequence matching using the modified Hausdorff distance and the directed divergence. IEEE Transactions on CSVT 12 7 (2002), pp. 592-596.
18 이동석, 유지상, "다시점 비디오의 휘도 및 색차 성분 불일치 보상을 위한 히스토그램 매칭 기반의 전처리 기법", 전자공학회 논문지, 11월개재예정   과학기술학회마을
19 U. Fecker, M. Barkowsky, and A. Kaup, "Time-constant histogram matching for colour compensation of multi-view video sequences," in Proc. 26th Picture Coding Symp. (PCS 2007), Lisbon, Portugal, Nov.2007.