IEIE Transactions on Smart Processing and Computing

대한전자공학회 (The Institute of Electronics and Information Engineers)
권호 표지
DOI QR코드

DOI QR Code

Novel Motion and Disparity Prediction for Multi-view Video Coding

  • Lim, Woong (Department of Computer Engineering, Kwangwoon University) ;
  • Nam, Junghak (Department of Computer Engineering, Kwangwoon University) ;
  • Sim, Donggyu (Department of Computer Engineering, Kwangwoon University)
  • 투고 : 2013.11.22
  • 심사 : 2014.03.20
  • 발행 : 2014.06.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

This paper presents an efficient motion and disparity prediction method for multi-view video coding based on the high efficient video coding (HEVC) standard. The proposed method exploits inter-view candidates for effective prediction of the motion or disparity vector to be coded. The inter-view candidates include not only the motion vectors of adjacent views, but also global disparities across views. The motion vectors coded earlier in an adjacent view were found to be helpful in predicting the current motion vector to reduce the number of bits used in the motion vector information. In addition, the proposed disparity prediction using the global disparity method was found to be effective for interview predictions. A multi-view version based on HEVC was used to evaluate the proposed algorithm, and the proposed correspondence prediction method was implemented on a multi-view platform based on HEVC. The proposed algorithm yielded a coding gain of approximately 2.9% in a high efficiency configuration random access mode.

키워드

참고문헌

  1. T. Wiegand, W. Han, B. Bross, J. Ohm, and G. Sullivan, "WD2: Working Draft 2 of High-Efficiency Video Coding," Document of Joint Collaborative Team on Video Coding, JCTVC-D503, Daegu, KR, Jan. 2011.
  2. K. McCann, B. Bross, S. Sekiguchi, and W. Han, "High efficiency video coding (HEVC) test model 2 (HM 2) encoder description," Document of Joint Collaborative Team on Video Coding, JCTVC-D502, Daegu, KR, Jan. 2011.
  3. T. Wiegand, J. Ohm, G. Sullivan, W. Han, R. Joshi, T. Tan, and K. Ugur, "Special section on the joint call for proposals on high efficiency video coding (HEVC) standardization," IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 12, pp. 1661-1666, Dec. 2010. https://doi.org/10.1109/TCSVT.2010.2095692
  4. A. Luthra, "Scalable enhancement requirements for HEVC," Document of Joint Collaborative Team on Video Coding, JCTVC-E502, Geneva, CH, Mar. 2011.
  5. A. Luthra, J. Ohm, and J. Ostermann, "Draft call for proposals on the scalable video coding extensions of HEVC," The 98th MPEG meeting, N12398, Geneva, CH, Nov. 2011.
  6. ISO/IEC JTC1/SC29/WG11, "Applications and requirements on 3D video coding," The 96th MPEG meeting, N12035, Geneva, CH, Mar. 2011.
  7. H. Choi, J. Nam, D. Sim, and I. V. Bajic, "Scalable video coding based on high efficiency video coding (HEVC)," IEEE Pacific Rim Conference on Communications, Computers, and Signal Processing (PacRim2011), pp. 346-351, Victoria, CA, Aug. 2011.
  8. J. Nam, W. Lim, D. Sim, and I. V. Bajic, "Multi-view video coding based on high efficiency video coding (HEVC)," The 26th International Technical Conference on Circuits/Systems, Computers, and Communications, pp. 169-172, Gyeongju, KR, Jun. 2011.
  9. T. Wiegand, G. Sullivan, and A. Luthra, "Draft ITUT recommendation and final draft international standard of joint video specification," Joint Video Team (JVT) of ITU-T VCEG and ISO/IEC MPEG, JVT-G050r1, Geneva, CH, May 2003.
  10. J. Jung and G. Laroche, "Competition-based scheme for motion vector selection and coding," ITU-T SG16/Q.6 VCEG-AC06, Klagenfurt, DE, Jul. 2006.
  11. J. Yang, K. Won, and B. Jeon, "Motion vector coding with selection of an optimal predictive motion vector," SPIE Optical Engineering, vol. 48, no. 1, pp. 010501:1-3, Jan. 2009.
  12. M. Jang, C. Seo, and J. Han, "Motion estimation using region-based motion vector precision," The 26th International Technical Conference on Circuits/Systems, Computers, and Communications, pp. 823-825, Gyeongju, KR, Jun. 2011.
  13. M. Winken, S. Bobe, B. Bross, P. Helle, T. Hinz, H. Kirchhoffer, H. Lakshman, D. Marpe, S. Oudin, M. Preib, H. Schwarz, M. Siekmann, K. Suhring, and T. Wiegand, "Description of video technology proposal by Fraunhofer HHI," Document of Joint Collaborative Team on Video Coding, JCTVC-A116, Dresden, DE, Apr. 2010.
  14. Ken McCann, Woo-Jin Han, Il-Koo Kim, Jung-Hye Min, Elena Alshina, Alexander Alshin, Tammy Lee, Jianle Chen, Vadim Seregin, Sunil Lee, Yoon-Mi Hong, Min-Su Cheon, and Nikolay Shlyakhov, "Samsung's Response to the Call for Proposals on Video Compression Technology," Document of Joint Collaborative Team on Video Coding, JCTVC-A124, Dresden, DE, Apr. 2010.
  15. D. Kim, D. Min, and K. Sohn, "A stereoscopic video generation method using stereoscopic disparity characterization and motion," IEEE Transactions on broadcasting, vol. 54, no. 2, pp. 188-197, Jun. 2008. https://doi.org/10.1109/TBC.2007.914714
  16. G. Laroche, J. Jung, and B. Pesquet-Popescu, "RD optimized coding for motion vector predictor selection," IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 9, pp. 1247-1257, Sept. 2008. https://doi.org/10.1109/TCSVT.2008.928882
  17. L. Shen, Z. Liu, S. Liu, Z. Zhang, and P. An, "Selective disparity estimation and variable size motion estimation based on motion homogeneity for multi-view coding," IEEE Transactions on broadcasting, vol. 55, no. 4, pp. 761-766, Dec. 2009. https://doi.org/10.1109/TBC.2009.2030453
  18. Z. Deng, Y. Chan, K. Jia, C. Fu, and W. Siu, "Fast motion and disparity estimation with adaptive search range adjustment in stereoscopic video coding," IEEE Transactions on broadcasting, vol. 58, no. 1, pp. 24-33, Mar. 2012. https://doi.org/10.1109/TBC.2011.2174279
  19. W. Zhu, X. Tian, F. Zhou, and Y. Chen, "Fast disparity estimation using spatio-temporal correlation of disparity field for multiview video coding," IEEE Transactions on Consumer Electronics, vol. 56, no. 2, pp. 957-964, May 2010. https://doi.org/10.1109/TCE.2010.5506026
  20. D. Han, Y. Lee, and Y. Lee, "Fast mode decision using global disparity vector for multi-view video coding," IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, vol. E92.A, no. 12, pp. 3407-3411, Dec. 2009. https://doi.org/10.1587/transfun.E92.A.3407
  21. J. Lu, H. Cai, J.-G. Lou, and J. Li, "An epipolar geometry-based fast disparity estimation algorithm for multiview image and video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 6, pp. 737-750, Jun. 2007. https://doi.org/10.1109/TCSVT.2007.896659
  22. X. Guo, Y. Lu, F. Wu, and W. Gao, "Inter-view direct mode for multi-view video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 12, pp. 1527-1532, Dec. 2006. https://doi.org/10.1109/TCSVT.2006.885724
  23. J. Youn, M.-T. Sun, and C.-W. Lin, "Motion vector refinement for high performance transcoding," IEEE Transactions on Multimedia, vol. 1, no. 1, pp. 30-40, Mar. 1999. https://doi.org/10.1109/6046.748169
  24. Y. Su, M.-T. Sun, and V. Hsu, "Global motion estimation from coarsely sampled motion vector field and the applications," IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 2, pp. 232-242, Feb. 2005. https://doi.org/10.1109/TCSVT.2004.841656
  25. Y.-M Chen and I. V. Bajic, "A joint approach to global motion estimation and motion segmentation from a coarsely sampled motion vector field," IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 9, pp. 1316-1328, Sep. 2011. https://doi.org/10.1109/TCSVT.2011.2148490
  26. http://hevc.kw.bbc.co.uk/trac/ browser/ tags/HM-2.0, HM2.0 software.
  27. ISO/IEC JTC1/SC29/WG11, "Call for proposals on 3D video coding technology," The 96th MPEG meeting, N12036, Geneva, CH, Mar. 2011.
  28. F. Bossen, "Common Test Conditions and Software Reference Configurations," Document of Joint Collaborative Team on Video Coding, JCTVC-D600, Daegu, KR, Jan. 2011.
  29. G. Bjontegaard, "Calculation of average PSNR differences between RD-Curves," ITU-T SG16/Q.6, VCEG-M33, Austin, TX, Apr. 2001.