Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Virtual View Rendering for 2D/3D Freeview Video Generation

2차원/3차원 자유시점 비디오 재생을 위한 가상시점 합성시스템

  • Min, Dong-Bo (School of Electrical & Electronic Engineering, Yonsei University) ;
  • Sohn, Kwang-Hoon (School of Electrical & Electronic Engineering, Yonsei University)
  • 민동보 (연세대학교 전기전자공학부) ;
  • 손광훈 (연세대학교 전기전자공학부)
  • Published : 2008.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new approach for efficient multiview stereo matching and virtual view generation, which are key technologies for 3DTV. We propose semi N-view & N-depth framework to estimate disparity maps efficiently and correctly. This framework reduces the redundancy on disparity estimation by using the information of neighboring views. The proposed method provides a user 2D/3D freeview video, and the user can select 2D/3D modes of freeview video. Experimental results show that the proposed method yields the accurate disparity maps and the synthesized novel view is satisfactory enough to provide user seamless freeview videos.

3DTV를 위한 핵심 기술 중의 하나인 다시점 영상에서 변이를 추정하고 가상시점을 합성하는 새로운 방식을 제안한다. 다시점 영상에서 변이를 효율적이고 정확하게 추정하기 위해 준 N-시점 & N-깊이 구조를 제안한다. 이 구조는 이웃한 영상의 정보를 이용하여 변이 추정 시 발생하는 계산상의 중복을 줄인다. 제안 방식은 사용자에게 2D와 3D 자유시점을 제공하며, 사용자는 자유시점 비디오의 모드를 선택할 수 있다. 실험 결과는 제안 방식이 정확한 변이 지도를 제공하며, 합성된 영상이 사용자에게 자연스러운 자유시점 비디오를 제공한다는 것을 보여준다.

Keywords

References

  1. https://www.3dtv-research.org
  2. E. Chen and L. Williams, "View interpolation for image synthesis," SIGGRAPH, pp. 279-288, 1993
  3. L. Zhang, D. Wang, and A. Vincent, "Adaptive Reconstruction of Intermediate Views From Stereoscopic Images," IEEE Trans. Circuits and Systems for Video Technology, vol. 16, no. 1, pp. 102-113, Jan. 2006 https://doi.org/10.1109/TCSVT.2005.857785
  4. A. Criminisi, A. Blake and C. Rother, "Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic Programming," International Journal of Computer Vision, vol. 71, no. 1, pp. 89-110, 2007 https://doi.org/10.1007/s11263-006-8525-1
  5. P. Kauff, N. Atzpadin, C. Fehn, M. Muller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Signal Processing: Image Communication, vol. 22, pp. 217-234, 2007 https://doi.org/10.1016/j.image.2006.11.013
  6. L. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," SIGGRAPH, pp. 598-606, 2004
  7. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Journal of Computer Vision, vol. 47, no. 1-3, pp. 7-42, Apr. 2002 https://doi.org/10.1023/A:1014573219977
  8. K. Yoon and I. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Trans. PAMI, vol. 28, no. 4, pp. 650-656, Apr. 2006 https://doi.org/10.1109/TPAMI.2006.70
  9. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions using graph cuts," Proc. IEEE International Conf. Computer Vision, pp. 508-515, 2001
  10. J. Sun, N-N. Zheng, and H-Y. Shum, "Stereo Matching Using Belief Propagation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 787-800, 2003 https://doi.org/10.1109/TPAMI.2003.1206509
  11. C. Fehn, R. Barre, and S. Pastoor, "Interactive 3-DTV-Concepts and Key Technologies," Proceedings of the IEEE, vol. 94, no. 3, pp. 524-538, Mar. 2006 https://doi.org/10.1109/JPROC.2006.870688
  12. http://vision.middlebury.edu/stereo
  13. http://diml.yonsei.ac.kr/-forevertin