Browse > Article

Fast Multi-View Synthesis Using Duplex Foward Mapping and Parallel Processing  

Choi, Ji-Youn (한양대학교 컴퓨터공학과 가상현실 연구실)
Ryu, Sae-Woon (한양대학교 컴퓨터공학과 가상현실 연구실)
Shin, Hong-Chang (한국전자통신연구소 방송시스템연구부)
Park, Jong-Il (한양대학교 컴퓨터공학과 가상현실 연구실)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.34, no.11B, 2009 , pp. 1303-1310 More about this Journal
Abstract
Glassless 3D display requires multiple images taken from different viewpoints to show a scene. The simplest way to get multi-view image is using multiple camera that as number of views are requires. To do that, synchronize between cameras or compute and transmit lots of data comes critical problem. Thus, generating such a large number of viewpoint images effectively is emerging as a key technique in 3D video technology. Image-based view synthesis is an algorithm for generating various virtual viewpoint images using a limited number of views and depth maps. In this paper, because the virtual view image can be express as a transformed image from real view with some depth condition, we propose an algorithm to compute multi-view synthesis from two reference view images and their own depth-map by stepwise duplex forward mapping. And also, because the geometrical relationship between real view and virtual view is repetitively, we apply our algorithm into OpenGL Shading Language which is a programmable Graphic Process Unit that allow parallel processing to improve computation time. We demonstrate the effectiveness of our algorithm for fast view synthesis through a variety of experiments with real data.
Keywords
3D Display; View Synthesis; Parallel Processing; GPU(Graphic Processing Unit) Processing; OpenGL Shading Language;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H.-C. Shin, Y.-J. Kim, H. Park, J.-I. Park, 'Fast view synthesis using GPU for 3D display,' IEEE Trans. Consumer Electronics, Vol.54, No.4, pp. 2068-2076, Nov., 2008   DOI   ScienceOn
2 D, Scharstein, 'View synthesis using stereo vision,' Lecture Notes in Computer Science (LNCS), Vol.1583, 1999
3 GPGPU, http://www.gpgpu.org
4 C. Jin and H. Jeong, 'Intermediate view synthesis for multi-view 3D displays using belief propagation-based stereo matching,' Proc. of International Conference on Convergence and Hybrid Information Technology, Vol.1, pp.919-924, 2008   DOI
5 P. Kauffm, N. Atzpadin, C. Fehn, M. Muller, O. Schreer, A. Smolic and R. Tanger, 'Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability,' Signal Processing: Image communication, Vol.22, No.2, pp. 217-234, 2007   DOI   ScienceOn
6 K.-J. Oh, S. Yea, and Y.-S. Ho, 'Hole-filling method using depth based in-painting for view synthesis in free viewpoint television (FTV) and 3D video,' Proc. of Picture Coding Symposium (PCS), 2009   DOI
7 M. Pharr and R. Fernando, GPU Gems 2: Programming Techniques for High Performance Graphics and General-Purpose Computation, 2005
8 Middlebury Stereo Vision Page, http://vision.middlebury.edu/stereo
9 M. Bleyer, M. Gelautz, and C. Rother, C. Rhemann, 'A stereo approach that handles the matting problem via image warping,' Computer Vision and Pattern Recognition, 2009   DOI
10 K. Wegner and O. Stankiewicz, 'Similarity measures for depth estimation,' Proc. of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009   DOI
11 R.S. Wright, Jr. and B. Lipchak, OpenGL Superbible, 3rd edition, Sams Publishing, 2005
12 R. J. Rost, OpenGL Shading Language, second edition, Addison Wesley Professional, 2006