Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

A Quadtree-based Disparity Estimation for 3D Intermediate View Synthesis

3차원 중간영상의 합성을 위한 쿼드트리기반 변이추정 방법

  • 성준호 (연세대학교 전기전자공학과) ;
  • 이성주 (삼성전자(주) DM총괄) ;
  • 김성식 (삼성전자(주) DM총괄) ;
  • 하태현 (연세대학교 전기전자공학과) ;
  • 김재석 (연세대학교 전기전자공학과)
  • Published : 2004.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

In stereoscopic or multi-view three dimensional display systems, the synthesis of intermediate sequences is inevitably needed to assure look-around capability and continuous motion parallax so that it could enhance comfortable 3D perception. The quadtree-based disparity estimation is one of the most remarkable methods for synthesis of Intermediate sequences due to the simplicity of its algorithm and hardware implementation. In this paper, we propose two ideas in order to reduce the annoying flicker at the object boundaries of synthesized intermediate sequences by quadtree-based disparity estimation. First, new split-scheme provides more consistent auadtree-splitting during the disparity estimation. Secondly, adaptive temporal smoothing using correlation between present frame and previous one relieves error of disparity estimation. Two proposed Ideas are tested by using several stereoscopic sequences, and the annoying flickering is remarkably reduced by them.

스테레오 방식 및 다시점 3차원 영상시스템에서, 관찰자에게 룩어라운드 기능 및 연속적인 운동시차를 부여하여 보다 안락한 3차원 현실감을 제공하기 위해서 중간영상의 합성이 요구된다. 쿼드트리기반의 변이추정은 그 알고리즘과 하드웨어 구현의 간편성 때문에 중간영상의 합성을 위한 유력한 방법 중 하나이다. 본 논문에서는 쿼드트리기반의 변이추정을 이용하여 합성된 중간영상의 물체간 경계에서 발생하는 플리커링을 제거하기 위하여 두가지의 아이디어를 제안한다. 첫째, 새로운 분할방법은 변이추정 동안 보다 일관된 쿼드트리 분할을 부여한다. 둘째, 이전프레임과 현재프레임의 상관성을 이용하는 적응적 시간평활화는 변이추정의 오류를 감소시켜준다. 두가지의 제안된 아이디어는 여러 스테레오영상을 이용해 검증되었으며, 플리커링이 상당히 감소됨을 확인하였다.

Keywords

References

  1. M.H. Kim and K.H. Sohn, 'Edge-preserving directional regularization technique for disparity estimation of stereoscopic images,' IEEE Trans. Consumer Electronics, vol. 45, no. 3, pp. 804-811, Aug. 1999
  2. J. Konrad, 'View reconstruction for 3-D video entertainment: issues, algorithms and applications,' Proc. of Int. Conf. on Image Processing and its Applications, pp. 8-12, July 1999
  3. A. Mancini and J. Konrad, 'Robust quadtree-based disparity estimation for the reconstruction of intermediate stereoscopic images,' IS$T/SPIE Symposium on Electronic Imaging Stereoscopic Displays and Virtual Reality Systems, vol. 3295, pp. 53-64, Jan. 1998
  4. A. Puri, R.V. Kollarits, and B.G. Haskell, 'Basics of stereoscopic video, new compression results with MPEG-2 and a proposal for MPEG-4,' Signal Processing: Image Communication, no. 10, pp. 201-234, 1997
  5. C.L. Pagliari, M.M. Perez, and T.J. Dennis, 'Reconstruction of intermediate views from stereoscopic images using a rational filter,' Proc. of IEEE Int. Conf. on Image Processing, vol. 2, pp. 627-631, Oct. 1998
  6. J.R. Ohm and E. Izquierdo, 'An object-based system for stereoscopic viewpoint synthesis,' IEEE Trans. Circuits Sys. Video Tech., vol. 7, no. 5, pp. 801-811, Oct. 1997
  7. M.M. Perez, C.L. Pagliari, and T.J. Dennis, 'Stereo-based intermediate view synthesis with realistic 'look around' capability,' Electronic Letters, vol. 34, no. 19, Sep. 1998
  8. C. Vazquez, J. Konrad, and E. Dubois, 'Wavelet-based reconstruction of irregularly-sampled images: application to stereo imaging,' Proc. of Int. Conf. on Image Processing vol. 2 pp. 319-322 Sept. 2000
  9. M. B. Slima, J. Konrad, and A. Barwicz, 'Improvement of stereo disparity estimation through balanced filtering: the sliding-block approach,' IEEE Trans. Circuits and Systems, Video Tech., vol. 7, no. 6, pp. 913-920, Dec. 1997