Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

Hierarchical Disparity Estimation for Image Synthesis in Stereo Mixed Reality

스테레오 혼합 현실 영상 합성을 위한 계층적 변이 추정

  • 김한성 (연세대학교 전기전자공학과) ;
  • 최승철 (연세대학교 전기전자공학과) ;
  • 손광훈 (연세대학교 전기전자공학과)
  • Published : 2002.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

Natural synthesis of real and virtual images is a key technology in mixed reality. For this purpose, we propose an efficient dense disparity estimation algorithm and a synthesis algorithm considering features of stereo images. Dense disparities are estimated hierarchically from the low to high resolution images. In the process, the region-dividing-bidirectional-matching algorithm makes matching process efficient and keeps the reliability of the estimated disparities, and dense disparities are assigned considering edge information. finally, mixed reality stereo images are synthesized by comparing depth data of real and virtual Images. Computer simulation shows that the proposed algorithms estimate very stable disparity vectors with sharp edge and synthesize natural stereo mixed reality images.

본 논문에서는 혼합현실의 핵심 기술인 실사와 가상 영상의 합성을 위해 스테레오 영상의 특성을 고려하여 효율적으로 미세 변이를 추정하는 알고리듬과, 추정된 깊이 정보를 이용해 영상을 자연스럽게 합성하는 알고리듬을 제안하며, 이를 모의실험을 통해 검증한다. 제안 방법은 낮은 해상도의 영상으로부터 고해상도로 변이를 찾아가는 계층적 변이 추정 방식으로, 영역분할 양방향 화소정합을 통해 변이 추정의 수행 속도를 향상시키는 동시에 신뢰도를 높이며, 에지 정보를 참조하여 화소 단위로 미세 변이를 할당하게 된다. 이렇게 추정된 깊이 정보는 모델링된 가상 객체의 깊이 정좌와의 비교를 통해 혼합 현실 스테레오 영상으로 합성된다. 제안된 방식을 통해 매우 안정적이면서도 경계 부분이 정확한 변이 정보를 얻을 수 있었고, 3차원 영상의 합성에 효율적으로 사용될 수 있음을 실험을 통해 확인하였다.

Keywords

References

  1. R. T. Azuma, 'A survey of Augmented Reality,' Presence. Vol. 6, No. 4. pp. 335-385, Aug. 1997.
  2. S. Benford, C. Greenhalgh, G. Reynard, C. Brown and B. Koleva, 'Understanding and Constructing Shared Spaces with Mixed-Reality Boundaries,' ACM Transactions on Computer-Human Interaction, Vol. 5, No. 3, pp. 185-223, Sept. 1998 https://doi.org/10.1145/292834.292836
  3. Y. Nakazawa, S. Nakano, T. Komatu and Takahiro Saitou, 'A System for Composition of Real Moving Images and CG Images based on Image Feature Points,' The Journal of the institute of image information and television engineers, Vol. 51, No. 7, pp. 1086-1095, Jul. 1997 https://doi.org/10.3169/itej.51.1086
  4. T. Okuma, K. Kiyokawa, H. Takemura and N. Yokoya, 'An augmented reality system using a real-time vision based registration,' Proc. ICPR '98, Vol. 2, pp. 1226-1229, 1998
  5. Puri, R. V. Kollarits and B. G. Haskell, 'Basics of stereoscopic video, new compressionresults with MPEG-2 and a proposal for MPEG-4,' Signal Processing: Image Comm. 10, pp. 201-234, 1997
  6. Y. Wang and O. Lee, 'Use of 2-D deformable mesh structures for video coding, Part I-The synthesis problem: Mesh-based function approximation and mapping,' IEEE Trans. on Circuits and Systems for Video Tech., Vol.6, No. 6, pp. 636-646, Dec. 1996 https://doi.org/10.1109/76.544735
  7. Y. Ohta and T. Kanade, 'Stereo by intraand interand inter-scanline search using dynamic programming,' IEEE Trans. on Pattern Anal. Machine Intell., Vol. 7, No. 2, pp. 139-154, Mar. 1985 https://doi.org/10.1109/TPAMI.1985.4767639
  8. C. Lin, E. Fei and Y.Chen, 'Hierarchical disparity estimation using spatial correlation,' IEEE Trans. on Consumer Electronics, Vol. 44, No. 3, pp. 630-637, Aug. 1998 https://doi.org/10.1109/30.713174
  9. P. Kauff, N. Brandenburg, M. Karl and O. Schreer, 'Fast hybrid blockand pixel-recursive disparity analysis for real-time applications in immersive teleconference scenario,' Proc. of 9th Int. Conf. on Comp. Graphics, Visualization and Computer Vision, Feb. 2000
  10. H. J. Song, 'A study on the image transmission technique with the effective preprocessing,' MS Thesis, Yonsei University, Dec. 1997
  11. H. S. Kim 'Feature-Based Disparity Estimation and Intermediate View Reconstruction of 3D Images,' MS Thesis, Yonsei University, Aug. 2001
  12. R. C. Gonzalez and R. E. Wood, 'Digital Image Procesing,' Addison-Wesley publishing company, 1993
  13. M. E. Izquierdo, 'Stereo image analysis for multi-viewpoint telepresence applications,' Signal Processing :Image Comm. 11, pp. 231-254, 1998