Browse > Article

Multi-Depth Map Fusion Technique from Depth Camera and Multi-View Images  

엄기문 (한국전자통신연구원 디지털방송연구단 방송시스템연구그룹)
안충현 (한국전자통신연구원 디지털방송연구단 방송시스템연구그룹)
이수인 (한국전자통신연구원 디지털방송연구단 방송시스템연구그룹)
김강연 (광주과학기술원 기전공학과)
이관행 (광주과학기술원 기전공학과)
Publication Information
Journal of Broadcast Engineering / v.9, no.3, 2004 , pp. 185-195 More about this Journal
Abstract
This paper presents a multi-depth map fusion method for the 3D scene reconstruction. It fuses depth maps obtained from the stereo matching technique and the depth camera. Traditional stereo matching techniques that estimate disparities between two images often produce inaccurate depth map because of occlusion and homogeneous area. Depth map obtained from the depth camera is globally accurate but noisy and provide a limited depth range. In order to get better depth estimates than these two conventional techniques, we propose a depth map fusion method that fuses the multi-depth maps from stereo matching and the depth camera. We first obtain two depth maps generated from the stereo matching of 3-view images. Moreover, a depth map is obtained from the depth camera for the center-view image. After preprocessing each depth map, we select a depth value for each pixel among them. Simulation results showed a few improvements in some background legions by proposed fusion technique.
Keywords
3D scene reconstruction; depth map;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. H. Esteban and F. Schmitt, 'Silhouette and Stereo Fusion for 3D Object Modeling,' Proceedings of 3DIM'03, pp. 46-53, Oct. 2003
2 S. F. El-Hakim. C. Brenner, G. Roth, 'A Multi-sensor Approach to Create Accurate Virtual Environments,' ISPRS Journal for Photogrammetry and Remote Sensing, vol. 54, no.6, pp. 379-391, Dec. 1998
3 A. R. Chowdhury and R. Chellappa, 'A Robust Algorithm for Fusing Noisy Depth Estimates Using Stochastic Approximation,' Proceedings of IEEE, ICASSP-01, 2001
4 Y. Matusumoto, K. Fujimura, and T. Kitamura, 'Shape-from-silhouette/stereo and its Application to 3-d Digitizer,' Proceedings of Discrete Geometry for Computing Imagery, pp. 177-190, 1999
5 Hong Jeong, Sung-Chan Park, 'Trellis-based Systolic Multi-layer Stereo Matching,' Proceedings of IEEE Workshop on Signal Processing Systems 2003, 257-262, Aug., 2003
6 P. Fua, and Y. G. Leclerc, 'Object-centered Surface Reconstruction: Combining Multi-image Stereo and Shading,' Int. J. of Computer Vision, vol. 16, pp.35-56, 1995
7 http://www.3dvsystems.com
8 S. Y. Park and M. Subbarao, 'A Range Image Refinement Technique for Multi-view 3D Model Reconstruction,' Proceedings of 3DIM'03, pp. 147-154, Oct. 2003
9 G. Cross, and A. Zisserman, 'Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture,' Proceedings of NATO Advanced Research Workshop on Confluence of Computer Vision and Computer IGraphics, pp. 25-47, 2000
10 M. Li, H. Schirmacher, M. Magnor, and H. P. Seidel, 'Combining Stereo and Visual Hull Information for On-line Reconstruction and Rendering of Dynamic Scenes,' IEEE Workshop on MMSP, pp. 9-12, 2002
11 C. L. Zitnick and T. Kanade, 'Cooperative Algorithm for Stereo Matching and Occlusion Detection,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 7, July 2000
12 P. Dias, V. Sequeira, F. Vaz, and J. G. M. Gonoalves, 'Registration and Fusion of Intensity and Range Data for 3D Modeling of Real World Scenes,' Proceedings of 3DIM'03, pp. 418-426, Oct. 2003
13 P. Dias, V. Sequeira, F. Vaz, and J. G. M. Gonçalves, 'Registration and Fusion of Intensity and Range Data for 3D modeling of Real World Scenes,' Proceedings of 3DIM'03, pp. 418-426, Oct. 2003
14 J. Gluckman and S. K. Nayar, “Rectifying Transformations that Minimize Resampling Effects,” Proceedings of Computer Vision and Pattern Recognition 2001 (CVPR'01), pp.111-117, vol. 1, Dec. 2001