The Transactions of the Korean Institute of Electrical Engineers D (대한전기학회논문지:시스템및제어부문D)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지

Multi-Image Stereo Method Using DEM Fusion Technique

DEM 융합 기법을 이용한 다중영상스테레오 방법

  • Published : 2003.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

The ability to efficiently and robustly recover accurate 3D terrain models from sets of stereoscopic images is important to many civilian and military applications. A stereo matching has been an important tool for reconstructing three dimensional terrain. However, there exist many factors causing stereo matching error, such as occlusion, no feature or repetitive pattern in the correlation window, intensity variation, etc. Among them, occlusion can be only resolved by true multi-image stereo. In this paper, we present multi-image stereo method using DEM fusion as one of efficient and reliable true multi-image methods. Elevations generated by all pairs of images are combined by the fusion process which accepts an accurate elevation and rejects an outlier. We propose three fusion schemes: THD(Thresholding), BPS(Best Pair Selection) and MS(Median Selection). THD averages elevations after rejecting outliers by thresholding, while BPS selects the most reliable elevation. To determine the reliability of a elevation or detect the outlier, we employ the measure of self-consistency. The last scheme, MS, selects the median value of elevations. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental results indicate that all three fusion schemes showed much better improvement over the conventional binocular stereo in natural terrain of 29 Palms and urban site of Avenches.

Keywords

References

  1. T. Kanade, M. Okutumi, 'A Stereo matching algorithm with adaptive window : Theory and experiment', IEEE Trans, Pattern Anal. Machine Intell., vol. 16, no. 8, pp. 920-932, 1994 https://doi.org/10.1109/34.310690
  2. 우동민,'적응적인 스테레오 정합 기법에 의한 3차원 지형 복원', 대한전기학회 논문집 47권 12호, pp.2229-2236, 1998
  3. Agouris, Peggy, T. Schenk, 'Automates Aerotriangulation Using Multiple Image Multipoint Matching, ' Photogrammetric Engineering and Remote Sensing, vol. LXII, no.6, pp.703-710, 1996
  4. Fua. P, Y.G. Leclerc, 'Taking Advantage of Image Based and Geometry Based Constraints to Recover 3D Surfaces', Computer Vision and Image Understanding, vol.64,no.1, pp.111-127, 1996 https://doi.org/10.1006/cviu.1996.0048
  5. M. Okutomi, T. Kanade, 'A Multiple-Baseline Stereo,' IEEE Pattern Analysis and Machine Intelligence, vol.15, no. 4, pp.353-363, 1993 https://doi.org/10.1109/34.206955
  6. A. Gruen, E. Baltsavias, 'Geometrically Constrained Multiphoto Matching', Photogrammetric Engineering and Remote Sensing, vol. 54, no. 4, pp.633-641, 1988
  7. M. Kumar, P. Anandan, K. Hanna, 'Shape Recovery from Multiple views: A Parallax Based Approach,' Arpa IUW, Monterey, CA, pp.947-955, 1994
  8. R.T. Collins, 'A Space-Sweep Approach to True Multi-Image Matching', Proc. IEEE Computer Vision and Pattern Recognition, San Francisco. CA, pp.358-363, 1996 https://doi.org/10.1109/CVPR.1996.517097
  9. U. Helava, 'Object-Space Least-Squares Correlation,' Photogrammetric Engineering and Remote Sensing, vol. 54, no. 6, pp.711-714, 1988
  10. P. Fua, Y. Leclerc, 'Object-centered Suirface Reconstruction: Combining Multi-Image Stereo and Shading,' IJCV, vol. 16, no. 1, pp.35-56, 1995 https://doi.org/10.1007/BF01428192
  11. George T. Chou, Seth Teller, 'Multi-Image Correspondence using Geometric and Structural Constraints', Proc. 1997 Image Understanding Workshop, pp. 869-874, 1997
  12. Min-Suk Kim, Dong-Min Woo, 'Multi-Image Stereo Technique Using Self-Consistency,' 전기학회 논문지 제50권 제5호 pp.226-232, 2001
  13. Leclerc, Y.G., Q.T. Luong, et al., 'Self-consistency: A novel approach to characterizing the accuracy and reliability of point correspondence algorithms,' DARPA Image Understanding Workshop, Monterey, CA, Morgan Kauffman, 1998
  14. Chang-Woo Nam, Dong-Min Woo, 'DEM Estimation Using Two Stage Stereo Matching Method', 전기학회논문지 제49권 제 12호 pp.659-666, 2000
  15. Howard Schultz, Edward M. Riseman, Frank R.Stolle, Dong-Min Woo, 'Error Detection and DEM Fusion Using Self-Consistency' 7th IEEE International Conference on Computer Vision 1999 https://doi.org/10.1109/ICCV.1999.790413