The Transactions of the Korean Institute of Electrical Engineers D (대한전기학회논문지:시스템및제어부문D)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지

3D Line Segment Detection using a New Hybrid Stereo Matching Technique

새로운 하이브리드 스테레오 정합기법에 의한 3차원 선소추출

  • Published : 2004.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

We present a new hybrid stereo matching technique in terms of the co-operation of area-based stereo and feature-based stereo. The core of our technique is that feature matching is carried out by the reference of the disparity evaluated by area-based stereo. Since the reference of the disparity can significantly reduce the number of feature matching combinations, feature matching error can be drastically minimized. One requirement of the disparity to be referenced is that it should be reliable to be used in feature matching. To measure the reliability of the disparity, in this paper, we employ the self-consistency of the disunity Our suggested technique is applied to the detection of 3D line segments by 2D line matching using our hybrid stereo matching, which can be efficiently utilized in the generation of the rooftop model from urban imagery. We carry out the experiments on our hybrid stereo matching scheme. We generate synthetic images by photo-realistic simulation on Avenches data set of Ascona aerial images. Experimental results indicate that the extracted 3D line segments have an average error of 0.5m and verify our proposed scheme. In order to apply our method to the generation of 3D model in urban imagery, we carry out Preliminary experiments for rooftop generation. Since occlusions are occurred around the outlines of buildings, we experimentally suggested multi-image hybrid stereo system, based on the fusion of 3D line segments. In terms of the simple domain-specific 3D grouping scheme, we notice that an accurate 3D rooftop model can be generated. In this context, we expect that an extended 3D grouping scheme using our hybrid technique can be efficiently applied to the construction of 3D models with more general types of building rooftops.

Keywords

References

  1. D. J. Panton, 'A flexible approach to digital stereo mapping', Photogram Eng. Remote Sensing, vol. 44, no. 12, pp. 1499-1512, 1978
  2. M. J. Hannah, 'A system for digital stereo image matching', Photogrammetric Engineering and Remote Sensing, vol. 55, no. 12, pp. 1765-1770, 1989
  3. Y. Hung, C. Chen, K. Hung, Y. Chen, C. Fuh, 'Multipass hierarchical stereo matching for generation of digital terrain models from aerial images', Machine Vision and Applications, vol. 10, no. 5/6, pp. 280-291, 1998 https://doi.org/10.1007/s001380050079
  4. H. Mostafavi, 'Image correaltion with geometric distortion. Part Ⅱ: Effects on local accuracy', IEEE Trans. Aerospace and Electronic Systems, vol, 14, no. 3, pp. 494-500, 1978 https://doi.org/10.1109/TAES.1978.308611
  5. W. E. L. Grimson, 'Computational experiments with feature based stereo algorithm', IEEE Trans. Pattern Anal. Mach. Intell., vol. 7, no. 1, pp. 17-34, 1985 https://doi.org/10.1109/TPAMI.1985.4767615
  6. D. Marr, and T. Poggio, 'A computational theory of human stereo vision', Proc. Roy. Soc. London B204, pp. 301-328, 1979 https://doi.org/10.1098/rspb.1979.0029
  7. D. De Vleeschauwer, 'An intensity-based, coarse-to-fine approach to reliably measure binocular disparity', CVGIP: Image Understanding, vol. 57, no. 2, pp. 204-218, 1993 https://doi.org/10.1006/ciun.1993.1013
  8. T. Kanade and M. Okutumi, 'A Stereo matching algorithm with adaptive window: theory and experiment', IEEE Trans. Pattern Anal. Machine Intell. vol. 16, No. 8, pp. 920-932, 1994 https://doi.org/10.1109/34.310690
  9. K. Y. Han, T. M. Bae and Y. H. ha, 'Hybrid stereo matching with a new relaxation scheme of preserving disparity discontinuity', Pattern Recongnition, vol. 33, pp. 767-785, 2000 https://doi.org/10.1016/S0031-3203(99)00095-3
  10. Y. Leclerc and Q. Luong, 'Self-consistency: A novel approach to characterizing the accuracy and reliability of point correspondence algorithms', DARPA Image Understanding Workshop, Monterey, CA,Morgan Kauffman, 1998
  11. H. Schultz, A. Hanson, E. Reisman, F. Stolle, Z. Zhu, D. Woo, 'A self-consistency technique for fusing 3D information', Proceessing of 5th Int. Conf. on Information Fusion, pp. 1106-1112, 2002 https://doi.org/10.1109/ICIF.2002.1020936
  12. H. Schultz, D. Woo, E. Riseman, F. Stolle, 'Error detection and DEM fusion using self-consistency', 7th IEEE Int. Conf. on Computer Vision, 1999 https://doi.org/10.1109/ICCV.1999.790413
  13. M. Boldt, R. Weiss, E. Riseman, Token-based extraction of straight lines, IEEE Trans. Systems Man Cybernet, vol. 19, no. 6, pp.1581-1594, 1989 https://doi.org/10.1109/21.44073
  14. C. Lin, A. Huertas and R. Nevatia, 'Detection of buildings using perceptual grouping and shadows,' Proceedings of IEEE CVPR, pp. 62-69, 1994 https://doi.org/10.1109/CVPR.1994.323811