DOI QR코드

DOI QR Code

Model-Based Plane Detection in Disparity Space Using Surface Partitioning

표면분할을 이용한 시차공간상에서의 모델 기반 평면검출

  • 하홍준 (건국대학교 컴퓨터공학과) ;
  • 이창훈 (건국대학교 컴퓨터공학과)
  • Received : 2015.06.25
  • Accepted : 2015.08.25
  • Published : 2015.10.31

Abstract

We propose a novel plane detection in disparity space and evaluate its performance. Our method simplifies and makes scenes in disparity space easily dealt with by approximating various surfaces as planes. Moreover, the approximated planes can be represented in the same size as in the real world, and can be employed for obstacle detection and camera pose estimation. Using a stereo matching technique, our method first creates a disparity image which consists of binocular disparity values at xy-coordinates in the image. Slants of disparity values are estimated by exploiting a line simplification algorithm which allows our method to reflect global changes against x or y axis. According to pairs of x and y slants, we label the disparity image. 4-connected disparities with the same label are grouped, on which least squared model estimates plane parameters. N plane models with the largest group of disparity values which satisfy their plane parameters are chosen. We quantitatively and qualitatively evaluate our plane detection. The result shows 97.9%와 86.6% of quality in our experiment respectively on cones and cylinders. Proposed method excellently extracts planes from Middlebury and KITTI dataset which are typically used for evaluation of stereo matching algorithms.

본 논문에서는 시차공간상의 평면검출 방법을 제안하고 그 성능을 평가한다. 다양한 표면을 평면으로 근사하고 검출함으로써 시차공간에 나타난 장면을 간소화하고 수식화하여 다루기 쉽도록 한다. 또한 시차공간에서 근사적으로 구한 평면은 3차원 공간상에서 실측 크기로 표현 가능하고 장애물 검출 및 카메라 위치 추정에 활용할 수 있다. 먼저 스테레오 매칭 기술을 이용해 두 개의 영상으로부터 2차원 공간상에 좌표쌍마다 시차값을 가지는 시차공간을 생성한다. x 또는 y축의 전체적인 추이를 반영하도록 돕는 선 단순화 기법을 이용하여 시차값의 접선 기울기를 추정한다. 기울기 쌍의 조합에 따라 10개의 라벨을 시차공간의 좌표쌍에 부여한다. 상하좌우 방향으로 인접하고 동일한 라벨을 가지는 좌표쌍을 연결하여 군집을 생성하고 최소자승법을 이용해 각 군집에 대한 평면식을 추정한다. 시차공간 내에서 평면식을 만족하는 점들이 가장 많은 평면을 검출하고 이를 시차공간을 가장 잘 간소화한 N개의 평면으로 선택한다. 평면검출의 성능을 정량적으로 평가하였고 그 결과는 3차원 원뿔과 원통에서 각각 97.9%, 86.6% 품질을 보였다. 스테레오 비전 알고리즘의 성능을 평가하기 위해 대표적으로 이용되는 Middlebury와 KITTI 실험데이터로부터 제안된 평면검출 방법은 훌륭하게 평면을 검출하였다.

Keywords

References

  1. J. A. Delmerico, Jason Corso, and P. David, "Boosting with Stereo Features for Building Facade Detection on Mobile Platforms," WNYIPW, Workshop on, 2010.
  2. Jason Corso, Darius Burschka, and Gregory Hager, "Direct Plane Tracking in Stereo Images for Mobile Navigation," ICRA, IEEE Conference on, 2003.
  3. Gim Hee, F. Fraundorfer, and M. Pollefeys, "MAV visual SLAM with Plane Constraint," ICRA, IEEE Conference on, 2011.
  4. N. Molton, S. Se, J. M. Brady, D. Lee, and P. Probert, "A Stereo vision-based aid for the visually impaired," Image and Vision Computing, Vol.16, No.4, 1998.
  5. Stephen Se and Michael Brady, "Ground plane estimation, error analysis and applications," Robotics and Autonomous Systems, Vol.39, No.2, 2002.
  6. Vivek Pradeep, Gerard Medioni, and James Weiland, "Piecewise Plana Modeling for Step Detection using Stereo Vision," Computer Vision Applications for the Visually Impaired, IEEE Workshop on, 2008.
  7. E. Trucco, F. Isgro, and F. Bracch, "Plane Detection in Disparity Space," Visual Information Engineering, Conference on, 2003.
  8. Stephen Se and Michael Brady, "Stereo vision-based obstacle detection for partially sighted people," ACCV, Conference on, 1998.
  9. N. Thakoor, Sungying Jung, and Jean Gao, "Real-time Planar Surface Segmentation in Disparity Space," CVPR, IEEE Conference on, 2007.
  10. S.-T. Wu and M.R. Gonzales Marquez, "A non-self-intersection Douglas-Peucker Algorithm," SIBGRAPI, Conference on, 2003
  11. Paul S. Heckbert and Michael Garland, "Survey of Polygonal Surface Simplification Algorithm," SIGGRAPH, Course Notes #25, 1997.
  12. James T. Todd, "The visual perception of 3D shape," Trends in Cognitive Sciences, Vol.8, No.3, pp.115-121, 2004. https://doi.org/10.1016/j.tics.2004.01.006
  13. Pedro F. Felzenszwalb and Daniel P. Huttenlocher, "Efficient Belief Propagation for Early Vision," International Journal of Computer Vision, Vol.70, No.1, pp.41-54, 2006. https://doi.org/10.1007/s11263-006-7899-4
  14. J. Sun, N. N. Zheng, and H. Y. Shum, "Stereo Matching Using Belief Propagation," Pattern Analysis and Machine Intel-ligence, IEEE Transaction on, Vol.25, pp.787-800, 2003. https://doi.org/10.1109/TPAMI.2003.1206509
  15. Andreas Klaus, Mario Sormann, and Konrad Karner, "Segment-Based Stereo Matching Using Belief Propagation and a self-Adapting Dissimilarity Measure," ICPR, IEEE Conference on, 2006.
  16. Daniel Scharstein and Richard Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Journal of Computer Vision, Vol.47, No.1, pp.7-42, 2002. https://doi.org/10.1023/A:1014573219977
  17. C. Heipke, et al., "Evaluation of automatic road extraction," International Archives of Photogrammetry and Remote Sensing, Conference on, Vol.32, Par.3-4W2, pp.151-160, 1997.
  18. Andreas Geiger, Philip Lenz, and Raquel Urtasun, "Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite," CVPR, IEEE Conference on, 2012.