STEREO VISION-BASED FORWARD OBSTACLE DETECTION

  • Published : 2007.08.31

Abstract

This paper proposes a stereo vision-based forward obstacle detection and distance measurement method. In general, stereo vision-based obstacle detection methods in automotive applications can be classified into two categories: IPM (Inverse Perspective Mapping)-based and disparity histogram-based. The existing disparity histogram-based method was developed for stop-and-go applications. The proposed method extends the scope of the disparity histogram-based method to highway applications by 1) replacing the fixed rectangular ROI (Region Of Interest) with the traveling lane-based ROI, and 2) replacing the peak detection with a constant threshold with peak detection using the threshold-line and peakness evaluation. In order to increase the true positive rate while decreasing the false positive rate, multiple candidate peaks were generated and then verified by the edge feature correlation method. By testing the proposed method with images captured on the highway, it was shown that the proposed method was able to overcome problems in previous implementations while being applied successfully to highway collision warning/avoidance conditions, In addition, comparisons with laser radar showed that vision sensors with a wider FOV (Field Of View) provided faster responses to cutting-in vehicles. Finally, we integrated the proposed method into a longitudinal collision avoidance system. Experimental results showed that activated braking by risk assessment using the state of the ego-vehicle and measuring the distance to upcoming obstacles could successfully prevent collisions.

Keywords

References

  1. Batavia, P. H., Pomerleau, D. A. and Thorpe, C. E. (1997). Overtaking vehicle detection using implicit optical flow. IEEE Conf. Intelligent Transportation System, 729-734
  2. Bertozzi, M. and Broggi, A. (1998). GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Processing 7, 1, 62-81 https://doi.org/10.1109/83.650851
  3. Blum, J. and Eskandarian, A. (2002). Software architecture for adaptive collision avoidance systems. Int. J. Automotive Technology 3, 2, 79-88
  4. Bouguet, J. Y. (2006). Camera Calibration Tool Box for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc/
  5. Brown, M. Z., Burschka, D. and Hager, G. D. (2003). Advances in computational stereo. IEEE Trans. Pattern Analysis and Machine Intelligence 25, 8, 993-1008 https://doi.org/10.1109/TPAMI.2003.1217603
  6. Chellappa, R., Qian, G. and Zheng, Q. (2004). Vehicle detection and tracking using acoustic and video sensors. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 793-796
  7. Franke, U. and Kutzbch, I. (1996). Fast stereo based object detection for stop & go traffic. IEEE Intelligent Vehicle Symp., 339-344
  8. Giachetti, A., Campani, M. and Torre, V. (1998). The use of optical flow for road navigation. IEEE Trans. Robotics and Automation 14, 1, 34-48 https://doi.org/10.1109/70.660838
  9. Hancock, J., Hoffman, E., Sullivan, R., Ingimarson, D., Langer, D. and Hebert, M. (1997). High-performance laser ranger scanner. SPIE Int'l Conf. Intelligent Trans-portation Systems
  10. Herbert, M. (2000). Active and passive range sensing for robotics. Proc. IEEE Int. Conf. Robotics and Automation, 1, 102-110
  11. Ito, T., Yamada, K. and Nishioka, K. (1995). Understanding driving situations using a network model. Intelligent Vehicles '95 Symp., 48-53
  12. Jung, H. G., Kim, D. S., Yoon, P. J. and Kim, J. H. (2006). 3D Vision system for the recognition of free parking site location. Int. J. Automotive Technology 7, 3, 361-367
  13. Kastrinaki, V., Zervakis, M. and Kalaitzakis, K. (2003). A survey of video processing techniques for traffic applications. Image and Vision Computing, 21, 359-381 https://doi.org/10.1016/S0262-8856(03)00004-0
  14. McCall, J. C. and Trivedi, M. M. (2006). Video-based lane estimation and tracking for driver assistance: Survey, system and evaluation. IEEE Trans. Intelligent Transportation Systems 7, 1, 20-37 https://doi.org/10.1109/TITS.2006.869595
  15. Park, S., Kim, T., Kang, S. and Heon, K. (2003). A novel signal processing technique for vehicle detection radar. 2003 IEEE MTT-S Int. Microwave Symp. Digest, 607-610
  16. Scharstein, D. and Szeliski, R. (2002). A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Computer Vision, 47(1/2/3), 7-42 https://doi.org/10.1023/A:1014573219977
  17. Sun, Z., Bebis, G. and Miller, R. (2005). On-road vehicle detection using evolutionary gabor filter optimization. IEEE Trans. Intelligent Transportation Systems 6, 2, 125-137 https://doi.org/10.1109/TITS.2005.848363
  18. Sun, Z., Bebis, G. and Miller, R. (2006). On-road vehicle detection: A Review. IEEE Trans. Pattern Recognition and Machine Intelligence 28, 5, 1-18 https://doi.org/10.1109/TPAMI.2006.13
  19. Wang, C., Thorpe, C. and Suppe, A. (2003). Ladar-based detection and tracking of moving objects from a ground vehicle at high speeds. Proc. IEEE Intelligent Vehicle Symp., 416-421