Journal of the Institute of Electronics Engineers of Korea TC (대한전자공학회논문지TC)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

A survey of traffic monitoring systems based on image analysis

영상 분석에 기반한 교통 모니터링 시스템에 관한 조사

  • Lee Dae-Ho (Faculty of General Education, Kyung Hee University) ;
  • Park Young-Tae (College of Electronics & Information, Kyung Hee University)
  • Published : 2006.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

A number of researches on vision-based traffic monitoring system have been carried out. Most of traffic monitoring schemes belong to one of two categories: analyzing of entire traffic scene and examining of local region. However, the proposed methods suffer from severe performance deterioration when applied in different operating conditions because of the loss of robustness. This paper is aimed at surveying various methods proposed and analyzing the advantages and disadvantages of these methods. Also we propose and investigate appropriate approaches to solve the problems in specific applications.

영상 정보를 이용한 교통 모니터링 시스템에 관한 많은 연구가 이루어졌다. 대부분의 교통 모니터링 기술은 전체 영상을 분석하는 기법과 국부 영역을 검사하는 기법으로 구분된다. 하지만, 제안된 대부분의 기법들은 동작 환경이 변화할 경우 강건성의 결여로 인해 성능이 급격히 저하하는 문제점을 갖고 있다. 본 논문에서는 기존의 논문에서 제안되었던 다양한 기법들의 특성을 조사하고, 장점과 단점을 분석한다. 또한 각 응용 분야마다 영상 처리를 이용하는 기법들이 가지고 있는 문제점들을 해결 할 수 있는 적절한 방법을 고찰한다.

Keywords

References

  1. 이승환, 'ITS의 기본 개념과 국내 · 외 추진 동향,' 대한전자공학회지, 제28권, 제5호, 22-26쪽, 2001년 5월
  2. 박종헌, 'ITS의 발전 전망과 과제,' 대한전자공학회지, 제28권, 제5호. 22-26쪽, 2001년 5월
  3. 이대호, 박영태, '시공간 영상 분석에 의한 강건한 교통 모니터링 시스템,' 정보과학회논문지: 소프트웨어 및 응용 제31권, 제11호, 1534-1542쪽, 2004년 11월
  4. Z. Sun G. Bebis and R. Miller, 'On-road vehicle detection using optical sensors: a review,' The 7th International IEEE Conference on Intelligent Transportation Systems, pp. 585-590, October, 2004 https://doi.org/10.1109/ITSC.2004.1398966
  5. Z. Sun, G. Bebis and R. Miller, 'On-road vehicle detection: a review,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, pp. 694-771, 2006 https://doi.org/10.1109/TPAMI.2006.104
  6. V. Kastrinaki, M. Zervakis and K. Kalaitzakis, 'A survey of video processing techniques for traffic applications,' Image and Vision Computing, Vol. 21, No. 4, pp. 359-381, 2003 https://doi.org/10.1016/S0262-8856(03)00004-0
  7. Y. Park, 'Shape-resolving local thresholding for object detection,' Pattern Recognition Letters, Vol. 22, Issue 6, pp. 883-890, June 2001 https://doi.org/10.1016/S0167-8655(01)00034-4
  8. N. Friedman and S. Russel, 'Image segmentation in video sequences: a probabilistic approach,' In Proceedings of the Thirteenth Conference of Uncertainty in Artificial Intelligence, pp. 175-181, August 1997
  9. K. Karmann, A. Brandt, 'Moving object recognition using an adaptive background memory,' in V Cappellini(ed.), Time-Varying Image Processing and Moving Object Recognition, 2, Elsevier, Amsterdam, The Netherlands, 1990
  10. C. Stauffer and W.E.L. Grimson, 'Adaptive background mixture models for real-time tracking,' IEEE Conference on Computer Vision and Pattern Recognition, pp. 246-252, Colorado, USA, June 1999 https://doi.org/10.1109/CVPR.1999.784637
  11. G. Bailo, M. Bariani, P. Ijas and M. Raggio, 'Background estimation with gaussian distribution for image segmentation, a fast approach,' IEEE Ingternational Workshop on IMS 2005, pp. 2-5, March 2005 https://doi.org/10.1109/MSHS.2005.1502544
  12. D. Gao and J. Zhou, 'Adaptive background estimation for real-time traffic monitoring,' IEEE Proceedings of Intelligent Transportations Systems, pp. 330-333, Oakland, CA, USA, 2001 https://doi.org/10.1109/ITSC.2001.948678
  13. M. Kilger, 'Video-based traffic monitoring,' International Conference on Image Processing and Its Applications, pp. 89-92, Maastricht, Netherlands, April 1992
  14. M. Kilger, 'A shadow handler in a video-base real-time traffic monitoring system,' IEEE Workshop on Application of Computer Vision, pp. 1060-1066, Palm Springs, CA, USA, 1992 https://doi.org/10.1109/ACV.1992.240332
  15. S. Gupte, O. Masoud, R.R.K. Martin and N.P. Papanikolopoulos, 'Detection and classification of vehicles,' IEEE Transactions on Intelligent Transportation Systems, Vol. 3, No.1, pp. 37-47, March 2002 https://doi.org/10.1109/6979.994794
  16. D. Koller, J. Weber and J. Malik., 'Robust multiple car tracking with occlusion reasoning,' Proceedings of 3rd European Conference on Computer Vision, pp. 189-196, Stockholm, Sweden, May 1994
  17. Y. Jung and Y. Ho, 'Traffic parameter extraction using video-based vehicle tracking,' Proceedings of IEEE International Conference on ITS, pp. 764-766, Tokyo, Japan, October 1999 https://doi.org/10.1109/ITSC.1999.821157
  18. O. Masoud, N.P. Papanikolopoulos and E. Kwon, 'The use of computer vision in monitoring weaving sections,' IEEE Transactions on Intelligent Transportation Systems, Vol. 2, No. 1, pp.18-25, 2001 https://doi.org/10.1109/6979.911082
  19. B. Maurin, O. Masoud, and N. Papanikolopoulos, 'Monitoring crowded traffic scenes,' Proceedings of IEEE 5th International Conference on Intelligent Transportation Systems, pp. 19-24, 2002 https://doi.org/10.1109/ITSC.2002.1041182
  20. H. Veeraraghavan, O. Msoud and N.P. Papanikolopoulos, 'Computer vision algorithms for intersection monitoring,' IEEE Transaction on Intelligent Transportation Systems, Vol. 4, No. 2, pp. 78-89, 2003 https://doi.org/10.1109/TITS.2003.821212
  21. C. Jiangwei, 'Study on method of detecting preceding vehicle based on monocular camera,' IEEE Intelligent Vehicles Symposium 2004, pp. 750-755, June 2004 https://doi.org/10.1109/IVS.2004.1336478
  22. X. Ji, Z. Wei and Y. Feng, 'Effective vehicle detection techinique for traffic surveillance systems,' Journal of Visual Communication and Image Representation, Vol. 17, No. 3, pp. 647-658, June 2006 https://doi.org/10.1016/j.jvcir.2005.07.004
  23. D.M. Ha, J.M. Lee and Y.D. Kim, 'Neural-edge-based vehicle detection and traffic parameter extraction,' Image and Vision Computing, Vol. 22, No. 11, pp. 899-907, September 2004 https://doi.org/10.1016/j.imavis.2004.05.006
  24. 박세제, 이영재, 박영태, '교통 영상에서의 차량 검지 기법에 관한 연구,' 제11회 영상 처리 및 이해에 관한 워크샵 발표 논문집, 159-164쪽, 대전, 1999년 2월
  25. R. Cucchiara, M. Piccardi, and P. Mello, 'Image analysis and rule-based reasoning for a traffic monitoring system,' IEEE Transactions on Intelligent Transportation Systems, Vol. 1, No. 2, pp. 119-130, 2000 https://doi.org/10.1109/6979.880969
  26. L.D. Stefano and E. Viarani, 'Vehicle detection and tracking using the block matching algorithm,' Proceeding of 3rd IMACE/IEEE, Vol. 1, pp. 4491-4496, 1999
  27. F. Bartolini, V. Cappellini and C. Giani, 'Motion estimation and tracking for urban traffic monitoring,' Proceedings of International Conference on Image Processing '96, Vol. 3, pp. 787-790, Lausanne, Switzerland, September 1996 https://doi.org/10.1109/ICIP.1996.560850
  28. J. Atola, P. Haavisto and Y. Neuvo, 'Vector median filters,' International Conference on Image Processing, pp. 177-181, Kobe, Japan, April 1990 https://doi.org/10.1109/5.54807
  29. C. Tzomakas and W. Seelen, 'Vehicle detection in traffic scenes using shadows,' Technical Report 98-06, Institut fur Neuroinformatik, Ruht-Universitat, Bochum, Germany, 1998
  30. D. Lee and Y. Park, 'Robust vehicle detection based on shadow classification,' The 18th International Conference on Pattern Recognition, Hong Kong, August 2006 https://doi.org/10.1109/ICPR.2006.1018
  31. D. Koller, 'Moving object recognition and classification based on recursive shape parameter estimation,' 12th Israel Conference Artificial Intelligence, Computer Vision, December 1993
  32. D. Koller, K Daniilidis and H.H Nagel, 'Model-based object tracking in monocular image sequences of road traffic scenes,' International Journal of Computer Vision, Vol. 10. pp. 257-281, 1993 https://doi.org/10.1007/BF01539538
  33. Kollnig H and Nagel H, '3D pose estimation by directly matching polyhedral models to gray value gradients,' International Journal of Computer Vision, Vol. 23, No.3, pp. 283-302, 1997 https://doi.org/10.1023/A:1007927317325
  34. A. Mukerjee, S.P. Palanisqami, R. Gupta, Em Kumar and G.P. Kulkarni, 'Vehicle tracking in image sequences,' International Conference CAD/CAM robotics and factories of the future, pp. 304-316, Coimbatore, India, December 1998
  35. M. D. Jolly, S. Lakshmanan and A. K. Jain, 'Vehicle segmentation and classification using deformable templates,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No.3, pp. 293-308, 1996 https://doi.org/10.1109/34.485557
  36. G.D. Sulliva, K.D. Baker, A.D. Worrall, C.I Attwood and P.M. Remagnino, 'Model-based vehicle detection and classification using orthographic approximations,' Image and Vision Computing, Vol. 15, pp. 649-654, 1997 https://doi.org/10.1016/S0262-8856(97)00009-7
  37. J. Tai, S. Tseng, C. Lin and K. Song, 'Real-time image tracking for automatic traffic monitoring and enforcement applications,' Image and Vision Computing, Vol. 22, No.6. pp. 485-501, June, 2004 https://doi.org/10.1016/j.imavis.2003.12.001
  38. M. Kass, A. Witkin and D. Terzopoulos, 'Snakes: Active contour models,' International Journal of Computer Vision, Vol. 1, No. 4, pp. 321-331, 1988 https://doi.org/10.1007/BF00133570
  39. B. Coifman, D. Beymer, McLauchlan and J. Malik, 'A real-time computer vision system for vehicle tracking and traffic surveillance,' Transportation Research part C, Vol. 6. pp. 271-288, 1998 https://doi.org/10.1016/S0968-090X(98)00019-9
  40. D. Beymer and J. Malik, 'Tracking vehicles in congested traffic,' Proceedings of the 1996 IEEE Intelligent Vehicles Symposium, pp. 130-135, Tokyo, Japan, September 1996 https://doi.org/10.1109/IVS.1996.566366
  41. A.H Lai and N.H. Yung, 'Vehicle-type identification through automated virtual loop assignment and block-based direction-biased motion estimation,' IEEE Transactions on Intelligent Transportation Systems, Vol. 1, No. 2, pp. 86-97, 2000 https://doi.org/10.1109/6979.880965
  42. L. Wixson, K. Hanna, and D. Mishra, 'Illumination assessment for vision-based traffic monitoring,' 13th International Conference on Pattern Recognition, pp. 56-62, Vienna, Austria, August 1996 https://doi.org/10.1109/ICPR.1996.546794
  43. P.G. Michalopoulos, 'Vehicle detection video through image processing: The Autoscope system,' IEEE Transactions on Vehicular Technology Vol. 40, No. 1, pp. 21-29, 1991 https://doi.org/10.1109/25.69968
  44. S. Mantri and D. Bullock, 'A neural network based vehicle detection and tracking system,' Proceedings of the 27th Southeastern Symposium on System Theory, March, 1995 https://doi.org/10.1109/SSST.1995.390569
  45. J. Kato, S. Joga, J. Rittscher and A Blake, 'An HMM-based segmentation method for traffic monitoring movies,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 9, pp. 1291-1296, 2002 https://doi.org/10.1109/TPAMI.2002.1033221
  46. B.L. Tseng, C.Y. Lin and J.R. Smith, 'Real-time video surveillance for traffic monitoring using virtual line analysis,' Proceedings of IEEE International Conference on Multimedia and Expo, pp. 541-544, 2002 https://doi.org/10.1109/ICME.2002.1035671
  47. Z. Zhu, G. Xu, B. Yang, D. Shi and X. Lin, 'VISATRAM: A real-time vision system for automatic traffic monitoring,' Image and Vision Computing, Vol. 18, No. 10, pp. 781-794, 2000 https://doi.org/10.1016/S0262-8856(99)00046-3
  48. 이영재, 이대호, 박영태, '시공간 영상분석에 의한 실시간 교통 정보 산출 기법,' 전자공학회 논문지, 제37권, SP편, 제4호, 11-19쪽, 2000년 7월
  49. 이대호, 박영태, '영역 분류와 시공간 영상 분석에 의한 실시간 교통정보 파라메터 산출 기법,' 제12회 영상 처리 및 이해에 관한 워크샵 발표 논문집, 347-352쪽, 제주, 2000년 1월
  50. M. Fathy and M.Y. Siyal, 'Measuring Traffic Movements at Junctions using Image Processing Techniques,' Pattern Recognition Letters, Vol. 18, pp. 493-500, 1997 https://doi.org/10.1016/S0167-8655(97)00026-3
  51. M.Y. Siyal and M. Fathy, 'A Neural-Vision based Approach to Measure Traffic Queue Parameters in Real-Time,' Pattern Recognition Letters, Vol. 20, pp. 761-770, 1999 https://doi.org/10.1016/S0167-8655(99)00040-9
  52. S.M. Smith and J.M. Brady, 'ASSET-2: Real-time motion segmentation and shape tracking,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 8, pp. 814-820, 1995 https://doi.org/10.1109/34.400573
  53. P.H. Batavia, D.A. Pomerleau and C.E. Thorpe, 'Overtaking vehicle detection using implicit optical flow,' IEEE Conference on Intelligent Transportation System, pp. 729-734, Boston, MA, USA, November 1997 https://doi.org/10.1109/ITSC.1997.660564
  54. M. Betke, E. Haritaglu and L. Davis, 'Multiple vehicle detection and tracking in hard real time,' IEEE Intelligent Vehicles Symposium, pp. 351-356, 1996 https://doi.org/10.1109/IVS.1996.566405
  55. M Betke, E. Haritaoglu and L.S. Davis, 'Real-time multiple vehicle detection and tracking from a moving vehicle,' Machine Vision and Applications, Vol. 12, No. 2, pp. 69-83, 2000 https://doi.org/10.1007/s001380050126
  56. M. Bertozzi, A. Broggi, A. Fascioli and S. Nichele, 'Stereo vision-based vehicle detection,' Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 39-44, October 2000 https://doi.org/10.1109/IVS.2000.898315
  57. P. Barham, X. Zhang, L. Andreone and M. Vache, 'The development of a driver vision support system using far infrared technology: progress to date on the darwin project,' IEEE Intelligent Vehicles Symposium, pp. 545 - 549, October 2000 https://doi.org/10.1109/IVS.2000.898404
  58. D. Ranzato, 'Vehicle detection and localization in infra-red images,' IEEE 5th International Conference on Intelligent Transportation Systems, pp. 141 - 146, 2002 https://doi.org/10.1109/ITSC.2002.1041203
  59. B.K.P. Hom and B.G. Schunck, 'Determining optical flow,' Artificial Intelligence, Vol. 17, pp. 185-203, 1981 https://doi.org/10.1016/0004-3702(81)90024-2
  60. 최형진, 오영환, 안거원맹, 중도정지, '컴퓨터 화상처리를 이용한 차량 번호판 추출 방법,' 전자공학회논문지, 제24권 2호, 309-314쪽, 1987년 3월
  61. 최재호, 조범준, '다중 역전파 신경망을 이용한 차량 번호판의 인식,' 한국통신학회 논문지, 제22권, 11호, 2432-2438쪽, 1997년 11월
  62. 문성원, 장언동, 송여준, '기울어진 차량 번호판 영역의 검출,' 한국콘텐츠학회 논문지, 제4권, 제3호, 125-130쪽, 2004년 9월
  63. 이현창, '자동차 번호판 영상에서 효율적인 번호판 영역 검출 시스템의 설계 및 개발,' 한국컴퓨터정보학회 논문지, 제10권, 제5호, 87-93쪽, 2005년 11월
  64. 조동욱, 조용환, '환경에 불변인 전처리 과정과 히스토그램 및 원형 정합을 이용한 차량 번호판 인식,' 한국통신학회 논문지, 제23권 1호, 94-100쪽, 1998년 1월
  65. T. Zhao and R. Nevatia, 'Car detection in low resolution aerial image,' Image and Vision Computing, Vol. 21, No. 8, pp. 693-703, 2003 https://doi.org/10.1016/S0262-8856(03)00064-7
  66. S. Hinz and U. Stilla, 'Car detection in aerial thermal images by local and global evidence accumulation,' Pattern Recognition Letters, Vol. 27, No. 4, pp. 309-315, 2006 https://doi.org/10.1016/j.patrec.2005.08.013
  67. H. Kim J. Lee, S. Kim, J. Ko and D. Cho, 'Ultrasonic vehicle detector for side-fire implementation and extensive results including harsh conditions,' IEEE Transaction on Intelligent Transportation System, Vol. 2, No. 3, pp. 127-134, 2001 https://doi.org/10.1109/6979.954546
  68. T.M. Hussain, T.N. Saadawi, S.A. Ahmed, 'Overhead infrared sensor for monitoring vehicular traffic,' IEEE Transaction on Vehicular Technology, Vol. 42, No. 4, pp. 477-483, 1993 https://doi.org/10.1109/25.260764
  69. T.M. Hussain, A.M. Baig, T.N. Saadawi and S.A. Ahmed, 'Infrared pyroelectric sensor for detection of vehicular traffic using digital signal processing techniques,' IEEE Transactions on Vehicular Technology, Vol. 44, No. 3, pp. 683-689, 1995 https://doi.org/10.1109/25.406637
  70. H.H. Cheng, B.D. Shaw, J. Palen, J.E. Larson, X. Hu, K.V. Katwyk, 'A real-time laser-based detection system for measurement of delineations of moving vehicles,' IEEE/ASME Transaction on Mechatronics, Vol. 6, No. 2, pp. 170-187, 2001 https://doi.org/10.1109/3516.928732
  71. Y. Zhang and R.Q. Hu, 'Development of an automated accident detection system at intersections,' 8th International Conference on Applications of Advanced Technologies in Transportation Engineering 2004, pp. 153-157, Beijing, China, May 2004
  72. Y. Zhang and L.M. Bruce, 'Automated accident detectio at intersection,' Technical Report, Mississippi Department of Transportation, March 2004