DOI QR코드

DOI QR Code

Real-time Sign Object Detection in Subway station using Rotation-invariant Zernike Moment

회전 불변 제르니케 모멘트를 이용한 실시간 지하철 기호 객체 검출

  • Received : 2011.07.13
  • Accepted : 2011.08.26
  • Published : 2011.09.30

Abstract

The latest hardware and software techniques are combined to give safe walking guidance and convenient service of realtime walking assistance system for visually impaired person. This system consists of obstacle detection and perception, place recognition, and sign recognition for pedestrian can safely walking to arrive at their destination. In this paper, we exploit the sign object detection system in subway station for sign recognition that one of the important factors of walking assistance system. This paper suggest the adaptive feature map that can be robustly extract the sign object region from complexed environment with light and noise. And recognize a sign using fast zernike moment features which is invariant under translation, rotation and scale of object during walking. We considered three types of signs as arrow, restroom, and exit number and perform the training and recognizing steps through adaboost classifier. The experimental results prove that our method can be suitable and stable for real-time system through yields on the average 87.16% stable detection rate and 20 frame/sec of operation time for three types of signs in 5000 images of sign database.

시각 장애인을 위한 실시간 보행보조 시스템의 안전한 보행안내와 편리한 서비스를 제공하기 위해 최신 하드웨어 기술과 소프트웨어 기술이 결합되고 있다. 이 시스템은 보행자가 원하는 목적지까지 보행할 수 있도록 장애물 검출 및 인지와 장소인식, 기호인식으로 구성된다. 본 논문에서는 보행보조 시스템의 중요한 요소 중 하나인 기호인식을 위해 지하철 역 내부에서의 기호 객체 검출 시스템을 개발하였다. 본 논문은 조명과 잡음이 존재하는 복잡한 환경으로부터 기호 객체 영역을 강건하게 검출할 수 있는 적응적인 특징맵을 제안하였다. 그리고 보행 시 객체의 이동, 회전 및 크기에 불변하도록 고속 제르니케 모멘트 특징을 이용하여 기호를 인식한다. 화살표, 화장실, 출구번호 3개의 기호를 대상으로 하며, 에이다부스트 분류기를 이용하여 기호를 학습 및 인식한다. 실험결과에서는 5000장의 기호영상 데이터 베이스의 3개의 기호에 대해 평균 87.16%의 검출율과 20 frame/sec의 처리속도를 통해 안정적이며 실시간 시스템에 적합함을 입증한다.

Keywords

References

  1. C. Y. Fang, S. W. Chen, and C. S. Fuh, "Road-sign detection and tracking", IEEE Transactions on Vehi cular Technology, Vol. 52, No. 5, pp. 1329-1341, 2003. https://doi.org/10.1109/TVT.2003.810999
  2. Y. Inoue, Y. Kohashi, N. Ishikaw, and M. Nakajima, "Automatic Recognition of Road Signs", Proceeding s of SPIE Vol. 4790, pp.543-550, 2002.
  3. M. A. Mattar, A. R. Hanson, and E. G. Learned-Miller, "Sign Classification using Local and Meta-Features", 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops (CVPRW'05), Vol. 3, pp.26-26, 2005.
  4. P. Silapachote, J. Weinman, A. Hanson, M. A. Mattar, and R. Weiss, "Automatic sign detection and recognition in natural scenes", 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops(CVPRW'05), Vol. 3, pp.27-27, 2005.
  5. M. Rusinol, J. Llados, and P. Dosch, "Camera-Based Graphical Symbol Detection", Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), Vol. 2, pp.884-888, 2007.
  6. A. Ruta, Y. Li, and X. Liu, "Detection, Tracking and Recognition of Traffic Signs from Video Input", 11th International IEEE Conference on Intelligent Transportation Systems 2008(ITSC 2008), pp.55-60, 2008.
  7. C. Bahlmann, Y. Zhu, V. Ramesh, M. Pellkofer, and T. Koehler, "A system for traffic sign detection, tracking and recognition using color, shape, and motion information", IEEE Intelligent Vehicles Symposium, pp.255-260, 2005.
  8. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, Vol. 60, no. 2, pp.91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  9. B. Hoferlin and K. Zimmermann, "Towards Reliable Traffic Sign Recognition", IEEE Intelligent Vehicles Symposium 2009, pp.324-329, 2009.
  10. M. A. Mattar, A. R. Hanson and E. Learned-Miller, "Sign classification for the visually impaired", Technical Report, 2005-014 University of Massachusetts Amherst, 2005.
  11. H. Bay, T. Tuytelaars, and L. V. Gool, "SURF: Speeded Up Robust Features", computer science ed., ser. Lecture Notes in Computer Science. Springer Berlin/Heidelberg, 7 2006, Vol.3951, ch. Computer Vision-ECCV 2006, pp.404-417, 2006.
  12. A. Koncar, H. Janben, S. Halgamuge, "Gabor wavelet similarity maps for optimising hierarchical road sign classifiers", Pattern Recognition Letters, Vol.28, No.2, pp.260-267, 2007. https://doi.org/10.1016/j.patrec.2006.07.012
  13. W. M. Theimer and H. A. Mallot, "Phase-based binocular vergence control and depth reconstruction using active vision", CVGIP: Image Understanding, Vol.60, No.3, pp.343-358, 1994. https://doi.org/10.1006/ciun.1994.1061
  14. J. P. Jones and L. A. Palmer, "An evaluation of the two-dimensional gabor filter model of simple receptive fields in cat striate cortex", J. Neurophysiol., Vol.58, No.6, pp.1233-1258, 1987. https://doi.org/10.1152/jn.1987.58.6.1233
  15. F. Zernike, Beugungstheorie des schneidenverfahre ns und seiner verbesserten form, der phasenkontras tmethode, Physical 7, pp.689-701, 1934.
  16. R. Mukundan and K. R. Ramakrishnan, "Fast computation of Legendre and Zernike moments," Pattern Recognition, Vol.28, No.9, pp.1433-1441, 1995. https://doi.org/10.1016/0031-3203(95)00011-N
  17. S. O. Belkasim, "Efficient algorithm for fast computation of Zernike moments," IEEE 39th Midwest symposium on Circuits and Systems, Vol.3, pp.1401-1404, 1996.
  18. A. Prata, W. V. T. Rusche, "Algorithm for computat ion of Zernike polynomials expansion coefficients," Applied Optics, Vol.28, pp.749-754, 1989. https://doi.org/10.1364/AO.28.000749
  19. E. C. Kintner, "On the mathematical properties of the Zernike polynomials," Optica Acta, Vol.23, No.8, pp.679-680, 1976. https://doi.org/10.1080/713819334
  20. C. W. Chong, P. Raveendran and R. Mukundan, "A comparative analysis of algorithms for fast computation of Zernike moments," Pattern Recognition, Vol.36, No.3, pp.731-742, 2003. https://doi.org/10.1016/S0031-3203(02)00091-2
  21. S. K. Hwang and W. Y. Kim, "An Efficient Computation of Zernike Moments Using Symmetric Properties of the Basis Functions", Journal of KISS-Software and Applications, Vol.31, No.5, pp.563-569, 2004.
  22. S. K. Hwang and W. Y. Kim, "A Novel Approach to the Fast Computation of Zernike Moments," Pattern Recognition, Vol. 39, pp.2065-2076, 2006. https://doi.org/10.1016/j.patcog.2006.03.004
  23. L. Breiman, J. Friedman, R. Olshen, and C. Stone, "Classification and regression trees", Wadsworth, B elmont, 1984.
  24. J. Zhu, S. Rosset, H. Zou, and T. Hastie "Multi-class AdaBoost", Statistics and Its Interface, Vol. 2, pp.349-360, 2009. https://doi.org/10.4310/SII.2009.v2.n3.a8
  25. X. Chen and A. L. Yuille, "AdaBoost Learning for Detecting and Reading Text in City Scenes", IEEE Conference on Computer Vision and Pattern Recogn ition(CVPR 2004), 2004.