ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Robust Sign Recognition System at Subway Stations Using Verification Knowledge

  • Lee, Dongjin (IT Convergence Technology Research Laboratory, ETRI) ;
  • Yoon, Hosub (IT Convergence Technology Research Laboratory, ETRI) ;
  • Chung, Myung-Ae (Future Research Creative Laboratory, ETRI) ;
  • Kim, Jaehong (IT Convergence Technology Research Laboratory, ETRI)
  • Received : 2014.01.10
  • Accepted : 2014.09.05
  • Published : 2014.10.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we present a walking guidance system for the visually impaired for use at subway stations. This system, which is based on environmental knowledge, automatically detects and recognizes both exit numbers and arrow signs from natural outdoor scenes. The visually impaired can, therefore, utilize the system to find their own way (for example, using exit numbers and the directions provided) through a subway station. The proposed walking guidance system consists mainly of three stages: (a) sign detection using the MCT-based AdaBoost technique, (b) sign recognition using support vector machines and hidden Markov models, and (c) three verification techniques to discriminate between signs and non-signs. The experimental results indicate that our sign recognition system has a high performance with a detection rate of 98%, a recognition rate of 99.5%, and a false-positive error rate of 0.152.

Keywords

References

  1. D. Geronimo et al., "Traffic Sign Recognition for Computer Vision Project-Based Learning," IEEE Trans. Educ., vol. 25, no. 3, Aug. 2013, pp. 364-371.
  2. H.S. Park et al., "In-Vehicle AR-HUD System to Provide Driving-Safety Information," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1038-1047. https://doi.org/10.4218/etrij.13.2013.0041
  3. S. Muller-Schneiders, C. Nunny, and M. Meuter, "Performance Evaluation of a Real-Time Traffic Sign Recognition System," IEEE Intell. Veh. Symp., Eindhoven, Netherlands, June 4-6, 2008, pp. 79-84.
  4. J. Lee et al., "AdaBoost for Text Detection in Natural Scene," Int. Conf. Document Anal. Recogn., Beijing, China, Sept. 18-21, 2011, pp. 429-434.
  5. K. Choi et al., "State Machine and Downhill Simplex Approach for Vision-Based Nighttime Vehicle Detection," ETRI J., vol. 36, no. 3, June 2014, pp. 439-449. https://doi.org/10.4218/etrij.14.0113.0509
  6. S.M. Hanif and L. Prevost, "Text Detection and Localization in Complex Scene Images Using Constrained AdaBoost Algorithm," Int. Conf. Document Anal. Recogn., Barcelona, Spain, July 26-29, 2009, pp. 1-5.
  7. C. Bahlmann et al., "A System for Traffic Sign Detection, Tracking, and Recognition Using Color, Shape, and Motion Information," IEEE Intell. Veh. Symp., Las Vegas, NV, USA, June 6-8, 2005, pp. 255-260.
  8. B. Froba and A. Ernst, "Face Detection with the Modified Census Transform," IEEE Conf. Autom. Face Gesture Recogn., Seoul, Rep. of Korea, May 17-19, 2004, pp. 91-96.
  9. K-D. Ban et al., "Tiny and Blurred Face Alignment for Long Distance Face Recognition," ETRI J., vol. 33, no. 2, Apr. 2011, pp. 251-258. https://doi.org/10.4218/etrij.11.1510.0022
  10. J. Sauvola and M. Pietikainen, "Adaptive Document Image Binarization," Pattern Recogn., vol. 33, no. 1, 2000, pp. 149-160. https://doi.org/10.1016/S0031-3203(99)00006-0
  11. Y. Yoon et al., "Best Combination of Binarization Methods for License Plate Character Segmentation," ETRI J., vol. 35, no. 3, June 2013, pp. 491-500. https://doi.org/10.4218/etrij.13.0112.0545
  12. D. Lee and H. Yoon, "Sign Recognition with HMM/SVM Hybrid for the Visually-Handicapped in Subway Stations," Int. Joint Conf. Comput. Intell., Barcelona, Spain, Oct. 5-9, 2012, pp. 631-634.
  13. C-L. Liu, "Handwritten Chinese Character Recognition: Effects of Shape Normalization and Feature Extraction," Lecture Notes Comput. Sci., vol. 4768, 2008, pp. 104-128. https://doi.org/10.1007/978-3-540-78199-8_7
  14. C.C. Chang and C.J Lin, "LIBSVM: A Library for Support Vector Machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 27, 2011, pp. 2-27.
  15. A. Schlapbach and H. Bunke, "Off-line Handwriting Identification Using HMM Based Recognizers," Int. Conf. Pattern Recogn., Cambridge, UK, vol. 2, Aug. 23-26, 2004, pp. 654-658.
  16. T.Y. Zhang and C.Y. Suen, "A Fast Parallel Algorithm for Thinning Digital Patterns," Commun. ACM, vol. 27, no. 3, Mar. 1984, pp. 236-239. https://doi.org/10.1145/357994.358023
  17. M. Ahmed and R. Ward, "A Rotation Invariant Rule-Based Thinning Algorithm for Character Recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, Dec. 2002, pp. 1672-1678. https://doi.org/10.1109/TPAMI.2002.1114862
  18. J. Kim and H. Yoon, "Graph Matching Method for Character Recognition in Natural Scene Images: A Study of Character Recognition in Natural Scene image Considering Visual Impairments," IEEE Int. Conf. Intell. Eng. Syst., Poprad, Slovakia, June 23-25, 2011, pp. 347-350.
  19. B.L. Van, S. Garcia-Salicetti, and B. Dorizzi, Fusion of HMM's Likelihood and Viterbi Path for On-line Signature Verification, Springer Berlin Heidelberg, vol. 3087, 2004, pp. 318-331.
  20. J. Illingworth and J. Kittler, "The Adaptive Hough Transform," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 5, Sept. 1987, pp. 690-698.
  21. Y. Xie and Q. Ji, "A New Efficient Ellipse Detection Method," Int. Conf. Pattern Recogn., Quebec, Canada, Aug. 11-15, 2002, pp. 957-960.
  22. P. Perez et al., "Color-Based Probabilistic Tracking," European Conf. Comput. Vis., Copenhagen, Denmark, May 28-31, 2002, pp. 661-675.
  23. D. Comaniciu, V. Ramesh, and P. Meer, "Real-Time Tracking of Non-Rigid Objects Using Mean Shift," Comput. Vis. Pattern Recogn., Hilton Head, SC, USA, vol. 2, June 13-15, 2000, pp. 142-149.
  24. T. Wu, C. Lin, and R.C. Weng, "Probability Estimates for Multiclass Classification by Pairwise Coupling," J. Mach. Learning Res., vol. 52, Dec. 2004, pp. 975-1005.

Cited by

  1. Real-Time License Plate Detection in High-Resolution Videos Using Fastest Available Cascade Classifier and Core Patterns vol.37, pp.2, 2014, https://doi.org/10.4218/etrij.15.2314.0077
  2. Automated Railway Signs Detection. Preliminary Results vol.20, pp.1, 2014, https://doi.org/10.2478/ttj-2019-0002
  3. Enhancing Role of Guiding Signs Setting in Metro Stations with Incorporation of Microscopic Behavior of Pedestrians vol.11, pp.21, 2014, https://doi.org/10.3390/su11216109