Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회지)

Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회)
권호 표지
DOI QR코드

DOI QR Code

Identifying Specifications of Flat Type Signboards Using a Stereo Camera

스테레오 카메라를 이용한 판류형 간판의 규격 판별

  • Kwon, Sang Il (Department of Spatial Information Engineering, Namseoul University) ;
  • Kim, Eui Myoung (Department of Spatial Information Engineering, Namseoul University)
  • Received : 2019.12.25
  • Accepted : 2020.02.20
  • Published : 2020.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Signboards are standardized according to national legislation for the safety of pedestrians and disaster prevention in urban areas. Signboards should be installed according to the standard. However, it is not easy to manage the signboards systematically due to the number of signboards that have been installed for a long time and frequently changing stores. In this study, we proposed a methodology for distinguishing signboards that deviated from the standard. To this end, the signboard was photographed using a stereo camera, and then the three-dimensional coordinates of the signboard were determined from the signboard image to calculate the signboard's horizontal and vertical dimensions to determine the signboard's specifications. In order to determine the interior and relative orientation parameters of the stereo camera, an outdoor three-dimensional building was used as the test field. Then, the image coordinates of four vertices of the signboard were extracted from the signboard image taken from about 15m ~ 22m distance using deep learning. After determining the signboard's three-dimensional coordinates by using the interior and relative orientation parameters of the stereo camera and the image coordinates of the four vertices of the signboard, the horizontal and vertical sizes of the signboard were calculated, resulting in an error of about 2.7cm on average. The specifications for the ten flat-type signboards showed that all of the horizontal sizes were compliant with the specifications, but the vertical sizes exceeded about 36.5cm on average. Through this, it was found that maintenance of flat-type signboards is needed overall.

간판은 보행자의 안전과 도심의 재난 예방을 위해 국가법령에 따라 간판의 규격이 정해져 있다. 간판은 규격에 따라 설치되어야 하지만 오랜 기간 동안 설치되어온 다수의 간판과 빈번하게 변화하는 점포로 인해 간판을 체계적으로 관리하기가 수월하지 않다. 이에 본 연구에서는 규격에 어긋나는 간판을 판별하는 방법론을 제안하였다. 이를 위해, 스테레오 카메라를 이용하여 간판을 촬영한 후 영상에서 간판의 3차원 좌표를 결정하여 간판의 가로와 세로 크기를 계산하여 간판의 규격을 판별하였다. 스테레오 카메라의 내부표정요소와 상호표정요소를 결정하기 위해서 실외의 3차원 건물을 검정장으로 사용하였다. 그리고 나서 약 15m ~ 22m 거리에서 촬영한 간판 영상에서 딥러닝을 이용하여 간판의 네 꼭지점에 대한 영상좌표를 추출하였다. 스테레오 카메라의 내부표정요소와 상호표정요소 그리고 간판의 네 꼭지점에 대한 영상좌표를 이용하여 간판의 3차원 좌표를 결정한 후 간판의 가로 및 세로 크기를 계산한 결과 평균적으로 약 2.7cm의 오차가 있었다. 10개의 판류형 간판에 대한 규격을 살펴본 결과 가로 크기는 모두 규격을 준수하였으나, 세로 크기는 평균적으로 약 36.5cm를 초과하였다. 이를 통해 판류형 간판의 정비가 필요한 것을 알 수 있었다.

Keywords

References

  1. Cha, S.H. and Kim, J.H. (2017), Analysis on managemental characteristics and problems of outdoor advertisement in Seoul metropolitan city, The Korean Society Of Design Culture, Vol. 23, No. 4, pp. 767-779. (in Korean with English abstract)
  2. Ham, S.I., Jo, K., and Kim, M.J. (2018), Algorithm of Geo-spatial Information Update of Sign Board using Black Box Images, ISBN 979-11-87121-58-9, Lx siri, Jeonju, pp. 1-69.
  3. Habib, A. and Morgan, M.F. (2003), Automatic calibration of low-cost digital cameras, Optical Engineering, Vol. 42, No. 4, pp. 948-956. https://doi.org/10.1117/1.1555732
  4. Kim, E.M. and Hong, S.P. (2018), Calibration comparison of single camera and stereo camera, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 36, No. 4, pp. 295-303. (in Korean with English abstract) https://doi.org/10.7848/KSGPC.2018.36.4.295
  5. Kwon, S.I. and Kim, E.M. (2019), Recognition of flat type signboard using deep learning, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 37, No. 4, pp. 219-231. (in Korean with English abstract) https://doi.org/10.7848/KSGPC.2019.37.4.219
  6. Lee, M.S. and Choi, G.S. (2018), Comparative analysis on characteristics of color uses for signboard between before and after signboard improvement project - focused on signboard improvement project in Ganghwa-gun, Incheon, Journal of Korea Society of Color Studies, Vol. 32, No. 2, pp. 51-63. (in Korean with English abstract) https://doi.org/10.17289/jkscs.32.2.201805.51
  7. Lee, Y.H., Kim, J.S, and Shi, J.C. (2019), Rear-approaching vehicle detection research using region of interesting based on Faster R-CNN, Institute of Korean Electrical and Electronics Engineers, Vol. 23, No. 1, pp. 235-241. (in Korean with English abstract)
  8. Ministry of the Interior and Safety(MOIS), (2018), 2018 Outdoor Advertising Statistics, ISSN 2635-5086, Korea out of home advertising center, Seoul, pp. 1-196.
  9. Peng, S., Nai-Guang, L., Ming-Li, D., Bi-Xi, Y., and Jun, W. (2018), Simultaneous All-Parameters Calibration and Assessment of a Stereo Camera Pair Using a Scale Bar, Sensors (Basel), Vol. 18, No. 11, pp. 3964-3983. https://doi.org/10.3390/s18113964
  10. Yang, L., Chao, X., Yi. Y., and Siqi, L. (2018), Automatic and real-time shop signboards monitoring and supervision system using active radio frequency identification technology, 2018 26th International Conference on Geoinformatics, 28-30 June 2018, Kunming, China, pp. 1-4.
  11. Yang, L., Mingyi, D., Changfeng, J., and Ruoming, S. (2012), Vehicle-mounted outdoor signboard management system combinging MMS and RFID technologies, 2012 IEEE International Geoscience and Remote Sensing Symposium, 22-27, July 2012, Munich, Germany, pp. 2763-2766.