Browse > Article
http://dx.doi.org/10.7848/ksgpc.2021.39.6.599

Updating Obstacle Information Using Object Detection in Street-View Images  

Park, Seula (Institute of Engineering Research, Seoul National University)
Song, Ahram (School of Convergence & Fusion System Engineering, Kyungpook National University)
Publication Information
Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography / v.39, no.6, 2021 , pp. 599-607 More about this Journal
Abstract
Street-view images, which are omnidirectional scenes centered on a specific location on the road, can provide various obstacle information for the pedestrians. Pedestrian network data for the navigation services should reflect the up-to-date obstacle information to ensure the mobility of pedestrians, including people with disabilities. In this study, the object detection model was trained for the bollard as a major obstacle in Seoul using street-view images and a deep learning algorithm. Also, a process for updating information about the presence and number of bollards as obstacle properties for the crosswalk node through spatial matching between the detected bollards and the pedestrian nodes was proposed. The missing crosswalk information can also be updated concurrently by the proposed process. The proposed approach is appropriate for crowdsourcing data as the model trained using the street-view images can be applied to photos taken with a smartphone while walking. Through additional training with various obstacles captured in the street-view images, it is expected to enable efficient information update about obstacles on the road.
Keywords
Object Detection; Deep Learning; YOLO; OpenStreetMap; Pedestrian Network; Map Update;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Oh, I.P., Baek, A.R., Kwon, J.A., Park, H.J., Son, S.O., and Choi, H.J. (2016), A study on improvement of assistive device for low vision: focused on the use of smart assistive device and mobile application, Proceedings of HCI KOREA 2016, 27-29 January, Gangwon-do, Korea, pp. 198-205. (in Korean with English abstract)
2 Ou, S.B. and Lee, J.W. (2019), Implementation of a bollard recognition system for safe walking of the visually impaired, Proceedings of Korea Computer Congress 2019, 26-28 Jun, Jeju, Korea, pp. 901-903. (in Korean)
3 Qin, H., Curtin, K. M., and Rice, M. T. (2018), Pedestrian network repair with spatial optimization models and geocrowdsourced data, GeoJournal, Vol. 83, No. 2, pp. 347-364.   DOI
4 Ting, L., Baijun, Z., Yongsheng, Z., and Shun, Y. (2021), Ship detection algorithm based on improved YOLO V5, In 2021 6th International Conference on Automation, Control and Robotics Engineering (CACRE), 15-17 July, Dalian, China, pp. 483-487.
5 Zhao, Z. Q., Zheng, P., Xu, S. T., and Wu, X. (2019), Object detection with deep learning: A review, IEEE Transactions on Neural Networks and Learning Systems, Vol. 30, No. 11, pp. 3212-3232.   DOI
6 Pathak, A. R., Pandey, M., and Rautaray, S. (2018), Application of deep learning for object detection, Procedia Computer Science, Vol. 132, pp. 1706-1717.   DOI
7 Ye, N., Wang, B., Kita, M., Xie, M., and Cai, W. (2019), Urban commerce distribution analysis based on street view and deep learning, IEEE Access, Vol. 7, pp. 162841-162849.   DOI
8 Yoon, D.Y., Lee, K.J., Yoom, S.I., Noh, G.E., Lee, H.B., Kim, S.H., and Kang, B.G. (2021), Smart assistive device based on CNN for the visually impaired with real-time video processing, Proceedings of KIIT conference, 25-27 November, Jeju, Korea, pp. 665-669. (in Korean with English abstract)
9 Ban, J.H., Lee, T.M., and Yoo, J.H. (2019), Safe2Walk4Blind: DNN-based walking assistance system for the blind, Journal of Institute of Control, Robotics and Systems, Vol. 25, No. 6, pp. 656-571. (in Korean with English abstract)
10 Kim, Y.W., Jang, W.J., and Park, Y.S. (2018), Walkway spatial information collection technologies for disadvantage pedestrians, Transportation Technology and Policy, Vol. 15, No. 2, pp. 23-30. (in Korean)
11 Ban, M.Y., Ryu, S.K., Ji, W.S., Kim, C.M., and Kim, J.S. (2012), User-Friendly Traffic Safety Facilities, Issues & Diagnosis 2012, Vol. 43, Gyeonggi Research Institute, pp. 1-25. (in Korean)
12 Boeing, G. (2017), OSMnx: New methods for acquiring, constructing, analyzing, and visualizing complex street networks, Computers, Environment and Urban Systems, Vol. 65, pp. 126-139.   DOI
13 Erwig, M. (2000), The graph Voronoi diagram with applications, Networks, Vol. 36, No. 3, pp. 156-163.   DOI
14 GM, V., Pereira, B., and Little, S. (2021), Urban footpath image dataset to assess pedestrian mobility, Proceedings of the 1st International Workshop on Multimedia Computing for Urban Data, 20 October, Virtual Event, China, pp. 23-30.
15 Lim, S.B., Seo, C.W., and Yun, H.C. (2015), Digital map updates with UAV photogrammetric methods, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 33, No. 5, pp. 397-405. (in Korean with English abstract)   DOI
16 Jocher, G., Stoken, A., Borovec, J., Christopher, S.T.A.N., and Laughing, L.C. (2021), Ultralytics/yolov5: V4. 0-Nn. Silu( ) activations weights & biases logging Pytorch hub integration, Zenodo, https://doi.org/10.5281/zenodo.4418161. (last date accessed: 28 December 2021)   DOI
17 Kang, J.M., Yoon, H.C., Park, J.K., and Kim, Y,G. (2008), Application of QuickBird imagery for the production of digital map, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 26, No. 1, pp. 63-71. (in Korean with English abstract)
18 Kim, H. and Oh, I.P. (2017), Support for the outdoor walking of people with low vision using visual filter and augmented reality, Archives of Design Research, Vol. 30, No. 4, pp. 71-84. (in Korean with English abstract)   DOI
19 Zhang, W., Witharana, C., Li, W., Zhang, C., Li, X., and Parent, J. (2018), Using deep learning to identify utility poles with crossarms and estimate their locations from google street view images, Sensors, Vol. 18, No. 8, 2484.   DOI