Browse > Article
http://dx.doi.org/10.12989/sss.2020.25.5.631

Vision-based full-field panorama generation by UAV using GPS data and feature points filtering  

Guo, Yapeng (School of Transportation Science and Engineering, Harbin Institute of Technology)
Xu, Yang (School of Civil Engineering, Harbin Institute of Technology)
Niu, Haowei (School of Transportation Science and Engineering, Harbin Institute of Technology)
Li, Zhonglong (School of Transportation Science and Engineering, Harbin Institute of Technology)
E., Yuhui (Liaoning Transportation Development Center)
Jiao, Xinghua (Liaoning Transportation Development Center)
Li, Shunlong (School of Transportation Science and Engineering, Harbin Institute of Technology)
Publication Information
Smart Structures and Systems / v.25, no.5, 2020 , pp. 631-641 More about this Journal
Abstract
To meet the urgent requirements of safety surveillance from civil engineering management authorities, this study proposes a refined and efficient approach to generate full-field high-resolution panorama of construction sites using camera-amounted UAV (Unmanned Aerial Vehicle). GPS (Global Position System) information extraction for pre-registration, feature points filtering for efficient registration and optimal seaming line seeking for fusion are performed in sequence to form the full-field panorama generation framework. Advantages of the proposed method are as follows. First, GPS information can sort images for pre-registration, avoiding inefficient repeated pairwise calculations and matching. Second, the feature points are filtered according to the characteristics of the construction site images to reduce the amount of calculation. The proposed framework is validated on a road construction site and results demonstrate that it can generate an accurate and high-quality full-site panorama for the safety supervision in a much efficient manner.
Keywords
full-field panorama; UAV; GPS information; image registration; image stitching;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Brown, M. and Lowe, D. (2007), "Automatic panoramic image stitching using invariant features", Int. J. Comput. Vision, 74(1), 59-73. https://doi.org/10.1007/s11263-006-0002-3   DOI
2 Calonder, M., Lepetit, V., Strecha, C. and Fua, P. (2010), "BRIEF: Binary robust independent elementary features", Profeedings of European Conference on Computer Vision, 6314, 778-792.
3 Carlos, E.T. (2008), "Gauss Kruger projection for areas of wide longitudinal extent", Int. J. Geographi. Info. Sci., 22(6), 703-719. https://doi.org/10.1080/13658810701602286   DOI
4 De Melo, R.R.S., Costa, D.B., Lvares, J.S. and Irizarry, J. (2017), "Applicability of unmanned aerial system (UAS) for safety inspection on construction sites", Safety Sci., 98, 174-185. https://doi.org/10.1016/j.ssci.2017.06.008   DOI
5 Ellenberg, A., Branco, L., Krick, A., Bartoli, I. and Kontsos, A. (2014), "Use of unmanned aerial vehicle for quantitative infrastructure evaluation", J. Infrastruct. Syst., 21(3), 04014054. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000246   DOI
6 Hackl, J., Adey, B.T., Wozniak, M. and Schumperlin, O. (2017), "Use of unmanned aerial vehicle photogrammetry to obtain topographical information to improve bridge risk assessment", J. Infrastruct. Syst., 24(1), 04017041. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000393   DOI
7 Ham, Y., Han, K.K., Lin, J.J. and Golparvar-Fard, M. (2016), "Visual monitoring of civil infrastructure systems via cameraequipped unmanned aerial vehicles (UAV): A review of related works", Visualiz. Eng., 4(1), 1. https://doi.org/10.1186/s40327-015-0029-z   DOI
8 Irizarry, J. and Costa, D.B. (2016), "Exploratory study of potential applications of unmanned aerial systems for construction management tasks", J. Manage. Eng., 32(3), 05016001. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000422   DOI
9 Kim, S. and Kim, S. (2018), "Opportunities for construction site monitoring by adopting first personal view (FPV) of a drone", Smart Struct. Syst., Int. J., 21(2), 139-149. https://doi.org/10.12989/sss.2018.21.2.139
10 Li, H., Zhang, Q.-L., Yang, B., Lu, J. and Hu, J. (2015), "Development and application of construction monitoring system for shanghai tower", Smart Struct. Syst., Int. J., 15(4), 1019-1039. https://doi.org/10.12989/sss.2015.15.4.1019   DOI
11 Akbar, M.A., Qidwai, U. and Jahanshahi, M.R. (2019), "An evaluation of image-based structural health monitoring using integrated unmanned aerial vehicle platform", Struct. Control Health Monitor., 26(1), e2276. https://doi.org/10.1002/stc.2276   DOI
12 Bang, S., Kim, H. and Kim, H. (2017), "UAV-based automatic generation of high-resolution panorama at a construction site with a focus on preprocessing for image stitching", Automat. Constr., 84, 70-80. https://doi.org/10.1016/j.autcon.2017.08.031   DOI
13 Li, M., Chen, R., Zhang, W., Li, D., Liao, X., Wang, L., Pan, Y. and Zhang, P. (2017), "A stereo dual-channel dynamic programming algorithm for uav image stitching", Sensors, 17(9), 2060. https://doi.org/10.3390/s17092060   DOI
14 Lin, C., Pankanti, S., Ramamurthy, K. and Aravkin, A. (2015), "Adaptive as-natural-as-possible image stitching", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, June.
15 Microsoft research image composite editor. http://research.microsoft.com/en-us/um/redmond/groups/ivm/ice/
16 Liu, P., Chen, A.Y., Huang, Y.-N., Han, J.-Y., Lai, J.-S., Kang, S.-C., Wu, T.-H., Wen, M.-C. and Tsai, M.-H. (2014), "A review of rotorcraft unmanned aerial vehicle (UAV) developments and applications in civil engineering", Smart Struct. Syst., Int. J., 13(6), 1065-1094. https://doi.org/10.12989/sss.2014.13.6.1065   DOI
17 Matthew, B. and Lowe, D.G. (2007), "Automatic panoramic image stitching using invariant features", Int. J. Comput. Vision, 74(1), 59-73. https://doi.org/10.1007/s11263-006-0002-3   DOI
18 Metni, N. and Hamel, T. (2007), "A UAV for bridge inspection: Visual servoing control law with orientation limits", Automat. Constr., 17(1), 3-10. https://doi.org/10.1016/j.autcon.2006.12.010   DOI
19 Reagan, D., Sabato, A., Niezrecki, C., Yu, T. and Wilson, R. (2016), "An autonomous unmanned aerial vehicle sensing system for structural health monitoring of bridges", In: Nondestructive Evaluation and Health Monitoring, San Diego, CA, USA, March.
20 Rosten, E. and Drummond, T. (2006), "Machine learning for highspeed corner detection", Profeedings of European Conference on Computer Vision, 3951, 430-443.
21 Rublee, E., Rabaud, V., Konolige, K. and Bradski, G.R. (2011), "ORB: An efficient alternative to sift or surf", Proceedings of 2011 IEEE International Conference on Computer Vision, Barcelona, Spain, November.
22 Torge, W. and Muller, J. (2012), Geodesy, Walter de Gruyter.
23 Xiang, R., Sun, M., Jiang, C., Liu, L., Zheng, H. and Li, X. (2014), "A method of fast mosaic for massive uav images", Land Surface Remote Sensing II, 9260, 92603W. https://doi.org/10.1117/12.2069201
24 Zhang, W., Li, X., Yu, J., Kumar, M. and Mao, Y. (2018), "Remote sensing image mosaic technology based on surf algorithm in agriculture", EURASIP J. Image Video Process., 2018(1), 85. https://doi.org/10.1186/s13640-018-0323-5   DOI
25 Xu, X., Soga, K., Nawaz, S., Moss, N., Bowers, K. and Gajia, M. (2015), "Performance monitoring of timber structures in underground construction using wireless smartplank", Smart Struct. Syst., Int. J., 15(3), 769-785. https://doi.org/10.12989/sss.2015.15.3.769   DOI