Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회지)

Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회)
권호 표지
DOI QR코드

DOI QR Code

Detection of Collapse Buildings Using UAV and Bitemporal Satellite Imagery

UAV와 다시기 위성영상을 이용한 붕괴건물 탐지

  • Jung, Sejung (Department of Geospatial Information, Kyungpook National University) ;
  • Lee, Kirim (Department of Geospatial Information, Kyungpook National University) ;
  • Yun, Yerin (School of Convergence & Fusion System Engineering, Kyungpook National University) ;
  • Lee, Won Hee (School of Convergence & Fusion System Engineering, Kyungpook National University) ;
  • Han, Youkyung (School of Convergence & Fusion System Engineering, Kyungpook National University)
  • Received : 2020.04.21
  • Accepted : 2020.06.01
  • Published : 2020.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, collapsed building detection using UAV (Unmanned Aerial Vehicle) and PlanetScope satellite images was carried out, suggesting the possibility of utilization of heterogeneous sensors in object detection located on the surface. To this end, the area where about 20 buildings collapsed due to forest fire damage was selected as study site. First of all, the feature information of objects such as ExG (Excess Green), GLCM (Gray-Level Co-Occurrence Matrix), and DSM (Digital Surface Model) were generated using high-resolution UAV images performed object-based segmentation to detect collapsed buildings. The features were then used to detect candidates for collapsed buildings. In this process, a result of the change detection using PlanetScope were used together to improve detection accuracy. More specifically, the changed pixels acquired by the bitemporal PlanetScope images were used as seed pixels to correct the misdetected and overdetected areas in the candidate group of collapsed buildings. The accuracy of the detection results of collapse buildings using only UAV image and the accuracy of collapse building detection result when UAV and PlanetScope images were used together were analyzed through the manually dizitized reference image. As a result, the results using only UAV image had 0.4867 F1-score, and the results using UAV and PlanetScope images together showed that the value improved to 0.8064 F1-score. Moreover, the Kappa coefficiant value was also dramatically improved from 0.3674 to 0.8225.

본 연구에서는 UAV (Unmanned Aerial Vehicle)와 PlanetScope 위성영상을 함께 이용한 붕괴건물 탐지를 수행하여 지표면에 위치한 특정 객체 탐지에 있어 이종 센서의 활용 가능성을 제시하였다. 이를 위해 지난해 4월 산불 피해로 붕괴된 20여 채의 건물들이 있는 곳을 실험장소로 선정하였다. 붕괴건물 탐지를 위해 1차적으로 객체기반 분할을 수행한 고해상도의 UAV 영상을 이용해 ExG (Excess Green), GLCM (Gray-Level Co-occurrence Matrix) 그리고 DSM (Digital Surface Model)과 같은 객체들의 특징(feature) 정보를 생성한 후 이를 붕괴건물 후보군 탐지에 이용하였다. 이 과정에서 탐지정확도 향상을 위해 PlanetScope를 이용한 변화탐지 결과를 함께 사용하였으며 이를 시드 화소(seed pixles)로 사용하여 붕괴건물 후보군에서 오탐지된 영역과 과탐지된 영역을 수정 및 보완하였다. 최종적인 탐지 결과는 참조 영상을 통해 그 성능을 분석하였으며 UAV 영상만을 이용한 붕괴건물 후보군 탐지 결과와 UAV 그리고 PlanetScope 영상을 함께 사용했을 때의 결과의 정확도를 비교, 분석하였다. 그 결과 UAV 영상만을 이용해 탐지한 붕괴건물의 정확도는 0.4867 F1-score를 가지며 UAV와 PlanetScope 영상을 함께 사용했을 때의 결과는 0.8064 F1-score로 그 값이 상승하였다. Kappa 지수 또한 0.3674에서 0.8225로 향상된 것을 확인할 수 있었다.

Keywords

References

  1. Awrangjeb, M., Zhang, C., and Fraser, C. S. (2011), Improved building detection using texture information, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences-2011, 38, 5-7 October, Munich, Germany, pp. 143-148.
  2. Hao, L., Zhang, Y., and Cao, Z. (2019), Robust building boundary extraction method based on dual-scale feature classification and decision fusion with satellite image, International journal of remote sensing. Vol. 40, No. 14, pp. 5497-5529. https://doi.org/10.1080/01431161.2019.1580787
  3. Haralick, R.M., Shanmugam, K., and Dinstein, I.H. (1973), Textural features for image classification, IEEE Transactions on systems, man, and cybernetics, Vol. SMC-3. No. 6, pp. 610-621. https://doi.org/10.1109/TSMC.1973.4309314
  4. Hong, Z., Tong, X., Cao, W., Jiang, S., Chen, P., and Liu, S. (2015), Rapid three-dimensional detection approach for building damage due to earthquakes by the use of parallel processing of unmanned aerial vehicle imagery, Journal of Applied Remote Sensing, Vol. 9, No. 1, pp. 097292. https://doi.org/10.1117/1.JRS.9.097292
  5. Huang, X., Zhang, L., and Zhu, T. (2013), Building change detection from multitemporal high-resolution remotely sensed images based on a morphological building index, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 7, No. 1, pp. 105-115. https://doi.org/10.1109/JSTARS.2013.2252423
  6. Jung, S.J., Kim, T.H., Lee, W.H., and Han, Y.K. (2019), Object-based Change Detection using Various Pixelbased Change Detection Results and Registration Noise, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 37, No. 6, pp. 481-489. (in Korean with English abstract) https://doi.org/10.7848/KSGPC.2019.37.6.481
  7. Konstantinidis, D., Stathaki, T., Argyriou, V., and Grammalidis, N. (2016), Building detection using enhanced HOG-LBP features and region refinement processes, IEEE Journal of Selected topics in applied Earth observations and Remote Sensing, Vol. 10, No. 3, pp. 888-905. https://doi.org/10.1109/JSTARS.2016.2602439
  8. Landis, J.R. and Koch, G.G. (1977), An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers, Biometrics, Vol. 33, No. 2, pp. 363-374. https://doi.org/10.2307/2529786
  9. Li, S., Tang, H., He, S., Shu, Y., Mao, T., Li, J., and Xu, Z. (2015), Unsupervised detection of earthquake-triggered roof-holes from UAV images using joint color and shape features, IEEE Geoscience and Remote Sensing Letters, Vol. 12, No. 9, pp. 1823-1827. https://doi.org/10.1109/LGRS.2015.2429894
  10. Liu, H., Yang, M., Chen, J., Hou, J., and Deng, M. (2018), Lineconstrained shape feature for building change detection in VHR remote sensing imagery, ISPRS International Journal of Geo-Information, Vol. 7, No. 10, pp. 410. https://doi.org/10.3390/ijgi7100410
  11. Ma, H., Liu, Y., Ren, Y., and Yu, J. (2020), Detection of Collapsed Buildings in Post-Earthquake Remote Sensing Images Based on the Improved YOLOv3, Remote Sensing, Vol. 12, No. 1, pp. 44.
  12. Mosammam, H.M., Nia, J.T., Khani, H., Teymouri, A., and Kazemi, M. (2017), Monitoring land use change and measuring urban sprawl based on its spatial forms: The case of Qom city, The Egyptian Journal of Remote Sensing and Space Science, Vol. 20, No. 1, pp. 103-116. https://doi.org/10.1016/j.ejrs.2016.08.002
  13. Shin, D.Y., Kim, T.H., Han, Y.K., Kim, S.S., and Park, J.S. (2019), Change Detection of Building Demolition Area Using UAV, Korean Journal of Remote Sensing, Vol. 35, No. 5-2, pp. 819-829. (in Korean with English abstract) https://doi.org/10.7780/kjrs.2019.35.5.2.6
  14. Tanchotsrinon, C., Phimoltares, S., and Lursinsap, C. (2013), An autonomic building detection method based on texture analysis, color segmentation, and neural classification, In 2013 5th International Conference on Knowledge and Smart Technology (KST) IEEE-2013, 31 January - 1 February, Chonburi, Thailand, pp. 162-167.
  15. Woebbecke, D.M., Meyer, G.E., Von Bargen, K., and Mortensen, D.A. (1995), Color indices for weed identification under various soil, residue, and lighting conditions, Transactions of the ASAE, Vol. 38, No. 1, pp. 259-269. https://doi.org/10.13031/2013.27838
  16. Xiao, P., Zhang, X., Wang, D., Yuan, M., Feng, X., and Kelly, M. (2016), Change detection of built-up land: A framework of combining pixel-based detection and objectbased recognition, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 119, pp. 402-414. https://doi.org/10.1016/j.isprsjprs.2016.07.003
  17. Xie, S., Duan, J., Liu, S., Dai, Q., Liu, W., Ma, Y., and Ma, C. (2016), Crowdsourcing rapid assessment of collapsed buildings early after the earthquake based on aerial remote sensing image: A case study of yushu earthquake, Remote Sensing, Vol. 8, No. 9, pp. 759. https://doi.org/10.3390/rs8090759
  18. Zhang, X., Chen, G., Wang, W., Wang, Q., and Dai, F. (2017), Object-based land-cover supervised classification for very-high-resolution UAV images using stacked denoising autoencoders, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, No. 7, pp. 3373-3385. https://doi.org/10.1109/JSTARS.2017.2672736

Cited by

  1. 주택건설 사업계획 수립을 위한 공사 예정지의 DEM 구축 및 공간분석 vol.22, pp.1, 2020, https://doi.org/10.5762/kais.2021.22.1.621
  2. 주택건설 사업계획 수립을 위한 공사 예정지의 DEM 구축 및 공간분석 vol.22, pp.1, 2020, https://doi.org/10.5762/kais.2021.22.1.621