Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회지)

Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회)
권호 표지
DOI QR코드

DOI QR Code

A Hybrid Approach for Automated Building Area Extraction from High-Resolution Satellite Imagery

고해상도 위성영상을 활용한 자동화된 건물 영역 추출 하이브리드 접근법

  • An, Hyowon (Dept. of Civil and Environmental Engineering, Myongji University) ;
  • Kim, Changjae (Dept. of Civil and Environmental Engineering, Myongji University) ;
  • Lee, Hyosung (Dept. of Civil Engineering, Sunchon National University) ;
  • Kwon, Wonsuk (Agency for Defense Development)
  • Received : 2019.11.24
  • Accepted : 2019.12.04
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This research aims to provide a building area extraction approach over the areas where data acquisition is impossible through field surveying, aerial photography and lidar scanning. Hence, high-resolution satellite images, which have high accessibility over the earth, are utilized for the automated building extraction in this study. 3D point clouds or DSM (Digital Surface Models), derived from the stereo image matching process, provides low quality of building area extraction due to their high level of noises and holes. In this regards, this research proposes a hybrid building area extraction approach which utilizes 3D point clouds (from image matching), and color and linear information (from imagery). First of all, ground and non-ground points are separated from 3D point clouds; then, the initial building hypothesis is extracted from the non-ground points. Secondly, color based building hypothesis is produced by considering the overlapping between the initial building hypothesis and the color segmentation result. Afterwards, line detection and space partitioning results are utilized to acquire the final building areas. The proposed approach shows 98.44% of correctness, 95.05% of completeness, and 1.05m of positional accuracy. Moreover, we see the possibility that the irregular shapes of building areas can be extracted through the proposed approach.

본 연구에서는 기존의 연구들에서 주로 사용하여왔던 현장측량, 항공사진, 라이다 데이터 등의 취득이 원천적으로 어려운 지역에 대한 건물 영역 추출을 구현하고자 하였다. 이에 접근성에 큰 영향을 받지 않는 거의 유일한 데이터인 고해상도 위성영상을 활용한 방법론을 제시하고자 한다. 영상정합을 통해 추출되는 점군 데이터 또는 DSM(Digital Surface Models)을 활용한 건물 영역 추출은 데이터내의 높은 잡음과 다수의 빈 영역으로 인해 그 정확성에 한계를 보이고 있다. 따라서 본 연구에서는 영상 정합을 통해 얻어진 3차원 점군 데이터, 영상의 색상 및 선형 정보를 결합하여 건물 영역 추출을 수행하는 하이브리드식 접근법을 제안하였다. 일차적으로 다중영상정합으로 얻어진 3차원 점군 데이터로부터 지면점과 비지면점을 분리하고, 비지면점으로부터 초기 건물 대상지를 추출한다. 이후, 영상의 색상기반 분할을 수행하여 얻어진 결과와 초기 건물 대상지를 결합하여, 색상분할기반 건물 대상지를 추출한다. 이어서 영상의 선형 추출 및 공간 분할정보를 이용하여 최종적인 건물 영역을 선정하게 된다. 본 논문에서 제시한 건물 영역 자동 추출 방법론은 Correctness: 98.44%, Completeness: 95.05%, 위치오차: 1.05m 정도의 성능을 보임을 확인하였으며, 더불어 직각형태 이상의 복잡한 건물 영역도 잘 추출함을 확인하였다.

Keywords

References

  1. Alharthy, A. (2003), Airborne Laser Scanning: System Evaluation and Building Extraction, Ph.D. dissertation. Purdue University, Indiana, USA, 233p.
  2. Baek, S.H. and Park, S.Y. (2010), A stereo matching technique using multi-directional scan-line optimization and reliabilitybased hole-filling, The KIPS Transactions: Part B, Vol.17, No. 2, pp. 115-124. (in Korean with English abstract) https://doi.org/10.3745/KIPSTB.2010.17B.2.115
  3. Baillard, C., Schmid, C., Zisserman, A., and Fitzgibbon, A. (1999), Automatic line matching and 3D reconstruction of buildings from multiple views, International Archives of Photogrammetry and Remote Sensing, IAPRS, 8-10 September, Munich, Germany, Vol.32, pp. 69-80.
  4. Bartels, M. and Wei, H. (2010), Threshold-free object and ground point separation in LIDAR data, Pattern Recognition Letters, Vol. 31, No. 10, pp. 1089-1099. https://doi.org/10.1016/j.patrec.2010.03.007
  5. Chen, L.C., Teo, T.A., Rau, J.Y., Liu, J.K., and Hsu, W.C. (2005), Building reconstruction from LIDAR data and aerial imagery, In Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium IGARSS'05, IEEE, 25-29 July, Seoul, Korea, Vol. 4, pp. 2846-2849.
  6. Chen, T.W., Chen, Y.L., and Chien, S.Y. (2008), Fast image segmentation based on K-Means clustering with histograms in HSV color space, In 2008 IEEE 10th Workshop on Multimedia Signal Processing, IEEE, 8-10 October, Cairns, Qld, Australia, pp. 322-325.
  7. Cheng, L., Gong, J., Li, M., and Liu, Y. (2011), 3D building model reconstruction from multi-view aerial imagery and lidar data, Photogrammetric Engineering and Remote Sensing, Vol. 77, No. 2, pp. 125-139. https://doi.org/10.14358/PERS.77.2.125
  8. Choi Y. and Cho G. (2007), Classification of raw LiDAR data using entropy theory, Journal of the Korean Society of Civil Engineers, Vol. 27(2D), pp. 225-231.
  9. Faig, W. and Widmer, T. (2000), Automatic building extraction from aerial images, International Archives of Photogrammetry and Remote Sensing, IEEE, 4-8 December, Cancun, Mexico, Vol. 33, pp. 1708-1715.
  10. Forstner, W. (1999), 3D-city models: automatic and semiautomatic acquisition methods, Photogrammetric Week 99, PHOWO99, 20-24 September, Stuttgart, Germany, pp.291-303.
  11. Haala, N., Brenner, C., and Anders, K.H. (1998), 3D urban GIS from laser altimeter and 2D map data, International Archives of Photogrammetry and Remote Sensing, ISPRS, 6-10 July, Columbus, Ohio, USA, Vol. 32, pp. 339-346.
  12. Habib, A.F., Zhai, R., and Kim, C. (2010), Generation of complex polyhedral building models by integrating stereo-aerial imagery and lidar data, Photogrammetric Engineering and Remote Sensing, Vol. 76, No. 5, pp. 609-623. https://doi.org/10.14358/PERS.76.5.609
  13. Hirschmuller, H. (2008), Stereo processing by semi-global matching and mutual information, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 2, pp. 328-341. https://doi.org/10.1109/TPAMI.2007.1166
  14. Hirschmuller, H. and Scharstein, D. (2009), Evaluation of stereo matching costs on images with radiometric differences, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 9, pp. 1582-1599. https://doi.org/10.1109/TPAMI.2008.221
  15. Kim, C., Habib, A., Pyeon, M., Kwon, G.R., Jung, J., and Heo, J. (2016), Segmentation of planar surfaces from laser scanning data using the magnitude of normal position vector for adaptive neighborhoods, Sensors, Vol. 16, No. 2, p. 140. https://doi.org/10.3390/s16020140
  16. Kim, Z., Huertas, A., and Nevatia, R. (2001), Automatic description of buildings with complex rooftops from multiple images, Computer Vision and Pattern Recognition CVPR 2001, IEEE, 8-14 December, Kauai, HI, USA, Vol. 2, pp. 272-279.
  17. Kwak, E. (2013), Automatic 3D Building Model Generation by Integrating LiDAR and Aerial Images Using a Hybrid Approach, Ph.D. dissertation, University of Calgary, Alberta, Canada, 163p.
  18. Kwak, E., Al-Durgham, M., and Habib, A. (2012), Automatic 3D building model generation from lidar and image data using sequential minimum bounding rectangle, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, ISPRS, 5 August - 01 September, Melbourne, Australia, Vol. 39, pp. 285-290.
  19. Kwak, E. and Habib, A. (2014), Automatic representation and reconstruction of DBM from LiDAR data using recursive minimum bounding rectangle, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 93, pp. 171-191. https://doi.org/10.1016/j.isprsjprs.2013.10.003
  20. Lee, D.H., Lee, K.M., and Lee, S.U. (2008), Fusion of lidar and imagery for reliable building extraction, Photogrammetric Engineering and Remote Sensing, Vol. 74, No. 2, pp. 215-225. https://doi.org/10.14358/PERS.74.2.215
  21. Ma, R. (2004), Building Model Reconstruction from LiDAR Data and Aerial Photographs, Ph.D. dissertation, The Ohio State University, Ohio, USA, 166p.
  22. Maas, H.G. and Vosselman, G. (1999), Two algorithms for extracting building models from raw laser altimetry data. ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 54, pp. 153-163. https://doi.org/10.1016/S0924-2716(99)00004-0
  23. Pingel, T.J., Clarke, K.C., and Mcbride, W.A. (2013), An improved simple morphological filter for the terrain classification of airborne LIDAR data, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 77, pp. 21-30. https://doi.org/10.1016/j.isprsjprs.2012.12.002
  24. Roggero, M. (2001), Airborne laser scanning-clustering in raw data, International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, ISPRS, 22-24 October, Annapolis, Maryland, USA, Vol. 34, pp. 227-232.
  25. Rottensteiner, F. and Jansa, J. (2002), Automatic extraction of buildings from LIDAR data and aerial images, International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, ISPRS, 9-12 July, Ottawa, Canada, Vol. 34, pp. 569-574.
  26. Sampath, A. and Shan, J. (2010), Segmentation and reconstruction of polyhedral building roofs from aerial lidar point clouds, IEEE Transactions on Geoscience and Remote Sensing, Vol. 48, No. 3, pp. 1554-1567. https://doi.org/10.1109/TGRS.2009.2030180
  27. Schenk, T. and Csatho, B. (2002), Fusion of LIDAR data and aerial imagery for a more complete surface description, International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, ISPRS, 9-13 September, Graz, Austria, Vol. 34, pp. 310-317.
  28. Seo, S. (2003), Model-based Automatic Building Extraction from Lidar and Aerial Imagery, Ph.D dissertation, The Ohio State University, Ohio, USA, 139p
  29. Sohn, G., Huang, X., and Tao, V. (2008), Using a binary space partitioning tree for reconstructing polyhedral building models from airborne lidar data, Photogrammetric Engineering and Remote Sensing, Vol. 74, No. 11, pp. 1425-1438. https://doi.org/10.14358/PERS.74.11.1425
  30. Suveg, I. and Vosselman, G. (2004), Reconstruction of 3D building models from aerial images and maps, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 58, pp. 202-224. https://doi.org/10.1016/j.isprsjprs.2003.09.006
  31. Toutin, T. (2004), Comparison of stereo-extracted DTM from different high-resolution sensors: SPOT-5, EROS-A, IKONOSII, and QuickBird, IEEE Transactions on Geoscience and Remote Sensing, Vol. 42, No. 10, pp. 2121-2129. https://doi.org/10.1109/TGRS.2004.834641
  32. Von Gioi, R.G., Jakubowicz, J., Morel, J.M., and Randall, G. (2010), LSD: A fast line segment detector with a false detection control, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 32, No. 4, pp. 722-732. https://doi.org/10.1109/TPAMI.2008.300
  33. Von Gioi, R.G., Jakubowicz, J., Morel, J.M., and Randall, G. (2012), LSD: a line segment detector, Image Processing on Line, Vol. 2, pp. 35-55. https://doi.org/10.5201/ipol.2012.gjmr-lsd
  34. Vosselman, G. (2000), Slope based filtering of laser altimetry data, International Archives of Photogrammetry and Remote Sensing, IAPRS, 16-22 July, Amsterdam, The Netherlands, Vol. 33, pp. 935-942.
  35. Vosselman, G. and Dijkman, S. (2001), 3D building model reconstruction from point clouds and ground plans, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, ISPRS, 22-24 October, Annapolis, Maryland, Vol. 34, pp. 37-44.
  36. Wang, Y., Schultz, S., and Giuffrida, F. (2008), Pictometry's proprietary airborne digital imaging system and its application in 3D city modelling, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, ISPRS, 3-11 July, Beijing, China, Vol. 37, pp. 1065-1070.
  37. Yan, L. and Li, P. (2014), Building footprints extraction methods based on marker-controlled watershed segmentation and local radon transformation. Information Technology Journal, Vol. 13, No. 11, pp. 1903-1907. https://doi.org/10.3923/itj.2014.1903.1907
  38. Zhang, K., Chen, S.C., Whitman, D., Shyu, M.L., Yan, J., and Zhang, C. (2003), A progressive morphological filter for removing nonground measurements from airborne LIDAR data, IEEE Transactions on Geoscience and Remote Sensing, Vol. 41, No. 4, pp. 872-882. https://doi.org/10.1109/TGRS.2003.810682
  39. Zhang, L. and Gruen, A. (2006), Multi-image matching for DSM generation from IKONOS imagery, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 60, No. 3, pp. 195-211. https://doi.org/10.1016/j.isprsjprs.2006.01.001
  40. Zheng, L., Zhang, J., and Wang, Q. (2009), Mean-shiftbased color segmentation of images containing green vegetation, Computers and Electronics in Agriculture, Vol. 65, No. 1, pp. 93-98. https://doi.org/10.1016/j.compag.2008.08.002