Browse > Article
http://dx.doi.org/10.7780/kjrs.2021.37.2.7

Comparative Analysis of Evaluation Methods for Image Segmentation Results  

Seo, Won-Woo (Department of Geoinformatic Engineering, Inha University)
Lee, Kyu-Sung (Department of Geoinformatic Engineering, Inha University)
Publication Information
Korean Journal of Remote Sensing / v.37, no.2, 2021 , pp. 257-274 More about this Journal
Abstract
Although image segmentation is a critical part of object-based analysis of high resolution imagery, there has been lack of studies to evaluate the quality of image segmentation. In this study, we aimed to find practical and effective methods to obtain optimal parameters for image segmentation. Evaluations of image segmentation are divided into unsupervised, supervised, and qualitative visual interpretation methods. Using the multispectral UAV images, sampled from urban and forest over the Incheon Metropolitan City Park, three evaluation methods were compared. In overall, three methods showed very similar results regardless of the computational costs and applicability, although the optimal parameters determined by the evaluations were different between the urban and forest images. There is no single measure that outperforms in the unsupervised evaluation. Any combinations of intra-segment measures (V, COV, WV) and inter-segment measures (MI, BSH, DTNP) provided almost the same results. Although supervised method may be biased by subjective selection of reference data, it can be easily applied to detect object of interest. The qualitative visual interpretation on the segmentation results corresponded with the unsupervised and supervised evaluations.
Keywords
image segmentation; unsupervised evaluation; supervised evaluation; OBIA; SLIC; UAV; multispectral image;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Najafi, P., B. Feizizadeh, and H. Navid, 2021. A Comparative Approach of Fuzzy Object Based Image Analysis and Machine Learning Techniques Which Are Applied to Crop Residue Cover Mapping by Using Sentinel-2 Satellite and UAV Imagery, Remote Sensing, 13(5): 937.   DOI
2 Smith, A., 2010. Image segmentation scale parameter optimization and land cover classification using the Random Forest algorithm, Journal of Spatial Science, 55(1): 69-79.   DOI
3 Su, T. and S. Zhang, 2017. Local and global evaluation for remote sensing image segmentation, ISPRS Journal of Photogrammetry and Remote Sensing, 130: 256-276.   DOI
4 Wang, Y., Q. Qi, Y. Liu, L. Jiang, and J. Wang, 2019. Unsupervised segmentation parameter selection using the local spatial statistics for remote sensing image segmentation, International Journal of Applied Earth Observation and Geoinformation, 81: 98-109.   DOI
5 Weidner, U., 2008. Contribution to the assessment of segmentation quality for remote sensing applications. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 37(B7): 479-484.
6 Yu, Q., P. Gong, N. Clinton, G. Biging, M. Kelly, and D. Schirokauer, 2006. Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery, Photogrammetric Engineering and Remote Sensing, 72(7): 799-811.   DOI
7 Zhang, H., J.E. Fritts, and S.A. Goldman, 2008. Image segmentation evaluation: A survey of unsupervised methods, Computer Vision and Image Understanding, 110(2): 260-280.   DOI
8 Zhang, X., P. Xiao, and X. Feng, 2012. An unsupervised evaluation method for remotely sensed imagery segmentation, IEEE Geoscience and Remote Sensing Letters, 9(2): 156-160.   DOI
9 Zhao, M., Q. Meng, L. Zhang, D. Hu, Y. Zhang, and M. Allam, 2020. A Fast and Effective Method for Unsupervised Segmentation Evaluation of Remote Sensing Images, Remote Sensing, 12(18): 3005.   DOI
10 Espindola, G.M., G. Camara, I.A. Reis, L.S. Bins, and A.M. Monteiro, 2006. Parameter selection for region-growing image segmentation algorithms using spatial autocorrelation, International Journal of Remote Sensing, 27(14): 3035-3040.   DOI
11 Franklin, S.E., 2018. Pixel-and object-based multispectral classification of forest tree species from small unmanned aerial vehicles, Journal of Unmanned Vehicle Systems, 6(4): 195-211.   DOI
12 Achanta, R., A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, 2012. SLIC superpixels compared to state-of-the-art superpixel methods, IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11): 2274-2282.   DOI
13 Cao, J., W. Leng, K. Liu, L. Liu, Z. He, and Y. Zhu, 2018. Object-based mangrove species classification using unmanned aerial vehicle hyperspectral images and digital surface models, Remote Sensing, 10(1): 89.   DOI
14 Gao, H., Y. Tang, L. Jing, H. Li, and H. Ding, 2017. A novel unsupervised segmentation quality evaluation method for remote sensing images, Sensors, 17(10): 2427.   DOI
15 Chung, M., Y. Han, J. Choi, and Y. Kim, 2018. Optimal parameter analysis and evaluation of change detection for SLIC-based superpixel techniques using KOMPSAT data, Korean Journal of Remote Sensing, 34(6-3): 1427-1443 (in Korean with English abstract).   DOI
16 Johnson, B.A., M. Bragais, I. Endo, D.B. Magcale-Macandog, and P.B.M. Macandog, 2015. Image segmentation parameter optimization considering within-and between-segment heterogeneity at multiple scale levels: Test case for mapping residential areas using landsat imagery, ISPRS International Journal of Geo-Information, 4(4): 2292-2305.   DOI
17 Lee, H.S., W.W. Seo, C. Woo, and K.S. Lee, 2019. Derivation and evaluation of surface reflectance from UAV multispectral image for monitoring forest vegetation, Korean Journal of Remote Sensing, 35(6-2): 1149-1160 (in Korean with English abstract).   DOI
18 Ming, D., J. Li, J. Wang, and M. Zhang, 2015. Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example, ISPRS Journal of Photogrammetry and Remote Sensing, 106: 28-41.   DOI
19 Chen, G., K. Zhao, and R. Powers, 2014. Assessment of the image misregistration effects on object-based change detection, ISPRS Journal of Photogrammetry and Remote Sensing, 87: 19-27.   DOI
20 Chen, Y., D. Ming, L. Zhao, B. Lv, K. Zhou, and Y. Qing, 2018. Review on high spatial resolution remote sensing image segmentation evaluation, Photogrammetric Engineering and Remote Sensing, 84(10): 629-646.   DOI
21 Dronova, I., P. Gong, N.E. Clinton, L. Wang, W. Fu, S. Qi, and Y. Liu, 2012. Landscape analysis of wetland plant functional types: The effects of image segmentation scale, vegetation classes and classification methods, Remote Sensing of Environment, 127: 357-369.   DOI
22 Chung, S.Y., J.S. Yim, and M.Y. Shin, 2011. A comparison of pixel-and segment-based classification for tree species classification using QuickBird imagery, Journal of Korean Society of Forest Science, 100(4): 540-547 (in Korean with English abstract).
23 Clinton, N., A. Holt, J. Scarborough, L.I. Yan, and P. Gong, 2010. Accuracy assessment measures for object-based image segmentation goodness, Photogramm. Eng. Remote Sens, 76(3): 289-299.   DOI
24 Crommelinck, S., R. Bennett, M. Gerke, M.N. Koeva, M.Y. Yang, and G. Vosselman, 2017. SLIC superpixels for object delineation from UAV data, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 4: 9-16.
25 Duro, D.C., S.E. Franklin, and M.G. Dube, 2012. A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery, Remote Sensing of Environment, 118: 259-272.   DOI