Browse > Article
http://dx.doi.org/10.7780/kjrs.2019.35.6.3.10

A Convolutional Neural Network Model with Weighted Combination of Multi-scale Spatial Features for Crop Classification  

Park, Min-Gyu (Department of Geoinformatic Engineering, Inha University)
Kwak, Geun-Ho (Department of Geoinformatic Engineering, Inha University)
Park, No-Wook (Department of Geoinformatic Engineering, Inha University)
Publication Information
Korean Journal of Remote Sensing / v.35, no.6_3, 2019 , pp. 1273-1283 More about this Journal
Abstract
This paper proposes an advanced crop classification model that combines a procedure for weighted combination of spatial features extracted from multi-scale input images with a conventional convolutional neural network (CNN) structure. The proposed model first extracts spatial features from patches with different sizes in convolution layers, and then assigns different weights to the extracted spatial features by considering feature-specific importance using squeeze-and-excitation block sets. The novelty of the model lies in its ability to extract spatial features useful for classification and account for their relative importance. A case study of crop classification with multi-temporal Landsat-8 OLI images in Illinois, USA was carried out to evaluate the classification performance of the proposed model. The impact of patch sizes on crop classification was first assessed in a single-patch model to find useful patch sizes. The classification performance of the proposed model was then compared with those of conventional two CNN models including the single-patch model and a multi-patch model without considering feature-specific weights. From the results of comparison experiments, the proposed model could alleviate misclassification patterns by considering the spatial characteristics of different crops in the study area, achieving the best classification accuracy compared to the other models. Based on the case study results, the proposed model, which can account for the relative importance of spatial features, would be effectively applied to classification of objects with different spatial characteristics, as well as crops.
Keywords
Crop classification; Convolutional neural network; Spatial feature; Image patch;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Kim, Y., G.-H. Kwak, K.-D. Lee, S.-I. Na, C.-W. Park, and N.-W. Park, 2018. Performance evaluation of machine learning and deep learning algorithms in crop classification: Impact of hyper-parameters and training sample size, Korean Journal of Remote Sensing, 34(5): 811-827 (in Korean with English abstract).   DOI
2 Lee, E., J. H. Kastens, and S. L. Egbert, 2016. Investigating collection 4 versus collection 5 MODIS 250 m NDVI time-series data for crop separability in Kansas, USA, International Journal of Remote Sensing, 37(2): 341-355.   DOI
3 Liu, B. S. and W. L. Zhang, 2019. Multi-scale convolutional neural networks aggregation for hyperspectral images classification, Proc. of the 2019 Symposium on Piezoelectricity, Acoustic Waves and Device Applications, Heilongjiang, China. Jan. 11-14, pp. 1-6.
4 Meng, Z., L. Li, X. Tang, Z. Feng, L. Jiao, and M. Liang, 2019. Multipath residual network for spectral-spatial hyperspectral image classification, Remote Sensing, 11(16): 1896.   DOI
5 Na, S.-I., C.-H. Park, K.-H. So, H.-Y. Ahn, and K.-D. Lee, 2018. Development of biomass evaluation model of winter crop using RGB imagery based on unmanned aerial vehicle, Korean Journal of Remote Sensing, 34(5): 709-720 (in Korean with English abstract).   DOI
6 Park, N.-W., P. C. Kyriakidis, and S.-Y. Hong, 2016. Spatial estimation of classification accuracy using indicator kriging with an image-derived ambiguity index, Remote Sensing, 8(4): 320.   DOI
7 Sharma, A., X. Liu, and X. Yang, 2018. Land cover classification from multi-temporal, multi-spectral remotely sensed imagery using patch-based recurrent neural networks, Neural Networks, 105: 346-355.   DOI
8 Tian, Z., J. Ji, S. Mei, J. Hou, S. Wan, and Q. Du, 2018. Hyperspectral classification via spatial context exploration with multi-scale CNN, Proc. of the 2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, Jul. 22-27, pp. 2563-2566.
9 Feng, Q., D. Zhu, J. Yang, and B. Li, 2019a. Multisource hyperspectral and LiDAR data fusion for urban land-use mapping based on a modified twobranch convolutional neural network, ISPRS International Journal of Geo-Information, 8(1): 28.   DOI
10 Duan, Y., X. Tao, C. Han, X. Qin, and J. Lu, 2018. Multi-scale convolutional neural network for SAR image semantic segmentation, Proc. of the 2018 IEEE Global Communications Conference, Abu Dhabi, UAE, Dec. 9-13, pp. 1-6.
11 Feng, Q., J. Yang, D. Zhu, J. Liu, H. Guo, B. Bayartungalag, and B. Li, 2019b. Integrating multitemporal Sentinel-1/2 data for coastal land cover classification using a multibranch convolutional neural network: A case of the Yellow River Delta, Remote Sensing, 11(9): 1006.   DOI
12 Hu, F., G. S. Xia, J. Hu, and L. Zhang, 2015a. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery, Remote Sensing, 7(11): 14680-14707.   DOI
13 Hu, J., L. Shen, and G. Sun, 2018. Squeeze-andexcitation networks, Proc. of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, Jun. 18-22, pp. 7132-7141.
14 Hu, W., Y. Huang, L. Wei, F. Zhang, and H. Li, 2015b. Deep convolutional neural networks for hyperspectral image classification, Journal of Sensors, 2015: 258619.
15 Yu, Y. and F. Liu, 2018. A two-stream deep fusion framework for high-resolution aerial scene classification, Computational Intelligence and Neuroscience, 2018: 8639367.
16 Ji, S., C. Zhang, A. Xu, Y. Shi, and Y. Duan, 2018. 3D convolutional neural networks for crop classification with multi-temporal remote sensing images, Remote Sensing, 10(1): 75.   DOI
17 Kim, Y., K.-D. Lee, S.-I. Na, S.-Y. Hong, N.-W. Park, and H. Y. Yoo, 2016. MODIS data-based crop classification using selective hierarchical classification, Korean Journal of Remote Sensing, 32(3): 235-244 (in Korean with English abstract).   DOI
18 Vakalopoulou, M., K. Karantzalos, N. Komodakis, and N. Paragios, 2015. Building detection in very high resolution multispectral data with deep learning features, Proc. of the 2015 IEEE International Geoscience and Remote Sensing Symposium, Milan, Italy, Jul. 26-31, pp. 1873-1876.
19 Wardlow, B. D. and S. L. Egbert, 2008. Large-area crop mapping using time-series MODIS 250m NDVI data: An assessment for the U.S. Central Great Plains, Remote Sensing of Environment, 112(3): 1096-1116.   DOI
20 Xie, B., H. K. Zhang, and J. Xue, 2019. Deep convolutional neural network for mapping smallholder agriculture using high spatial resolution satellite image, Sensors, 19(10): 2398.   DOI
21 Yue, J., W. Zhao, S. Mao, and H. Liu, 2015. Spectralspatial classification of hyperspectral images using deep convolutional neural networks, Remote Sensing Letters, 6(6): 468-477.   DOI
22 Zhong, L., L. Hu, and H. Zhou, 2019. Deep learning based multi-temporal crop classification, Remote Sensing of Environment, 221: 430-443.   DOI
23 Zhang, C., X. Pan, H. Li, A. Gardiner, I. Sargent, J. Hare, and P. M. Atkinson, 2018. A hybrid MLPCNN classifier for very fine resolution remotely sensed image classification, ISPRS Journal of Photogrammetry and Remote Sensing, 140: 133-144.   DOI
24 Zhang, W., P. Tang, and L. Zhao, 2019. Remote sensing image scene classification using CNNCapsNet, Remote Sensing, 11(5): 494.   DOI
25 Zhao, W. and S. Du, 2016. Spectral-spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach, IEEE Transactions on Geoscience and Remote Sensing, 54(8): 4544-4554.   DOI
26 Chen, X., S. Xiang, C. L. Liu, and C. H. Pan, 2014. Vehicle detection in satellite images by hybrid deep convolutional neural networks, IEEE Geoscience and Remote Sensing Letters, 11(10): 1797-1801.   DOI
27 Bohler, J., M. Schaepman, and M. Kneubuhler, 2018. Crop classification in a heterogeneous arable landscape using uncalibrated UAV data, Remote Sensing, 10(8): 1282.   DOI
28 Carranza-Garcia, M., J. Garcia-Gutierrez, and J. C. Riquelme, 2019. A framework for evaluating land use and land cover classification using convolutional neural networks, Remote Sensing, 11(3): 274.   DOI