Browse > Article
http://dx.doi.org/10.7780/kjrs.2020.36.4.2

Potential of Bidirectional Long Short-Term Memory Networks for Crop Classification with Multitemporal Remote Sensing Images  

Kwak, Geun-Ho (Department of Geoinformatic Engineering, Inha University)
Park, Chan-Won (National Institute of Agricultural Sciences, Rural Development Administration)
Ahn, Ho-Yong (National Institute of Agricultural Sciences, Rural Development Administration)
Na, Sang-Il (National Institute of Agricultural Sciences, Rural Development Administration)
Lee, Kyung-Do (National Institute of Agricultural Sciences, Rural Development Administration)
Park, No-Wook (Department of Geoinformatic Engineering, Inha University)
Publication Information
Korean Journal of Remote Sensing / v.36, no.4, 2020 , pp. 515-525 More about this Journal
Abstract
This study investigates the potential of bidirectional long short-term memory (Bi-LSTM) for efficient modeling of temporal information in crop classification using multitemporal remote sensing images. Unlike unidirectional LSTM models that consider only either forward or backward states, Bi-LSTM could account for temporal dependency of time-series images in both forward and backward directions. This property of Bi-LSTM can be effectively applied to crop classification when it is difficult to obtain full time-series images covering the entire growth cycle of crops. The classification performance of the Bi-LSTM is compared with that of two unidirectional LSTM architectures (forward and backward) with respect to different input image combinations via a case study of crop classification in Anbadegi, Korea. When full time-series images were used as inputs for classification, the Bi-LSTM outperformed the other unidirectional LSTM architectures; however, the difference in classification accuracy from unidirectional LSTM was not substantial. On the contrary, when using multitemporal images that did not include useful information for the discrimination of crops, the Bi-LSTM could compensate for the information deficiency by including temporal information from both forward and backward states, thereby achieving the best classification accuracy, compared with the unidirectional LSTM. These case study results indicate the efficiency of the Bi-LSTM for crop classification, particularly when limited input images are available.
Keywords
Crop classification; Deep learning; Long short-term memory; Multitemporal analysis;
Citations & Related Records
Times Cited By KSCI : 8  (Citation Analysis)
연도 인용수 순위
1 Na, S.-I., C.-W. Park, K.-H. So, H.-Y. Ahn, and K.-D. Lee, 2018. Application method of unmanned aerial vehicle for crop monitoring in Korea, Korean Journal of Remote Sensing, 34(5-2): 829-846 (in Korean with English abstract).   DOI
2 Ruswurm, M. and M. Korner, 2018. Multi-temporal land cover classification with sequential recurrent encoders, ISPRS International Journal of Geo-Information, 7(4): 129.   DOI
3 Schuster, M. and K. K. Paliwal, 1997. Bidirectional recurrent neural networks, IEEE Transactions on Signal Processing, 45(11): 2673-2681.   DOI
4 Sonobe, R., Y. Yamaya, H. Tani, X. Wang, N. Kobayashi, and K.-I. Mochizuki, 2017. Mapping crop cover using multi-temporal Landsat 8 OLI imagery, International Journal of Remote Sensing, 38(15): 4348-4361.   DOI
5 Srivastava, N., G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, 2014. Dropout: A simple way to prevent neural networks from overfitting, Journal of Machine Learning Research, 15(1): 1929-1958.
6 Sun, Z., L. Di, and H. Fang, 2019. Using long shortterm memory recurrent neural network in land cover classification on Landsat and Cropland data layer time series, International Journal of Remote Sensing, 40(2): 593-614.   DOI
7 Yang, L., Y. Li, J. Wang, and Z. Tang, 2019. Post text processing of Chinese speech recognition based on bidirectional LSTM networks and CRF, Electronics, 8(11): 1248.   DOI
8 Yoo, H. Y., K.-D. Lee, S.-I. Na, C.-W. Park, and N.-W. Park, 2017. Field crop classification using multi-temporal high-resolution satellite imagery: A case study on garlic/onion field, Korean Journal of Remote Sensing, 33(5-2): 621-630 (in Korean with English abstract).   DOI
9 Zhong, L., L. Hu, and H. Zhou, 2019. Deep learning based multi-temporal crop classification, Remote Sensing of Environment, 221: 430-443.   DOI
10 Ban, H.-Y., K. S. Kim, N.-W. Park, and B.-W. Lee, 2017. Using MODIS data to predict regional corn yields, Remote Sensing, 9(1): 16.   DOI
11 Chollet, F., 2015. Keras, https://github.com/fchollet/keras, Accessed on Jul. 13, 2020.
12 Guidici, D. and M. L. Clark, 2017. One-dimensional convolutional neural network land-cover classification of multi-seasonal hyperspectral imagery in the San Francisco Bay area, California, Remote Sensing, 9(6): 629.   DOI
13 Lee, J., B. Seo, and S. Kang, 2017. Development of a biophysical rice yield model using allweather climate data, Korean Journal of Remote Sensing, 33(5-2): 721-732 (in Korean with English abstract).   DOI
14 Hochreiter, S. and J. Schmidhuber, 1997. Long shortterm memory, Neural Computation, 9(8): 1735-1780.   DOI
15 Ienco, D., R. Gaetano, C. Dupaquier, and P. Maurel, 2017. Land cover classification via multitemporal spatial data by deep recurrent neural networks, IEEE Geoscience and Remote Sensing Letters, 14(10): 1685-1689.   DOI
16 Kim, Y., N.-W. Park, and K.-D. Lee, 2017. Selflearning based land-cover classification using sequential class patterns from past land-cover maps, Remote Sensing, 9(9): 921.   DOI
17 Kwak, G.-H. and N.-W. Park, 2019. Impact of texture information on crop classification with machine learning and UAV images, Applied Sciences, 9(4): 643.   DOI
18 Kwak, G.-H., M.-G. Park, C.-W. Park, K.-D. Lee, S.-I. Na, H.-Y. Ahn, and N.-W. Park, 2019. Combining 2D CNN and bidirectional LSTM to consider spatio-temporal features in crop classification, Korean Journal of Remote Sensing, 35(5): 681-692 (in Korean with English abstract).   DOI
19 Liu, G. and J. Guo, 2019. Bidirectional LSTM with attention mechanism and convolutional layer for text classification, Neurocomputing, 337: 325-338.   DOI
20 Mou, L., P. Ghamisi, and X. X. Zhu, 2017. Deep recurrent neural networks for hyperspectral image classification, IEEE Transactions on Geoscience and Remote Sensing, 55(7): 3639-3655.   DOI
21 Na, S.-I., C.-W. Park, K.-H. So, J.-M. Park, and K.-D. Lee, 2017. Satellite imagery based winter crop classification mapping using hierarchical Classification, Korean Journal of Remote Sensing, 33(5): 677-687 (in Korean with English abstract).   DOI