Browse > Article
http://dx.doi.org/10.30693/SMJ.2022.11.4.30

Unsupervised Transfer Learning for Plant Anomaly Recognition  

Xu, Mingle (Department of Electronics Engineering, Jeonbuk National University)
Yoon, Sook (Department of Computer Engineering, Mokpo National University)
Lee, Jaesu (Rural Development Administration)
Park, Dong Sun (Department of Electronics Engineering, Jeonbuk National University)
Publication Information
Smart Media Journal / v.11, no.4, 2022 , pp. 30-37 More about this Journal
Abstract
Disease threatens plant growth and recognizing the type of disease is essential to making a remedy. In recent years, deep learning has witnessed a significant improvement for this task, however, a large volume of labeled images is one of the requirements to get decent performance. But annotated images are difficult and expensive to obtain in the agricultural field. Therefore, designing an efficient and effective strategy is one of the challenges in this area with few labeled data. Transfer learning, assuming taking knowledge from a source domain to a target domain, is borrowed to address this issue and observed comparable results. However, current transfer learning strategies can be regarded as a supervised method as it hypothesizes that there are many labeled images in a source domain. In contrast, unsupervised transfer learning, using only images in a source domain, gives more convenience as collecting images is much easier than annotating. In this paper, we leverage unsupervised transfer learning to perform plant disease recognition, by which we achieve a better performance than supervised transfer learning in many cases. Besides, a vision transformer with a bigger model capacity than convolution is utilized to have a better-pretrained feature space. With the vision transformer-based unsupervised transfer learning, we achieve better results than current works in two datasets. Especially, we obtain 97.3% accuracy with only 30 training images for each class in the Plant Village dataset. We hope that our work can encourage the community to pay attention to vision transformer-based unsupervised transfer learning in the agricultural field when with few labeled images.
Keywords
Plant Disease Recognition; Unsupervised Transfer Learning; Plant Village Dataset; Vision Transformer;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Mohanty, Sharada P., David P. Hughes, and Marcel Salathe, "Using deep learning for image-based plant disease detection," Frontiers in plant science, Sep. 2016.
2 Zhao, Xue, et al. "Identification method of vegetable diseases based on transfer learning and attention mechanism," Computers and Electronics in Agriculture, Vol. 193, Feb. 2022.
3 Deng, Jia, et al. "Imagenet: A large-scale hierarchical image database," 2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009.
4 He, Kaiming, et al. "Masked autoencoders are scalable vision learners," arXiv preprint arXiv:2111.06377, 2021.
5 Sethy, Prabira Kumar, et al. "Deep feature based rice leaf disease identification using support vector machine," Computers and Electronics in Agriculture, Vol. 175, Aug. 2020.
6 Dosovitskiy, Alexey, et al. "An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale," International Conference on Learning Representations, 2020.
7 Xu, Mingle, et al. "Style-Consistent Image Translation: A Novel Data Augmentation Paradigm to Improve Plant Disease Recognition," Frontiers in Plant Science , Vol. 12, Feb. 2022.
8 Fuentes, Alvaro, et al. "A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition," Sensors, Vol. 17, No. 9, Sep. 2017.
9 Liang, Xihuizi. "Few-shot cotton leaf spots disease classification based on metric learning," Plant Methods, Vol. 17, No. 1, Nov. 2021.
10 Nazki, Haseeb, Jaehwan Lee, Sook Yoon, and Dong Sun Park. "Image-to-image translation with GAN for synthetic data augmentation in plant disease datasets," Smart Media Journal, Vol. 8, no. 2, pp. 46-57, Jun. 2019.   DOI
11 Argueso, David, et al. "Few-Shot Learning approach for plant disease classification using images taken in the field," Computers and Electronics in Agriculture, Vol. 175, Aug. 2020.
12 Ha, Tae Min, Seongwon Cho, Ngo Luong Thanh Tra, Do Chi Thanh, and Keeseong Lee. "A Study on Sound Recognition System Based on 2-D Transformation and CNN Deep Learning," Smart Media Journal, Vol. 11, No. 1, pp. 31-37, Feb. 2022.
13 Pan, Sinno Jialin, and Qiang Yang, "A survey on transfer learning," IEEE Transactions on knowledge and data engineering, Vol. 22, No. 10 pp. 1345-1359, Oct. 2010   DOI
14 Li, Yang, and Xuewei Chao, "Semi-supervised few-shot learning approach for plant diseases recognition," Plant Methods, Vol. 17, No. 68, Jun. 2021.
15 Hughes, David, and Marcel Salathe, "An open access repository of images on plant health to enable the development of mobile disease diagnostics," arXiv preprint arXiv:1511.08060, 2015.
16 Liu, Ze, et al. "Swin transformer: Hierarchical vision transformer using shifted windows," Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
17 Moon, In Sik, Hyun Jin Kown, Mi Hyeon Kim, Se Myong Chang, In Ho Ra, and Heung Tae Kim. "Study on Three-Dimensional Analysis of Agricultural Plants and Drone-Spray Pesticide," Smart Media Journal, Vol. 9, No. 4, pp. 176-186, Dec. 2020.