The Journal of Korean Institute of Next Generation Computing (한국차세대컴퓨팅학회논문지)

Korean Institute of Next Generation Computing (한국차세대컴퓨팅학회)
권호 표지

Design and Implementation of a Similarity based Plant Disease Image Retrieval using Combined Descriptors and Inverse Proportion of Image Volumes

Descriptor 조합 및 동일 병명 이미지 수량 역비율 가중치를 적용한 유사도 기반 작물 질병 검색 기술 설계 및 구현

  • 임혜진 (세종대학교 컴퓨터공학과) ;
  • 정다운 (세종대학교 컴퓨터공학과) ;
  • 유성준 (세종대학교 컴퓨터공학과) ;
  • 구영현 (세종대학교 컴퓨터공학과) ;
  • 박종한 (농촌진흥청 국립원예특작과학원 원예특작과학과)
  • Received : 2018.10.12
  • Accepted : 2018.12.13
  • Published : 2018.12.31

⟨ Previous Next ⟩

Abstract

Many studies have been carried out to retrieve images using colors, shapes, and textures which are characteristic of images. In addition, there is also progress in research related to the disease images of the crop. In this paper, to be a help to identify the disease occurred in crops grown in the agricultural field, we propose a similarity-based crop disease search system using the diseases image of horticulture crops. The proposed system improves the similarity retrieval performance compared to existing ones through the combination descriptor without using a single descriptor and applied the weight based calculation method to provide users with highly readable similarity search results. In this paper, a total of 13 Descriptors were used in combination. We used to retrieval of disease of six crops using a combination Descriptor, and a combination Descriptor with the highest average accuracy for each crop was selected as a combination Descriptor for the crop. The retrieved result were expressed as a percentage using the calculation method based on the ratio of disease names, and calculation method based on the weight. The calculation method based on the ratio of disease name has a problem in that number of images used in the query image and similarity search was output in a first order. To solve this problem, we used a calculation method based on weight. We applied the test image of each disease name to each of the two calculation methods to measure the classification performance of the retrieval results. We compared averages of retrieval performance for two calculation method for each crop. In cases of red pepper and apple, the performance of the calculation method based on the ratio of disease names was about 11.89% on average higher than that of the calculation method based on weight, respectively. In cases of chrysanthemum, strawberry, pear, and grape, the performance of the calculation method based on the weight was about 20.34% on average higher than that of the calculation method based on the ratio of disease names, respectively. In addition, the system proposed in this paper, UI/UX was configured conveniently via the feedback of actual users. Each system screen has a title and a description of the screen at the top, and was configured to display a user to conveniently view the information on the disease. The information of the disease searched based on the calculation method proposed above displays images and disease names of similar diseases. The system's environment is implemented for use with a web browser based on a pc environment and a web browser based on a mobile device environment.

영상의 특징인 색상, 모양, 질감 등을 이용해 영상을 검색하는 연구들은 많이 진행되어 왔다. 또한 작물의 질병 영상과 관련된 연구들도 진행되고 있다. 농업 현장에서 재배되는 작물에 발생한 질병을 확인하는데 도움이 되기 위해 본 논문에서는 시설원예 작물의 질병 영상을 이용한 유사도 기반 작물 질병 검색 시스템을 제안한다. 제안하는 시스템은 단일 Descriptor를 사용하지 않고, 조합 Descriptor를 통해 기존 대비 영상의 유사도 검색 성능을 높였고 유사도 검색 결과를 가독성 높게 사용자에게 제공하기 위해 가중치 기반 산출방법을 적용했다. 본 논문에서는 총 13개의 개별 Descriptor를 이용해 조합을 진행했다. 조합 Descriptor를 이용해 6개 작물의 질병에 대해 유사도 검색을 진행했고 작물별로 평균 accuracy가 높은 조합 Descriptor를 선정해 유사도 검색에 사용했다. 검색된 결과는 병명의 비율을 기반으로 한 산출방법과 가중치를 기반으로 한 산출방법을 사용해 백분율로 나타냈다. 병명의 비율을 기반으로 한 산출방법은 질의 영상과 유사도 검색에 사용되는 영상의 수가 많은 병명이 1순위로 출력되는 문제점이 있다. 이를 해결하기 위해 가중치를 기반으로 한 산출방법을 사용했다. 작물의 병명별 테스트 영상을 두 가지 산출방법에 적용해 검색 성능을 측정했다. 작물의 질병별로 두 가지 산출방법에 대해 검색 성능 값의 평균을 비교한 결과 고추, 사과 작물에서는 병명의 비율을 기반으로 한 산출방법의 성능이 가중치를 기반으로 한 산출방법의 성능보다 평균 약 11.89%의 높은 성능 결과를 보였다. 국화, 딸기, 배, 포도 작물에서는 가중치를 기반으로 한 산출방법이 병명의 비율을 기반으로 한 산출방법의 성능보다 평균 약 20.34%의 높은 성능 결과를 보였다. 또한 본 논문에서 제안하는 시스템의 UI/UX는 실제 사용자의 피드백을 통해 편리하게 구성했다. 시스템의 화면마다 상단에 제목과 설명을 출력했고 사용자가 질병의 정보를 보기 편리하게 화면을 구성했다. 검색된 질병의 정보는 위에서 제안한 산출방법을 토대로 유사한 질병의 영상과 병명을 출력한다. 시스템의 환경은 PC 환경 기반의 웹 브라우저와 모바일 디바이스 환경 기반의 웹 브라우저를 통해 사용할 수 있도록 구현했다.

Keywords

Acknowledgement

Supported by : 농림수산식품 기술기획평가원

References

  1. https://en.wikipedia.org/wiki/Content-based_image_retrieval
  2. W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, and G. Taubin, "The QBIC Project: Querying Images By Content Using Color, Texture, and Shape", SPIE Conference on Storage and Retrieval for Image and Video Databases, Vol. 1908, pp. 173-187, 1993.
  3. M. J. Swain, D. H. Ballard, "Color Indexing", International Journal of Computer Vision, Vol. 7, No. 1, pp. 11-32, 1991. https://doi.org/10.1007/BF00130487
  4. S. Agarwal, A. K. Verma, and N. Dixit, "Content Based Image Retrieval using Color Edge Detection and Discrete Wavelet Transform", International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 368-372, 2014.
  5. J. S. Mary, Mrs. S. C. Magneta, "Content Based Image Retrieval using Color, MultiDimensional Texture and Edge Orientation", International Journal of Science Technology & Engineering, Vol. 2, pp. 110-115, 2016.
  6. B. S. Manjunath, W. Y. Ma, "Texture Features for Browsing and Retrieval of Image Data", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 837-842, 1996. https://doi.org/10.1109/34.531803
  7. M. B. Rao, B. P. Rao, and A. Govardhan, "Content Based Image Retrieval using Dominant Color, Texture, and Shape", International Journal of Engineering Science and Technology (IJEST), Vol. 3, No. 4, pp. 2887-2896, 2011.
  8. X. Y. Wang, Y. J. Yu, and H. Y. Yang, "An effective image retrieval sheme using color, texture, and shape features", Computer Standards & Interfaces, Vol. 33, pp. 59-68, 2011. https://doi.org/10.1016/j.csi.2010.03.004
  9. S. Yun, W. Xiangfeng, Z. Shanwen, and Z. Chuanlei, "PNN based crop disease recognition with leaf image features and meteorological data", International Journal of Agricultural and Biological Engineering, Vol. 8, pp. 60-68, 2015. https://doi.org/10.15740/HAS/IJAE/8.1/60-65
  10. K. S. Kailey, G. S. Sahdra, "Content-Based Image Retrieval (CBIR) For Identifying Image Based Plant Disease", Int. J. Computer Technology & Applications, Vol. 3, pp. 1099-1104, 2012.
  11. K. J. Mohan, M. Balasubramanian, and S. Palanivel, "Detection and Recognition of Disease from Paddy Plant Leaf Images", International Journal of Computer Applications, Vol. 5, pp. 34-41, 2016.
  12. D. N. D. Harini, D. L. Bhaskari, "Identification of Leaf Diseases in Tomato Plant Based on Wavelets and PCA", IEEE Word Congress on Information an Communication Technologies, pp. 1398-1403, 2011.
  13. A. S. Deokar, A. Pophale, S. Patil, P. Nazarkar, and S. Mungase, "Plant Disease Identification using Content Based Image Retrieval Techniques Based on Android System", International Advanced Research Journal in Science, Engineering and Technology. Vol. 3, pp. 44-46, 2016.
  14. J. K. Patil, R. Kumar, "Feature Extraction & Retrieval of Plant Leaf Disease using Image Histogram", International Science Press, India, Vol. 5, No. 2, pp. 143-151, 2013.
  15. J. H. Kang, S. H. Jung, S. S. Nor, W. H. So, and C. B. Sim, "Design and Implementation of Produce Farming Field-Oriented Smart Pest Information Retrieval System based on Mobile for u-Farm", The Journal of the Korea institute of electronic communication sciences, Vol. 5, pp. 1145-1156, 2015.
  16. Z. Piao, H. G. Ahn, S. J. Yoo, Y. H. Gu, H. Yin, D. W. Jeong, Z. Jiang, and W. H. Chung, "Performance analysis of combined descriptors for similar crop disease image retrieval", Cluster Computing, Vol. 20, pp. 3565-3577, 2017. https://doi.org/10.1007/s10586-017-1145-4
  17. M. Lux, S. A. Chatzichristofis, "LIRe: Lucene Image Retrieval - An Extensible Java CBIR Library", Proceedings of the 16th ACM International Conference on Multimedia, pp. 1085-1088, 2008.
  18. J. Huang, S. Kuamr, M. Mitra, W.-J. Zhu, and R. Zabih, "Image Indexing Using Color Correlograms", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 762-765, 1997.
  19. S. A. Chatzichristofis, Y. S. Boutalis, "CEDD: Color and Edge Directivity Descriptor - A Compact Descriptor for Image Indexing and Retrieval", In Proc. of the 6th International Conference on Computer Vision Systems, pp. 312-322, 2008.
  20. B. S. Manjunath, J. R. Ohm, V. V. Vasudevan, and A. Yamada, "Color and Texture Descriptors", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 11, No. 6, pp. 703-715, 2011.
  21. C. S. Won, D. K Park, and S. J. Park, "Efficient Use of MPEG-7 Edge Histogram Descriptor", ETRI Journal, Vol. 24, No. 1, pp. 23-30, 2002. https://doi.org/10.4218/etrij.02.0102.0103
  22. S. A. Chatzichristofis, Y. S. Boutalis, "FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval", in Proceedings of the 9th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), pp. 191-196, 2008.
  23. D. Zhang, A. Wong, M. Indrawan, and G. Lu, "Content-based Image Retrieval Using Gabor Texture Features", Proc. of First IEEE Pacific-Rim Conference on Multimedia (PCM), pp. 392-395, 2000.
  24. K. Zagoris, S. A. Chatzichristofis, N. Papamarkos, and Y. S. Boutalis, "Automatic Image Annotation and Retrieval Using the Joint Composite Descriptor", Panhellenic Conference on Informatics, pp. 143-147, 2010.
  25. G. Pass, R. Zabih, "Comparing Images Using Joint Histograms", Multimedia Systems, pp. 234-240, 1999.
  26. E. Kasutani, A. Yamada, "The MPEG-7 Color Layout Descriptor: A Compact Image Feature Description for High-Speed Image/Video Segment Retrieval", Proc. of International Conference on Image Processing (ICIP), Vol. 1, pp. 674-677, 2001.
  27. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluating Color Descriptors for Object and Scene Recognition", IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 32, No. 9, pp. 1582-1596, 2010. https://doi.org/10.1109/TPAMI.2009.154
  28. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel", In Proceedings of the International Conference on Image and Video Retrieval, pp. 401-408, 2007.
  29. J. R. Ohm, L. Cieplinski, H. J. Kim, S. Krishnamacha, B. S. Manunath, D. S. Messing, and A. Yamada, "The MPEG-7 Color Descriptors", IEEE Transactions on Circuits and Systems for Video Technology, 2001.
  30. A. K. Jain, A. Vailaya, "Image Retrieval using Color and Shape", Pattern Recognition, Vol. 29, No. 8, pp. 1233-1244, 1996. https://doi.org/10.1016/0031-3203(95)00160-3
  31. https://en.wikipedia.org/wiki/Accuracy_and_precision
  32. R. Kaur, S. Din, and PPS. Pannu, "Expert System to Detect and Diagnose the Leaf Diseases of Cereals", Int J of Current Engineering and Technology, Vol. 3, No. 4, pp. 1480-1483, 2013.
  33. https://en.wikipedia.org/wiki/Normalization_(statistics)
  34. S. Das, D. Rudrapal, and R. Sarkar, "An Efficient Method for Content Based Image Retrieval Using Color Moment and Texture Descriptors", International Conference on Computing, Communication and Information Technology (ICCCIT 2012), pp. 123-127, 2012.
  35. R. Usha, K. Perumal, "Content Based Image Retrieval using Combined Features of Color and Texture Features with SVM Classification", International Journal of Computer Science & Communication Networks, Vol. 4, pp. 169-174, 2014.
  36. M. D. Chaudhary, P. V. Pithadia, "Multifeature histogram intersection for Efficient Content Based Image Retrieval", International Conference on Circuits, Power and Computing Technologies (ICCPCT 2014), pp. 1366-1371, 2014.
  37. Y. J. Lee, D. W. Jeong, S. J. Yoo, Y. H. Gu, Z. Piao, H. Yi, J. H. Park, "An Integrated Image Retrieval and Recognition System for Detecting Diseases and Insect Pests", The Journal Of Korean Institute Of Next Generation Computing, Vol. 13, No. 4, pp. 100-111, 2017.
  38. H. C. Park, S. W. Lee, "CNN-facilitated Color and Character Recognition in Practical Applications", The Journal Of Korean Institute Of Next Generation Computing, Vol. 12, No. 6, pp. 104-115, 2016.
  39. M. E. M. Cayamcela, W. Lim. "Application of Image Classification using Machine Learning Technique on Smart Device", The Journal Of Korean Institute Of Next Generation Computing, Vol. 14, No. 1, pp. 16-26, 2018.