Journal of Korean Society of Industrial and Systems Engineering (산업경영시스템학회지)

Society of Korea Industrial and System Engineering (한국산업경영시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A Multi-Layer Perceptron for Color Index based Vegetation Segmentation

색상지수 기반의 식물분할을 위한 다층퍼셉트론 신경망

  • Lee, Moon-Kyu (Department of Industrial Engineering, Keimyung University)
  • Received : 2019.12.27
  • Accepted : 2020.02.27
  • Published : 2020.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Vegetation segmentation in a field color image is a process of distinguishing vegetation objects of interests like crops and weeds from a background of soil and/or other residues. The performance of the process is crucial in automatic precision agriculture which includes weed control and crop status monitoring. To facilitate the segmentation, color indices have predominantly been used to transform the color image into its gray-scale image. A thresholding technique like the Otsu method is then applied to distinguish vegetation parts from the background. An obvious demerit of the thresholding based segmentation will be that classification of each pixel into vegetation or background is carried out solely by using the color feature of the pixel itself without taking into account color features of its neighboring pixels. This paper presents a new pixel-based segmentation method which employs a multi-layer perceptron neural network to classify the gray-scale image into vegetation and nonvegetation pixels. The input data of the neural network for each pixel are 2-dimensional gray-level values surrounding the pixel. To generate a gray-scale image from a raw RGB color image, a well-known color index called Excess Green minus Excess Red Index was used. Experimental results using 80 field images of 4 vegetation species demonstrate the superiority of the neural network to existing threshold-based segmentation methods in terms of accuracy, precision, recall, and harmonic mean.

Keywords

References

  1. Ali, A.M., Darvishzadeh, R., and Skidmore, A.K., Specific Leaf Area Estimation from Leaf and Canopy Reflectance Through Optimization and Validation of Vegetation Indices, Agricultural and Forest Meteorology, 2017, Vol. 235, pp. 162-174.
  2. Barbosa, B.D.S., Ferraz, G.A.S., Goncalves, L.M., Marin, D.B., Maciel, D.T., Ferraz, P.F.P., and Rossi, G., RGB vegetation indices applied to grass monitoring : a qualitative analysis, Agronomy Research, 2019, Vol. 17, No. 2, pp. 349-357.
  3. Burgos-Artizzu, X.P., Ribeiro, A., Guijarro, M., and Pajares, G., Real-time Image Processing for Crop/weed Discrimination in Maize Fields, Comput. Electron. Agric., 2011, Vol. 75, No. 2, pp. 337-346. https://doi.org/10.1016/j.compag.2010.12.011
  4. Elfaki, M.S., Zhang, N., and Peterson, D.E., Weed Detection using Color Machine Vision, Trans. ASAE, 2000, Vol. 43, No. 6, pp. 1969-1978. https://doi.org/10.13031/2013.3103
  5. Golzarian, M.R. and Frick, R.A., Classification of Images of Wheat, Ryegrass and Brome Grass Species at Early Growth Stages using Principal Component Analysis, Plant Methods, 2011, Vol. 7, pp. 28-38. https://doi.org/10.1186/1746-4811-7-28
  6. Golzarian M.R., Lee, M.-K. and Desbiolles, J.M.A., Evaluation of Colour Indices for Improved Segmentation of Plant Images, Transactions of ASAE, 2012, Vol. 55, No. 1, pp. 261-273. https://doi.org/10.13031/2013.41236
  7. Guijarro, M., Pajares, G., Riomoros, I., Herrera, P.J., Burgos-Artizzu, X.P., and Ribeiro, A., Automatic Segmentation of Relevant Textures in Agricultural Images, Computers and Electronics in Agriculture, 2011, Vol. 75, No. 1, pp. 75-83. https://doi.org/10.1016/j.compag.2010.09.013
  8. Hamuda, E., Glavin, M., and Jones, E., A Survey of Image Processing Techniques for Plant Extraction and Segmentation in the Field, Computers and Electronics in Agriculture, 2016, Vol. 125, pp. 184-199. https://doi.org/10.1016/j.compag.2016.04.024
  9. Hertz, J., Krogh, A., and Palmer, R.G., Introduction to the theory of neural computation, Addison Wesley, Redwood City, USA, 1991.
  10. Kazmi, W., Garcia-Ruizb, F., Nielsenb, J., Rasmussen, J., and Andersen, H., Detecting Creeping Thistle in Sugar Beet Fields using Vegetation Indices, Computers and Electronics in Agriculture, 2015, Vol. 112, pp. 10-19. https://doi.org/10.1016/j.compag.2015.01.008
  11. Lee, W.S., Slaughter, D.C., and Giles. D.K., Robotic Weed Control System for Tomatoes, Precision Agriculture, 1999, Vol. 1, pp. 95-113. https://doi.org/10.1023/A:1009977903204
  12. Ma, J., Du, K., Zhang, L., Zheng, F., Chu, J., and Sun, Z., A Segmentation Method for Greenhouse Vegetable Foliar Disease Spots Images using Color Information and Region Growing, Computers and Electronics in Agriculture, 2017, Vol. 142, No. 110-117. https://doi.org/10.1016/j.compag.2017.08.023
  13. Meng, Q., Ruicheng, Q., He, J., Zhang, M., Ma, X., and Liu. G., Development of Agricultural Implement System based on Machine Vision, Computers and Electronics in Agriculture, 2015, Vol. 112, pp. 128-138. https://doi.org/10.1016/j.compag.2014.11.006
  14. Meyer, G.E. and Neto, J.C., Verification of Color Vegetation Indices for Automated Crop Imaging Applications, Computers and Electronics in Agriculture, 2008, Vol. 63, pp. 282-293. https://doi.org/10.1016/j.compag.2008.03.009
  15. Otsu, N., A Threshold Selection Method from Gray-Level Histogram, IEEE Trans. Syst. Man Cybern., 1979, Vol. 9, pp. 62-66. https://doi.org/10.1109/TSMC.1979.4310076
  16. Powers, D.M.W., Evaluation : From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation, Journal of Machine Learning Technologies, 2011, Vol. 2, No. 1, pp. 37-63.
  17. Sahoo, R.K., Soltani, S., Wong, K.C., and Chen, Y.C., A Survey of Thresholding Techniques, Computer Vision, Graphics, and Image Processing, 1988, Vol. 41, No. 2, pp. 233-260. https://doi.org/10.1016/0734-189X(88)90022-9
  18. Sazbi, S., Abbaspour-Gilandeh, Y., and Garcia-Mateos, G., A Fast and Accurate Expert System for Weed Identification in Potato Crops using Metaheuristic Algorithms, Computers in Industry, 2018, Vol. 98, pp. 80-89. https://doi.org/10.1016/j.compind.2018.03.001
  19. Suh, H.K., Hofstee, J.W., and van Henten, E.J., Improved Vegetation Segmentation with Ground Shadow Removal Using an HDR Camera, Precision Agriculture, 2018, Vol. 19, pp. 218-237. https://doi.org/10.1007/s11119-017-9511-z
  20. Wobbecke, D., Meyer, K., and Mortensen, D., Color Indices for Weed Identification under Various Soil, Residue and Lighting Conditions, Trans. ASAE, 1995, Vol. 38, pp. 259-269. https://doi.org/10.13031/2013.27838
  21. Zhang, X., Li, X., Zhang, B., Zhou, J., Tian, G., Xiong, Y., and Gu, B., Automated Robust Crop-Row Detection in Maize Fields based on Position Clustering Algorithm and Shortest Path Method, Computers and Electronics in Agriculture, 2018, Vol. 154, pp. 165-175. https://doi.org/10.1016/j.compag.2018.09.014
  22. Zheng, H., Cheng, T., Li, D., Zhou, X., Yao, X., Tian, Y., Cao, W., and Zhu, Y., Evaluation of RGB, Color- Infrared and Multispectral Images Acquired from Unmanned Aerial Systems for the Estimation of Nitrogen Accumulation in Rice, Remote Sensing, 2018, Vol. 10, No. 6, pp. 824-840. https://doi.org/10.3390/rs10060824