Browse > Article
http://dx.doi.org/10.3837/tiis.2021.01.009

Empirical Analysis of a Fine-Tuned Deep Convolutional Model in Classifying and Detecting Malaria Parasites from Blood Smears  

Montalbo, Francis Jesmar P. (College of Informatics and Computing Sciences, Batangas State University)
Alon, Alvin S. (College of Engineering, Architecture and Fine Arts, Batangas State University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.15, no.1, 2021 , pp. 147-165 More about this Journal
Abstract
In this work, we empirically evaluated the efficiency of the recent EfficientNetB0 model to identify and diagnose malaria parasite infections in blood smears. The dataset used was collected and classified by relevant experts from the Lister Hill National Centre for Biomedical Communications (LHNCBC). We prepared our samples with minimal image transformations as opposed to others, as we focused more on the feature extraction capability of the EfficientNetB0 baseline model. We applied transfer learning to increase the initial feature sets and reduced the training time to train our model. We then fine-tuned it to work with our proposed layers and re-trained the entire model to learn from our prepared dataset. The highest overall accuracy attained from our evaluated results was 94.70% from fifty epochs and followed by 94.68% within just ten. Additional visualization and analysis using the Gradient-weighted Class Activation Mapping (Grad-CAM) algorithm visualized how effectively our fine-tuned EfficientNetB0 detected infections better than other recent state-of-the-art DCNN models. This study, therefore, concludes that when fine-tuned, the recent EfficientNetB0 will generate highly accurate deep learning solutions for the identification of malaria parasites in blood smears without the need for stringent pre-processing, optimization, or data augmentation of images.
Keywords
Malaria; Convolutional Neural Networks; Deep Learning; Fine-Tuning; Transfer Learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, "Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization," in Proc. of 2017 IEEE International Conference on Computer Vision(ICCV), pp. 618-626, 2017.
2 B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, "Learning Deep Features for Discriminative Localization," in Proc. of 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 2921-2929, 2016.
3 J. Ferrando, J. L. Domingues, J. Torres, R. Garcia, D. Garcia, D. Garrido, and J. Cortada, "Improving Accuracy and Speeding Up Document Image Classification Through Parallel Systems," in Proc. of International Conference on Computational Science, pp. 387-400, 2020.
4 A. Kumar, J. Kim, D. Lyndon, M. Fulham, and D. Feng, "An ensemble of fine-tuned convolutional neural networks for medical image classification," IEEE Journal of Biomedical and Health Informatics, vol. 21, no. 1, pp. 31-40, Jan. 2016.   DOI
5 World Health Organization, "The World malaria report 2019' at a glance," 2019.
6 K. J. Arrow, C. Panosian, and H. Gelband, "Saving Lives, Buying Time: Economics of Malaria Drugs in an Age of Resistance," The National Academies Press, 2004.
7 A. Martin-Diaz, J. M. Rubio, J. M. Herrero-Martinez, M. Lizasoain, J. M. Ruiz-Giardin, J. Jaqueti, J. Cuadros, G. Rojo-Marcos, P. Martin-Rabadán, M. Calderón, C. Campelo, M. Velasco, and A. Perez-Ayala, "Study of the diagnostic accuracy of microbiological techniques in the diagnosis of malaria in the immigrant population in Madrid," Malaria Journal, vol. 17, 2018.
8 J. Osei-Yeboah, G. K. Norgbe, S. Y. Lokpo, M. K. Kinansua, L. Nettey, and E. A. Allotey, "Comparative Performance Evaluation of Routine Malaria Diagnosis at Ho Municipal Hospital," Journal of Parasitology Research, vol. 2016, pp. 1-7, 2016.
9 S. H. Kassani and P. H. Kassani, "A comparative study of deep learning architectures on melanoma detection," Tissue and Cell, vol. 58, pp. 76-83, 2019.   DOI
10 T. Tan, Z. Li, H. Liu, F. G Zanjani, Q. Quyang, Y. Tang, Z. Hu, and Q. Lu, "Optimize transfer learning for lung diseases in bronchoscopy using a new concept: Sequential fine-tuning," IEEE Jouranl of Translational Engineering in Health and Medicine, vol. 6, pp. 1-8, 2018.
11 H. Brody, "Medical imaging," Nature, vol. 502, 2013.
12 Q. Liu, N. Zhang, W. Yang, S. Wang, Z. Cui, X. Chen, and L. Chen, "A Review of Image Recognition with Deep Convolutional Neural Network," in Proc. of International Conference on Intelligent Computing, pp. 69-80, 2017.
13 K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," in Proc. of 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 770-778, 2016.
14 A. Khan, A. Sohail, U. Zahoora, and A. S. Qureshi, "A survey of the recent architectures of deep convolutional neural networks," arXiv:1901.06032, 2019.
15 J. Schmidhuber, "Deep learning in neural networks: An overview," Neural Networks, vol. 61, pp. 85-117, 2015.   DOI
16 Z. Liang, A. Powell, I. Ersoy, M. Poostchi, K. Silamut, K. Palaniappan, P. Guo, M. A. Hossain, A. Sameer, R. J. Maude, J. X. Huang, S. Jaeger, and G. Thoma, "CNN-based image analysis for malaria diagnosis," in Proc. of 2016 IEEE International Conference on Bioinformatics and Biomedicine(BIBM), pp. 493-496, 2016.
17 O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, "Imagenet large scale visual recognition challenge," International Journal of Computer Vision, vol. 115. pp. 211-252, 2015.   DOI
18 G. Liang and L. Zheng, "A transfer learning method with deep residual network for pediatric pneumonia diagnosis," Computer Methods and Programs in Biomedicine, vol. 187, 2019.
19 S. S. Devi, S. A. Sheikh, A. Talukdar, and R. H. Laskar, "Malaria infected erythrocyte classification based on the histogram features using microscopic images of thin blood smear," Indian Journal of Science and Technology, vol. 9, no. 45, pp. 1-10, 2016.
20 K. M. F. Fuhad, J. F. Tuba, M. R. A. Sarker, S. Momen, N. Mohammed, and T. Rahman, "Deep Learning Based Automatic Malaria Parasite Detection from Blood Smear and Its Smartphone Based Application," Diagnostics, vol. 10, no. 5, p. 329, 2020.   DOI
21 G. Marques, D. Agarwal and I. de la Torre Diez, "Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network", Applied Soft Computing, vol. 96, p. 106691, 2020.   DOI
22 C. Zhang, P. Patras, and H. Haddadi, "Deep Learning in Mobile and Wireless Networking: A Survey," IEEE Communications Surveys & Tutorials, vol. 21, no. 3, pp. 2224-2287, 2019.   DOI
23 M. Tan and Q. Le, "EfficientNet: Rethinking model scaling for convolutional neural networks," in Proc. of International Conference on Machine Learning, 2019, pp. 6105-6114.
24 S. Rajaraman, S. Jaeger, and S. K. Antani, "Performance evaluation of deep neural ensembles toward malaria parasite detection in thin-blood smear images," PeerJ, 2019.
25 Q. Wei and R. L. Dunbrack, "The role of balanced training and testing data sets for binary classifiers in bioinformatics," PLoS ONE, vol. 8, no. 7, p. 67863, 2013.
26 A. Torralba, and A. Efros. "Unbiased look at dataset bias," in Proc. of Conference on Computer Vision and Pattern Recognition, pp. 1521-1528, 2011.
27 A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet classification with deep convolutional neural networks," Communications of the ACM, vol. 60, no. 6, pp. 89-40, 2017.   DOI
28 L. Lu, Y. Zheng, G. Carneiro, and L. Yang, "Deep Learning and Convolutional Neural Networks for Medical Image Computing. Cham," Switzerland: Springer, 2017.
29 Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, pp. 436-444, May 2015.   DOI
30 Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," in Proc. of IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.   DOI
31 K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition,", arXiv:1409.1556, 2015.
32 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, and V. Vanhoucke, "Going deeper with convolutions," in Proc. of 2015 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 1-9, 2015.
33 S. Rajaraman, S. K. Antani, M. Poostchi, K. Silamut, M. A. Hossain, R. J. Maude, S. Jaeger, and G. R. Thoma, "Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images," PeerJ, vol. 6, Apr. 2018.
34 D. Bibin, M. S. Nair, and P. Punitha, "Malaria parasite detection from peripheral blood smear images using deep belief networks," IEEE Access, vol. 5, pp. 9099-9108, 2017.   DOI
35 G. P. Gopakumar, M. Swetha, G. S. Siva, and G. R. K. Sai Subrahmanyam, "Convolutional neural network-based malaria diagnosis from focus stack of blood smear images acquired using custombuilt slide scanner," Journal of Biophotonics, vol. 11, no. 3, Mar. 2018.
36 Y. G. Gezahegn, Y. H. G. Medhin, E. A. Etsub, and G. N. G. Tekele, "Malaria Detection and Classification Using Machine Learning Algorithms," in Proc. of International Conference on Information and Communication Technology for Development for Africa, pp. 24-33, 2018.
37 J. A. Nichols, H. W. Herbert Chan, and M. A. B. Baker, "Machine learning: Applications of artificial intelligence to imaging and diagnosis," Biophysical Reviews, vol. 11, no. 1, pp. 111-118, Feb. 2019.   DOI
38 A. Vijayalasshmi and K. Rajesh, "Deep learning approach to detect malaria from microscopic images," Multimedia Tools and Applications, vol. 79, pp. 15297-15317, 2019.   DOI
39 P. A. Pattanaik, M. Mittal, and M. Z. Khan, "Unsupervised Deep Learning CAD Scheme for the Detection of Malaria in Blood Smear Microscopic Images," IEEE Access, vol. 8, pp. 94936-94946, 2020.   DOI
40 P. Pattanaik, M. Mittal, M. Khan, and S. Panda, "Malaria detection using deep residual networks with mobile microscopy," Journal of King Saud University - Computer and Information Sciences, 2020.
41 ReLu, Deep AI, 2019. [Online]. Available: https://deepai.org/machine-learning-glossary-andterms/relu
42 F. Chollet, Keras, 2015. [Online]. Available: https://github.com/keras-team/keras
43 M. Lin, Q. Chen, and S. Yan, "Network in network," arXiv:1312.4400, 2013.
44 N. Islam, U. Saeed, R. Naz, J. Tanveer, K. Kumar, and A. A. Shaikh, "DeepDR: An image guideddiabetic retinopathy detection technique using attention-based deep learning scheme," in Proc. of 2019 2nd International Conference on new Trends in Computing Sciences(ICTCS), pp. 1-6, 2019.
45 H. C. Shin, M. Orton, D. J. Collins, and M. Leach, "Oragn detection using deep learing," Academic Press, pp. 123-153, 2016.
46 M. A. E. Muhammed, A. A. Ahmed, and T. A. Khalid, "Benchmark analysis of popular imagenet classification deep cnn architectures," in Proc. of 2017 International Conference on Smart Technologies for Smart Nations, pp. 902-907, 2017.
47 N. Tajbakhsh, J. Y. Shin, S. R. Gurudu, R. T. Hurst, C. B. Kendall, M. B. Gotway, J. Liang, "Convolutional neural networks for medical image analysis: Full training or fine tuning?" IEEE Transactions on Medical Imaging, vol. 35, no. 5, pp. 1299-1312, May 2016.   DOI
48 E. M. Dogo, O. J. Afolabi, N. I. Nwulu, B. Twala, and C. O. Aigbavboa, "A Comparative Analysis of Gradient Descent-Based Optimization Algorithms on Convolutional Neural Networks," in Proc. of 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems(CTEMS), pp. 92-99, 2018.
49 S. Sun, Z. Cao, H. Zhu, and J. Zhao, "A Survey of Optimization Methods From a Machine Learning Perspective," IEEE Transactions on Cybernetics, vol. 50, no. 8, pp. 3668-3681, 2020.   DOI
50 Loss Functions, Loss Functions: ML Glossary documentation, 2017.
51 D. P. Kingma and J. L. Ba, "Adam: A method for stochastic optimization," in Proc. of International Conference for Learning Representations, 2015.
52 I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning," in Proc. of the 30th International Conferecne on Macnine Learning, vol. 28, no. 3, pp. 1139-1147, 2013.
53 T. Tieleman and G. Hinton, "Lecture 6a. Overview of mini-batch gradient descent," Neural Networks for Machine Learning, 2012.
54 P. Lakhani, D. L. Gray, C. R. Pett, P. Nagy, and G. Shih, "Hello world deep learning in medical imaging," Journal of Digital Imaging, vol. 31, pp. 283-289, 2018.   DOI
55 F. J. P. Montalbo and A. A. Hernandez, "An Optimized Classification Model for Coffea Liberica Disease using Deep Convolutional Neural Networks," in Proc. of 2020 16th IEEE International Colloquium on Signal Processing & Its Applications(CSPA), pp. 213-218, 2020.
56 M. Hossin and M. N. Sulaiman, "A review on evaluation metrics for data classification evaluations," International Journal of Data Mining & Knowledge Management Process, vol. 5, no. 2, p. 1, 2015.