Browse > Article
http://dx.doi.org/10.5392/JKCA.2021.21.08.001

Research on Deep Learning Performance Improvement for Similar Image Classification  

Lim, Dong-Jin (NHN 다이퀘스트 AI R&D그룹)
Kim, Taehong (한국한의학연구원 미래의학부)
Publication Information
Abstract
Deep learning in computer vision has made accelerated improvement over a short period but large-scale learning data and computing power are still essential that required time-consuming trial and error tasks are involved to derive an optimal network model. In this study, we propose a similar image classification performance improvement method based on CR (Confusion Rate) that considers only the characteristics of the data itself regardless of network optimization or data reinforcement. The proposed method is a technique that improves the performance of the deep learning model by calculating the CRs for images in a dataset with similar characteristics and reflecting it in the weight of the Loss Function. Also, the CR-based recognition method is advantageous for image identification with high similarity because it enables image recognition in consideration of similarity between classes. As a result of applying the proposed method to the Resnet18 model, it showed a performance improvement of 0.22% in HanDB and 3.38% in Animal-10N. The proposed method is expected to be the basis for artificial intelligence research using noisy labeled data accompanying large-scale learning data.
Keywords
Classification; Deep Learning; Similar Image; CNN; Confusion Rate;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Mikolajczyk, Agnieszka, and Michal Grochowski, "Data augmentation for improving deep learning in image classification problem," 2018 international interdisciplinary PhD workshop (IIPhDW), IEEE, pp.117-122, 2018.
2 J. G. Ian, P. Jean, M. Mehdi, X. Bing, W. David, O. Sherjil, C. Aaron, and B. Yoshua, Generative adversarial networks. 2014.
3 M. Frid-Adar, E. Klang, M. Amitai, J. Goldberger, and H. Greenspan, "Synthetic data augmentation using GAN for improved liver lesion classification," 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018), IEEE, pp.289-293, 2018.
4 임동진, AI 성능 향상을 위한 상호 혼동 쌍 선정 및 딥 러닝 모델 연구, 과학기술연합대학원대학교, 석사 학위논문, 2020.
5 Moravec, Hans, "When will computer hardware match the human brain," Journal of evolution and technology Vol.1, pp.10-22, 1998.
6 https://github.com/callee2006/HangulDB
7 https://dm.kaist.ac.kr/datasets/animal-10n
8 Simonyan, Karen, and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint arXiv:1409.1556, 2014.
9 김정연, 다중 열 딥러닝 구조와 자기 구성 지도를 이용한 한글 필기체 인식 연구, 숭실대학교, 석사학위논문, 2018.
10 A. Dubey, O. Gupta, P. Guo, R. Raskar, R. Farrell, and N. Naik, Training with confusion for fine-grained visual classification, CoRR, 2017.
11 K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," Proceedings of the IEEE conference on computer vision and pattern recognition, pp.770-778, 2016.
12 Johnson, M. Justin, and M. Taghi, "Survey on deep learning with class imbalance," Journal of Big Data, Vol6, No.1, pp.1-54, 2019.   DOI
13 T. Xiao, T. Xia, Y. Yang, C. Huang, and X. Wang, "Learning from massive noisy labeled data for image classification," Proceedings of the IEEE conference on computer vision and pattern recognition, pp.2691-2699, 2015.
14 D. Arpit, S. Jastrzebski, N. Ballas, D. Krueger, E. Bengio, and M. S. Kanwal, "A closer look at memorization in deep networks," International Conference on Machine Learning, PMLR, pp.233-242, 2017.
15 C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals, "Understanding deep learning requires rethinking generalization," Communications of the ACM, Vol.64, No.3, pp.107-115, 2021.
16 H. J. Song, M. S. Kim, and J. G. Lee, "Selfie: Refurbishing unclean samples for robust deep learning," International Conference on Machine Learning, pp.5096-5915, 2019.
17 S. Chopra, R. Hadsell, and Y. LeCun, "Learning a similarity metric discriminatively, with application to face verification," CVPR, pp.539-546, 2005.
18 Buda, Mateusz, Atsuto Maki, and A Mazurowski, "A systematic study of the class imbalance problem in convolutional neural networks," Neural Networks, Vol.106, pp.249-259, 2018.   DOI