DOI QR코드

DOI QR Code

Human Activity Classification Using Deep Transfer Learning

딥 전이 학습을 이용한 인간 행동 분류

  • Nindam, Somsawut (Division of Computer Science and Engineering, Jeonbuk National University) ;
  • Manmai, Thong-oon (Department of Mathematics Education, Sisaket Rajabhat University) ;
  • Sung, Thaileang (Division of Computer Science and Engineering, Jeonbuk National University) ;
  • Wu, Jiahua (Division of Computer Science and Engineering, Jeonbuk National University) ;
  • Lee, Hyo Jong (Division of Computer Science and Engineering, Jeonbuk National University)
  • Published : 2022.11.21

Abstract

This paper studies human activity image classification using deep transfer learning techniques focused on the inception convolutional neural networks (InceptionV3) model. For this, we used UFC-101 public datasets containing a group of students' behaviors in mathematics classrooms at a school in Thailand. The video dataset contains Play Sitar, Tai Chi, Walking with Dog, and Student Study (our dataset) classes. The experiment was conducted in three phases. First, it extracts an image frame from the video, and a tag is labeled on the frame. Second, it loads the dataset into the inception V3 with transfer learning for image classification of four classes. Lastly, we evaluate the model's accuracy using precision, recall, F1-Score, and confusion matrix. The outcomes of the classifications for the public and our dataset are 1) Play Sitar (precision = 1.0, recall = 1.0, F1 = 1.0), 2), Tai Chi (precision = 1.0, recall = 1.0, F1 = 1.0), 3) Walking with Dog (precision = 1.0, recall = 1.0, F1 = 1.0), and 4) Student Study (precision = 1.0, recall = 1.0, F1 = 1.0), respectively. The results show that the overall accuracy of the classification rate is 100% which states the model is more powerful for learning UCF-101 and our dataset with higher accuracy.

Keywords

Acknowledgement

This work was supported in part by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education under Grant 2019R1D1A3A03103736 and in part by project for Joint Demand Technology R&D of Regional SMEs funded by Korea Ministry of SMEs and Startups in 2021 (No. S3035805 ). The data collection of student behavior is funded by the TRSI and the Ministry of Higher Education, Science, Research and Innovation (MHESI) of Thailand (Project-ID: 63673).