Journal of Practical Engineering Education (실천공학교육논문지)

Korean Institute for Pratical Engineering Education (한국실천공학교육학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of a Learning Support System that Facilitates Teacher-Student Interaction Utilizing a Digital Human

디지털 휴먼을 활용하여 교수-학생 상호작용을 촉진시키는 학습지원 시스템 구현

  • Gyu-Sung Jung (School of Electrical, Electronics and Communication Engineering, Korea University of Technology and Education) ;
  • Chan-Hyeong Im (School of Electrical, Electronics and Communication Engineering, Korea University of Technology and Education) ;
  • Hae-Chan Lee (School of Electrical, Electronics and Communication Engineering, Korea University of Technology and Education) ;
  • Ra Yun Boo (School of Electrical, Electronics and Communication Engineering, Korea University of Technology and Education) ;
  • Soonuk Seol (School of Electrical, Electronics and Communication Engineering, Korea University of Technology and Education)
  • 정규성 (한국기술교육대학교 전기전자통신공학부) ;
  • 임찬형 (한국기술교육대학교 전기전자통신공학부) ;
  • 이해찬 (한국기술교육대학교 전기전자통신공학부) ;
  • 부라윤 (한국기술교육대학교 전기전자통신공학부) ;
  • 설순욱 (한국기술교육대학교 전기전자통신공학부)
  • Received : 2022.11.28
  • Accepted : 2022.12.31
  • Published : 2022.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

During the COVID-19 pandemic, the use of video classes and real-time online education has increased, but the lack of interaction between instructors and learners remains a challenging problem to be resolved. This paper designs and implements a learning support system that utilizes a digital human to improve faculty-student interaction, which plays an important role in increasing the educational effect and satisfaction of real-time online classes. In this paper, a digital human participates in a class as a virtual learner and asks questions raised by other learners through an anonymous chat system to the instructor on behalf of the learners. In addition, as a class facilitator, the digital human analyzes the lecturer's speech in real time and provides it to the learner in the form of a summary of the class, thereby facilitating faculty-student interaction. In order to confirm that the proposed system can be used in actual online real-time classes, we apply our system to Zoom classes. Experimental results show that facilitated Q&A and real-time class summaries are successfully provided through our digital human-based learning support system.

코로나19 팬데믹을 지나면서 동영상 수업과 실시간 온라인 교육은 활성화되었지만 교수자와 학습자 간의 상호작용 부족 문제는 여전히 해결해야 할 과제로 남아 있다. 본 논문은 실시간 온라인 수업의 교육 효과와 만족도를 높이는데 중요한 역할을 하는 상호작용의 문제를 개선하기 위해 디지털 휴먼을 활용하는 학습지원 시스템을 설계하고 구현한다. 본 논문에서 디지털 휴먼은 수업에 참여하는 가상의 학습자로서 다른 학습자들이 익명 채팅 시스템을 통해 등록한 질문을 교수자에게 대신 질문해 준다. 또한, 수업의 조력자로서 교수자가 강의하는 음성 메시지를 실시간으로 분석하여 학습자에게 수업의 요약본 형태로 제공함으로써 상호작용을 촉진한다. 제안한 시스템이 실제 온라인 실시간 수업에 활용 가능한지 검증하기 위해 Zoom 수업에 적용한다. 실험 결과 디지털 휴먼 기반의 학습지원시스템을 통하여 촉진된 질의응답과 실시간 수업 요약이 성공적으로 제공됨을 보인다.

Keywords

Acknowledgement

이 논문은 2022년도 한국기술교육대학교 교수 교육연구 진흥과제 지원에 의하여 연구되었음.

References

  1. N. Kim, "A study on the satisfaction of non-face-to-face online class -focused on K university," The Journal of Humanities and Social Science, vol. 11, no. 5, pp. 1145-1158, 2020.
  2. Y. J. Park, K. H. Lee, and H. S. Lee, "A comparative study on academic achievement and class satisfaction of college general mathematics according to face-to-face classes and remote classes," The Journal of the Korea Contents Association, vol. 22, no. 1, pp. 324-336, 2022. https://doi.org/10.5392/JKCA.2022.22.01.324
  3. S. I. Cho, "Comparison of academic achievement of classroom learning and on-line learning : a case study," The Journal of Business Education, vol. 34, no. 6, pp. 23-39, 2020. https://doi.org/10.34274/krabe.2020.34.1.002
  4. S. H. Kown and H. S. Ryu, "In COVID-19, a study on the effects of professor and learner interaction, self-directed learning, and learning participation on learning satisfaction in untact lecture," The Journal of Learner-Centered Curriculum and Instruction, vol. 21, no. 11, pp. 87-97, 2021.
  5. H. Min, K. Kim, and M. Nam, "A study on the best practices for online class in COVID-19 situation," The Journal of Humanities and Social Science, vol. 12, pp. 599-613, 2021.
  6. H. Min, "University teaching-learning direction to improve the quality of classes in the non-face-to-face era," Educational Development, Korean Educational Development Institute, vol. 47, no. 3, pp. 48-54, 2020.
  7. H. B. Jang, J. M. Kim, and K. T. Sohn, "A meta-analysis of the effects of adult learners' e-learning interactions on learning outcomes," The Journal of Learner-Centered Curriculum and Instruction, vol. 22, no. 3, pp. 705-720, 2022.
  8. S. Hong and Y. Ryu, "Factors affecting college students' learning outcomes in non face-to-face environment during Covid-19 pandemic," Journal of Educational Technology, vol. 36, no. 3, pp. 957-989, 2020. https://doi.org/10.17232/KSET.36.3.957
  9. C. I. Hwang and H. Y. Im, "An analysis study on students' questioning behaviors process and hinderance factors in university class," Asian Journal of Education, vol. 12, no. 3, pp. 55-74, 2011. https://doi.org/10.15753/AJE.2011.12.3.003
  10. Z. Chen and B. K. Kim, "Structural relationships of external questioning hesitating factors, positive support of professors and problem solving confidence in college classes: comparison between korea and china, comparison among different levels of learning engagement," The Journal of Educational Research, vol. 16, no. 4, pp. 27-55, 2018.
  11. J. U. Heo and S. A. Lee, "A chatbot using a Doc2Vec model for automatically answering of class questions," in Proceedings of the Korean Information Science Society Conference, Korean Institute of Information Scientists and Engineers, pp. 1660-1662, 2021.
  12. D. J. Na, J. W. Ahn, and S. J. Park, "Q&A and management AI chatbot service in the context of a university non-face-to-face remote lecture using the Seq2Seq model," in Proceedings of the Korean Society of Broadcast Engineers Conference, Korean Institute of Broadcast and Media Engineers, pp. 325-327, 2020.
  13. H. J. Kim, S. Yoo, and E. Y. Kim, "AI chatbot design and development model for classroom instruction: designing learning conversations," Brain, Digital, & Learning, vol. 10, no. 4, pp. 535-545, 2020. https://doi.org/10.31216/BDL.2020.10.3.535
  14. F. Yu, S. Jian, C. Shen, W. Xue, and Y. Fu, "On the issue of "Digital Human" in the context of digital transformation," in Proceedings of 2022 International Conference on Culture-Oriented Science and Technology, pp. 258-262, 2022.
  15. A. Ohno, T. Yamasaki, and K. I. Tokiwa, "A discussion on introducing half-anonymity and gamification to improve students' motivation and engagement in classroom lectures," in Proceedings of 2013 IEEE Region 10 Humanitarian Technology Conference, pp. 215-220, 2013.
  16. Maun.ai platform [Online]. Available: https://maum.ai/.
  17. Kakao i Cloud, "Speech to Text," [Online]. Available: https://www.kakaoicloud.com/service/detail/6-23.
  18. KoNLPy [Online]. Available: https://konlpy.org/en/latest/
  19. Open Broadcaster Software [Online]. Available: https://obsproject.com/.
  20. Virtual Audio Cable [Online]. Available: https://vac.muzychenko.net/en/.