Browse > Article
http://dx.doi.org/10.5392/JKCA.2022.22.02.010

Development of a Web-based Presentation Attitude Correction Program Centered on Analyzing Facial Features of Videos through Coordinate Calculation  

Kwon, Kihyeon (제주대학교 컴퓨터교육과)
An, Suho (제주대학교 컴퓨터교육과)
Park, Chan Jung (제주대학교 컴퓨터교육과)
Publication Information
The Journal of the Korea Contents Association / v.22, no.2, 2022 , pp. 10-21 More about this Journal
Abstract
In order to improve formal presentation attitudes such as presentation of job interviews and presentation of project results at the company, there are few automated methods other than observation by colleagues or professors. In previous studies, it was reported that the speaker's stable speech and gaze processing affect the delivery power in the presentation. Also, there are studies that show that proper feedback on one's presentation has the effect of increasing the presenter's ability to present. In this paper, considering the positive aspects of correction, we developed a program that intelligently corrects the wrong presentation habits and attitudes of college students through facial analysis of videos and analyzed the proposed program's performance. The proposed program was developed through web-based verification of the use of redundant words and facial recognition and textualization of the presentation contents. To this end, an artificial intelligence model for classification was developed, and after extracting the video object, facial feature points were recognized based on the coordinates. Then, using 4000 facial data, the performance of the algorithm in this paper was compared and analyzed with the case of facial recognition using a Teachable Machine. Use the program to help presenters by correcting their presentation attitude.
Keywords
Presentation Attitude; Face Recognition; Video Analysis; Audio Analysis; Feature Extraction;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 신경식, 유신우, 오혁준, "MFCC와 CNN을 이용한 저고도 초소형 무인기 탐지 및 분류에 대한 연구," 한국정보통신학회 논문지, 제24권, 제3호, pp.364-370, 2020.
2 김상훈, 정선태, 정수환, 오두식, 김재민, 조성원, "다중 스케일 가버 특징 벡터 모델 기반 눈좌표 검출," 한국콘텐츠학회논문지, 제7권, 제1호, pp.48-57, 2007.   DOI
3 A. L. A. Ramos and B. G. Dadiz, "A Facial Expression Emotion Detection using Gabor Filter and Principal Component Analysis to Identify Teaching Pedagogy," 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), pp.1-6, 2018, doi: 10.1109/HNICEM.2018.8666274.   DOI
4 이형일, 김진명, 이재원, "딥러닝 객체인식을 통한 경로보정 자율 주행 로봇의 구현," 한국콘텐츠학회논문지, 제19권, 제12호, pp.164-172, 2019.   DOI
5 박현정, 송민채, 신경식, "CNN을 적용한 한국어 상품평 감성분석: 형태소 임베딩을 중심으로," 지능정보연구, 제24권, 제2호, pp.59-83, 2018.   DOI
6 이도연, 장병희, "딥러닝을 이용한 음악흥행 예측모델 개발 연구," 한국콘텐츠학회논문지, 제20권, 제8호, pp.10-18, 2020.   DOI
7 http://wiki.hash.kr/index.php/합성곱_신경망
8 모경현, 박재선, 장명준, 강필성, "단어와 자소 기반 합성곱 신경망을 이용한 문서 분류," 대한산업공학회지, 제44권, 제3호, pp.180-188, 2018.   DOI
9 https://librosa.org/doc/latest/index.html
10 N. Dave, "Feature Extraction Methods LPC PLP and MFCC in Speech Recognition," Proceeding of the International Journal for Advance Research in Engineering and Technology, Vol.1, pp.1-5, 2013.
11 https://teachablemachine.withgoogle.com/
12 https://play.google.com/store/apps/details?id=com.enhanceu.selfview&hl=ko&gl=US
13 도원영, "말하기에서의 동작언어에 대한 고찰," 한국어학, 제39권, pp.191-221, 2008.
14 변정민, "청중을 고려한 발표자의 언어적.비언어적 표현 연구," 새국어교육, 제81권, pp.133-158, 2009.
15 김예지, 대학생 발표 불안 연구, 전남대학교 교육대학원, 석사학위논문, 2012.
16 송재민, 이새봄, 박아름, "이미지 인식 기술의 산업 적용 동향 연구," 한국콘텐츠학회논문지, 제20권, 제 7호, pp.86-96, 2020. https://doi.org/10.5392/JKCA.2020.20.07.086   DOI
17 조병모, 김기한, 이필규, "필터 및 특징 선택 기반의 적응형 얼굴 인식 방법," 한국콘텐츠학회논문지, 제9권, 제6호, pp.1-8, 2009.   DOI
18 김성영, "가버 필터에 기반한 관심 객체 검출," 한국컴퓨터정보학회논문지, 제13권, 제2호, pp.87-94, 2008.
19 이우리, 황민철, "한국인 표준 얼굴 표정 이미지의 감성 인식 정확률," 한국콘텐츠학회논문지, 제14권, 제9호, pp.467-483, 2014. https://doi.org/10.5392/JKCA.2014.14.09.476   DOI
20 https://docs.opencv.org/4.x/d2/d99/tutorial_js_face_detection.html
21 T. Ahonen, A. Hadid, and M. Pietikainen, "Face Description with Local Binary Patterns: Application to Face Recognition," Proceedings of the 2006 IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, Vol.28, No.12, pp.2037-2041, 2006.
22 S. Liao, X. Zhu, Z. Lei, L. Zhang, and S. Z. Li, "Learning Multi-scale Block Local Binary Patterns for Face Recognition," International Conference on Biometrics. Springer, Berlin, Heidelberg, 2007.
23 P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001. Vol.1, pp.I-I. 2001.
24 https://www.moe.go.kr/boardCnts/viewRenew.do?boardID=294&boardSeq=89671&lev=0&searchType=null&statusYN=W&page=1&s=moe&m=020402&opType=N
25 윤여경, "효과적인 의사소통을 위한 스피치 교육 앱 디자인 연구," 상품문화디자인학연구, 제66권, pp.43-52, 2020. https://doi.org/10.18555/kicpd2020.60.05   DOI
26 이종익, 발표능력 향상 프로그램이 여중생의 발표불안 감소 및 자기효능감 향상에 영향을 미치는 효과, 강원대학교 교육대학원, 석사학위논문, 2009.
27 송인섭, "학습자 중심의 21세기 패러다임: 방법과 전망," 교육심리연구, 제22권, 제4호, pp.881-896, 2008.
28 N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). Vol.1, IEEE, 2005.
29 J. Chen, Z. Chen, Z. Chi, and H. Fu, "Facial Expression Recognition Based on Facial Components Detection and HOG Features," Proceedings for the 2014 Scientific Cooperations International Workshops on Electrical and Computer Engineering Subfields, pp.884-888, 2014.
30 유원필, 실외환경에 강인한 도로기반 저가형 자율주행기술개발, 한국전자통신연구원, 2015.
31 https://generated.photos/
32 https://tech.kakaoenterprise.com/66