International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Proposal for AI Video Interview Using Image Data Analysis

  • Received : 2022.04.25
  • Accepted : 2022.05.03
  • Published : 2022.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, the necessity of AI video interview arises when conducting an interview for acquisition of excellent talent in a non-face-to-face situation due to similar situations such as Covid-19. As a matter to be supplemented in general AI interviews, it is difficult to evaluate the reliability and qualitative factors. In addition, the AI interview is conducted not in a two-way Q&A, rather in a one-sided Q&A process. This paper intends to fuse the advantages of existing AI interviews and video interviews. When conducting an interview using AI image analysis technology, it supplements subjective information that evaluates interview management and provides quantitative analysis data and HR expert data. In this paper, image-based multi-modal AI image analysis technology, bioanalysis-based HR analysis technology, and web RTC-based P2P image communication technology are applied. The goal of applying this technology is to propose a method in which biological analysis results (gaze, posture, voice, gesture, landmark) and HR information (opinions or features based on user propensity) can be processed on a single screen to select the right person for the hire.

Keywords

Acknowledgement

This research was supported by Kyungdong University Research Fund, 2021.

References

  1. Jinhyung Cho, Hwansoo Kang, Woochang Yoo and Kyutae Park, "Prototype Design and Development of Online Recruitment System Based on Social Media and Video Interview Analysis," Journal of Digital Convergence, Vol. 19, No. 3, pp. 203-209, Dec 2019. DOI: https://doi.org/10.14400/JDC.2021.19.3.203
  2. Sun-Jeong Jeong and Hwi-Eun Nam, "Status and Implications of Private-led Human Resources Development Program in New Technology Field," Journal of the Korea Academia-Industrial cooperation Society, Vol. 23, No. 2, pp. 322-330, Feb 2022. DOI: https://doi.org/10.5762/KAIS.2022.23.2.322
  3. Sung Jin Baek, Rang Hyuck Lee and Chang Seok Yi, "Design and Development of A Systemic Structure to Ensure the Interoperability between the WebRTC-based Video Conferencing Systems and Heterogeneous Terminals," KIISE Transactions on Computing Practices, Vol. 23, No. 4, pp. 238-243, Apr 2017. DOI: https://doi.org/10.5626/KTCP.2017.23.4.238
  4. Yun-jung Choi, Yoojin Chung, Ho Young Yoon, Minjung Kim, Na Young Kim, Chen Lu, Juyeon Sin, Ju-hee Lee, Na-young Kim, Eun Yeo and Jewon Kang, "Analysis of the 19th Presidential TV Debate Using Deep Learning Based Video Processing Algorithms : Analysis of the frequency, facial expression and gaze," Korean Society For Journalism And Communication Studies, Vol. 23, No. 4, pp. 238-243, Oct 2017. DOI: https://doi.org/10.20879/kjjcs.2020.64.5.009
  5. Changki Jang and WookJoon Sung, "A Study on Policy Acceptance Intention to Use Artificial Intelligence-Based Public Services: Focusing on the Influence of Individual Perception & Digital Literacy Level," Informatization Policy, Vol. 29, No. 1, pp. 060-083, Oct 2022. DOI: https://doi.org/10.22693/NIAIP.2022.29.1.060
  6. Jungmin Kwon, Jieun Kwon and Youngsun Lee, "Possibility of using AI in the Admissions Officer System in Korea," The Journal of Korea Elementary Education, Vol. 31, Supplement, pp. 1-15, Jan 2021. DOI: http://doi.org/10.20972/kjee.31..202101.1
  7. Namin Shin and Sejin Chang, "A Study on High School Students' Perceptions of AI Interview for University Admission," Journal of the Korea Academia-Industrial cooperation Society, Vol. 22, No. 7, pp.242~251, Jul 2021. DOI: https://doi.org/10.5762/KAIS.2021.22.7.242
  8. Namin Shin and Sejin Chang, "A Study on High School Students' Perceptions of AI Interview for University Admission," Journal of the Korea Academia-Industrial cooperation Society, Vol. 22, No. 7, pp.242~251, Jul 2021. DOI: https://doi.org/10.5762/KAIS.2021.22.7.242
  9. Ki-chae Min and Kyu-sung Lee, "A Study on Non-Facing Services of National Pension in the era of the 4th industrial revolution," The Journal of the Convergence on Culture Technology, Vol. 4, No. 3, pp.139-147, Aug 2018. DOI: http://dx.doi.org/10.17703/JCCT.2018.4.3.139
  10. Hansol Cho, Minsung Choi, Younwook Choi and Beongku An, "Live Streaming Service using Webrtc," Proceedings of Symposium of the Korean Institute of communications and Information Sciences, pp.475-476, 2019.