한국방송∙미디어공학회:학술대회논문집 (Proceedings of the Korean Society of Broadcast Engineers Conference)
- 한국방송∙미디어공학회 2021년도 추계학술대회
- /
- Pages.91-94
- /
- 2021
지도 학습한 시계열적 특징 추출 모델과 LSTM을 활용한 딥페이크 판별 방법
Deepfake Detection using Supervised Temporal Feature Extraction model and LSTM
- Lee, Chunghwan (Department of Electronic Engineering, Hanyang University) ;
- Kim, Jaihoon (Department of Electronic Engineering, Hanyang University) ;
- Yoon, Kijung (Department of Electronic Engineering, Hanyang University)
- 발행 : 2021.11.26
초록
As deep learning technologies becoming developed, realistic fake videos synthesized by deep learning models called "Deepfake" videos became even more difficult to distinguish from original videos. As fake news or Deepfake blackmailing are causing confusion and serious problems, this paper suggests a novel model detecting Deepfake videos. We chose Residual Convolutional Neural Network (Resnet50) as an extraction model and Long Short-Term Memory (LSTM) which is a form of Recurrent Neural Network (RNN) as a classification model. We adopted cosine similarity with hinge loss to train our extraction model in embedding the features of Deepfake and original video. The result in this paper demonstrates that temporal features in the videos are essential for detecting Deepfake videos.
키워드