Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.6.861

Automatic Video Editing Technology based on Matching System using Genre Characteristic Patterns  

Mun, Hyejun (Department of IT Media Engineering, Duksung Women's University)
Lim, Yangmi (Department of IT Media Engineering, Duksung Women's University)
Publication Information
Journal of Broadcast Engineering / v.25, no.6, 2020 , pp. 861-869 More about this Journal
Abstract
We introduce the application that automatically makes several images stored in user's device into one video by using the different climax patterns appearing for each film genre. For the classification of the genre characteristics of movies, a climax pattern model style was created by analyzing the genre of domestic movie drama, action, horror and foreign movie drama, action, and horror. The climax pattern was characterized by the change in shot size, the length of the shot, and the frequency of insert use in a specific scene part of the movie, and the result was visualized. The model visualized by genre developed as a template using Firebase DB. Images stored in the user's device were selected and matched with the climax pattern model developed as a template for each genre. Although it is a short video, it is a feature of the proposed application that it can create an emotional story video that reflects the characteristics of the genre. Recently, platform operators such as YouTube and Naver are upgrading applications that automatically generate video using a picture or video taken by the user directly with a smartphone. However, applications that have genre characteristics like movies or include video-generation technology to show stories are still insufficient. It is predicted that the proposed automatic video editing has the potential to develop into a video editing application capable of transmitting emotions.
Keywords
Movie analysis; Automatic video editing; Climax pattern; Emotional story video;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 J. Long, E. Shelhamer and T. Darrell, "Fully Convolutional Networks for Semantic Segmentation," 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3431-3440, June 2015, DOI: 10.1109/CVPR.2015.7298965   DOI
2 V. Gopalakrishnan, Y. Hu and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, Vol. 11, pp. 892-905, 2009, https://doi.org/10.1109/TMM.2009.2021726   DOI
3 N. Liu, J. Han, and M. H. Yang, "PiCANet: Learning pixel-wise contextual attention for saliency detection," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3089-3098, 2018, https://doi.org/10.1109/CVPR.2018.00326   DOI
4 K. Simonyan, A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," Published International Conference on Learning Representations, at ICLR 2015
5 Google Pixabay., https://pixabay.com/ko/
6 IBM Research, https://www-903.ibm.com/kr/research/?lnk=fdi
7 S.R. Park and Y.M. Lim, "The Implementing a Color, Edge, Optical Flow based on Mixed Algorithm for Shot Boundary Improvemen," Journal of Korea Multimedia Society, Vol. 21, No. 8, pp. 829-836, August 2018.   DOI
8 S.R. Park, J.E. Eum and Y.M. Lim, "A Study of Shot Boundary Detection for Film and TV Drama Images," Proceeding of the 14th International Conference on Multimedia Information Technology and Applications, Shanghai, China, pp. 111-113, 2018.
9 D.W. Kang and Y.M. Lim, "Generating Extreme Close-up Shot Dataset Based On ROI Detection for Classifying Shots Using Artificial Neural Network," Journal of the Korean Society Of Broad Engineers, Vol. 24, No. 6, November 2019, pp.983-991, https://doi.org/10.5909/JBE.2019.24.6.983   DOI
10 J.E. Eum, S.R. Park and Y.M. Lim, "The System Design and Implementation for Detecting the Types of Shot Siz," Proceeding of Multimedia Information Technology and Applications. Vol. 21, No. 1, pp. 968-969, spring 2018.
11 Facebook Inc., https://about.fb.com/ko/news/2018/07/watch-party/
12 J.E. Eum, S.R. Park and Y.M. Lim, "Design of Deep Learning for Movie Shot Size Recognition," Proceeding of Multimedia Information Technology and Applications. Vol. 20, No. 2, pp. 555-556, autumn 2017.
13 KCC, Research on the method of promoting the platform and application indust, Broadcasting communication policy research, 2011-2, 2011.
14 Google LLC., https://play.google.com/store/apps/details?id=com.darinsoft.vimo&hl=ko
15 BylineNetwork Inc., https://byline.network/2020/01/20-76/