Browse > Article
http://dx.doi.org/10.5909/JBE.2022.27.4.499

Video Content Editing System for Senior Video Creator based on Video Analysis Techniques  

Jang, Dalwon (Information & Media Research Center, KETI)
Lee, Jaewon (Information & Media Research Center, KETI)
Lee, JongSeol (Information & Media Research Center, KETI)
Publication Information
Journal of Broadcast Engineering / v.27, no.4, 2022 , pp. 499-510 More about this Journal
Abstract
This paper introduces a video editing system for senior creator who is not familiar to video editing. Based on video analysis techniques, it provide various information and delete unwanted shot. The system detects shot boundaries based on RNN(Recurrent Neural Network), and it determines the deletion of video shots. The shots can be deleted using shot-level significance, which is computed by detecting focused area. It is possible to delete unfocused shots or motion-blurred shots using the significance. The system detects object and face, and extract the information of emotion, age, and gender from face image. Users can create video contents using the information. Decorating tools are also prepared, and in the tools, the preferred design, which is determined from user history, places in the front of the design element list. With the video editing system, senior creators can make their own video contents easily and quickly.
Keywords
Video editing; Video creator; Video shot detection; Video analysis;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," Proceedings of the IEEE International conference on computer vision and pattern recognition(CVPR), Las Vegas, NV, USA, pp. 779-788, 2016. doi: https://doi.org/10.48550/arXiv.1506.02640   DOI
2 P. Viola and M. J. Jones, "Robust real-time face detection," International Journal of Computer Vision. Vol. 57, pp. 137-154, 2004 doi: https://doi.org/10.1023/B:VISI.0000013087.49260.fb   DOI
3 X. Yi and M. Eramian, "LBP-based segmentation of defocus blur," IEEE Trans. Image Process, Vol. 25, no. 4, pp. 1626-1638, Apr. 2016. doi: https://doi.org/10.1109/TIP.2016.2528042   DOI
4 C. Tang, X. Zhu, X. Liu, L. Wang, and A. Zomaya, "DeFusionNET: Defocus blur detection via recurrently fusing and refining multi-scale deep features," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition(CVPR), Long Beach, CA, USA, pp. 2700-2709, 2019. doi: https://doi.org/10.1109/CVPR.2019.00281   DOI
5 J. Lee, "A Study on Types of Short-form Video Contents," Humanities Contents, Vol. 58, pp.121-139, 2020. doi: https://doi.org/10.18658/humancon.2020.09.121   DOI
6 J. Shi, L. Xu, and J. Jia, "Discriminative blur detection features," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition(CVPR), Columbus, OH, USA, pp. 2965-2972, 2014. doi: https://doi.org/10.1109/CVPR.2014.379   DOI
7 Y. Gao, Y. Lai and Y.Liu, "Fast Video Shot Boundary Detection Based on Visual Perception", Proceeding of IEEE International Conference on Consumer Electronics(ICCE), Las Vegas, NV, USA, pp.1-4, 2019. doi: https://doi.org/10.1109/ICCE.2019.8662083   DOI
8 M. Gygli, "Ridiculously fast shot boundary detection with fully convolutional neural networks," Proceeding of International Conference on Content-Based Multimedia Indexing(CBMI), La Rochelle, France, Sep. 2018, pp. 1-4. doi: https://doi.org/10.1109/CBMI.2018.8516556   DOI
9 M. Brindha and R. Amsaveni, "Shot change detection on news videos using color histogram and edge based approaches," Proceeding of IEEE International Conference on Advances in Computer Applications(ICACA), Coimbatore, India, pp.50-54, 2016. doi: https://doi.org/10.1109/ICACA.2016.7887922   DOI
10 G. Kwon and J. Kwon, "A Study on the Usability of Video Authoring Tool Application for Active Senior," Journal of Next-generation Convergence Information Services Technology, 9, no.4 (2020) : 351-361. doi: http://doi.org/10.29056/jncist.2020.12.03   DOI
11 J.-H. Kwon, "A Study on the Planning of a Space for Senior Citizens Using Digital Contents," Journal of Digital Convergence, Vol. 18, No. 5, pp. 257-267, 2020. doi: https://doi.org/10.14400/JDC.2020.18.5.257   DOI
12 S.-D. Park, "Education of media by production of image contents - Focusing on Non-Linear Editing," Journal of the Korea Institute of Information and Communication Engineering, Vol. 23, No. 9, 1096~1103. doi: https://doi.org/10.6109/jkiice.2019.23.9.1096   DOI
13 W. Zhao, F. Zhao, D. Wang, and H. Lu., "Defocus blur detection via multi-stream bottom-top-bottom fully convolutional network," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition(CVPR), Salt Lake City, UT, USA, pp 3080- 3088, 2018. doi: https://doi.org/10.1109/CVPR.2018.00325   DOI