Korea Science and Art Forum (한국과학예술포럼)

The Korean Society of Science & Art (한국과학예술융합학회)
권호 표지
DOI QR코드

DOI QR Code

Convergence Analysis Algorithm Study for Extracting Image Configuration Parameters

영상 구성 파라미터 추출을 위한 융합 분석 알고리듬 연구

  • 맹채정 (중앙대학교 창의ICT공과대학) ;
  • 하동환 (중앙대학교 소프트웨어대학)
  • Received : 2019.05.13
  • Published : 2019.06.30
⟨ Previous Next ⟩

Abstract

This study was conducted to organize a program to classify and analyze the characteristics of images for the automation of background music selection in the video content production process. The results and contents of the study are as follows: video characteristics are selected as subject category, emotion, pixel motion speed, color, and character material. Subject categories and feelings were extracted using Microsoft's Azure Video Indexer, Pixel Movement Speed was an Optional flow, Color was an Image Histogram for Image, and character materials was CNN(Convolutional Neural Network). The results of this study are significant in that video analysis was conducted to match background music in the recent content production process of 'Internet One-person Broadcasting Creators'.

본 연구는 영상콘텐츠 제작과정에서 배경음악 선정의 자동화를 위하여 영상의 특성을 분류, 분석할 수 있는 프로그램을 구성하였다. 연구 결과 및 내용은 다음과 같다. 영상의 특성은 '주제 범주', '감정', '픽셀 움직임 속도', '색상', '등장인물' 로 선정하며, '주제 범주'와 '감정'은 Microsoft사의 Azure Video Indexer를, '픽셀 움직임 속도'는 Optical flow, '색상'은 Image Histogram, '등장인물'은 CNN (Convolutional Neural Network)을 활용하여 데이터를 추출하였다. 이러한 본 연구의 결과는 최근 주목을 받고있는 '인터넷 1인 방송 크리에이터'들의 콘텐츠 제작과정에서 배경음악 매칭을 위한 영상 특성 분석이 이루어졌다는 점에서 의의가 있다.

Keywords

References

  1. Byeongcheol Kim, Changjin Kim, Seongcheol Yun, Kyungsook Han, "Implement Static Analysis Tool using JavaCC ," Journal of the Korea Society of Computer and Information 23(12), pp.89-94, 2018. https://doi.org/10.9708/JKSCI.2018.23.12.089
  2. Byoungjun Kim, Joonwhoan Lee, "A Deep-Learning Based Model for Emotional Evaluation of Video Clips," INTERNATIONAL JOURNAL of FUZZY LOGIC and INTELLIGENT SYSTEMS 18(4), pp.245-253, 2018. https://doi.org/10.5391/ijfis.2018.18.4.245
  3. Edman Paes dos Anjos, "Experimental Evaluation of Succinct Representations of JSON Documents," Seoul National University : Graduate School of Computer Science and Engineering, 2016.
  4. Gil Levi, Tal Hassner, "Age and Gender Classfication using Convolutional Nerual Networks," IEEE Workshop on Analysis and Modeling of Faces and Gestures (AMFG), at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.34-42, 2015.
  5. Hansung Lee, Younghee Im, Jaehak Yu, Seunggeun Oh, Daihee Park, "A News Video Mining based on Multi-modal Approach and Text Mining," Journal of KIISE : Database 37(3), pp.127-136, 2010.
  6. Ji-Hyun Cho, Ji-Won Yoon, "Design of Unstructured Big Data Matching System for Unidentified Aircraft Tracking Using Open CV," Journal of Digital Forensics 10(2), pp.1-20 2016. https://doi.org/10.22798/KDFS.2016.10.2.1
  7. Joohyung Kang, Sooyeong Kwak, "Violent Behavior Detection using Motion Analysis in Surveillance Video," Journal of broadcast engineering Volume.20 Number.3, pp.430-439, 2015. https://doi.org/10.5909/JBE.2015.20.3.430
  8. JooSung Kim, KyongYeon Kim, HakIl Kim, Yoo-Sung Kim, "A Video Annotation System with Automatic Human Detection from Video Surveillance Data," Journal of KIISE : Computing Practices and Letters 18(11), pp.808-812, 2012.
  9. JongHui Lee, O Hae Seog, "Design of Indexing Agent for Semantic-based Video Retrieval ," KIPS Transactions B Volume.10-B Number.6, pp.687-694, 2003.
  10. Jong-In Kim, "Automatic classification of classical music based on musical contents ," Seoul National University : Graduate School of Cognitive Science, Master's thesis, 2018.
  11. Min Young Jung, Sung Han Park, "Semantic-based Scene Retrieval Using Ontologies for Video Server", Journal of the Institute of Electronics and Information Engineers-CI 45(5), pp.32-37, 2008.
  12. Tae-Dong Lee, Min-Gu Kim, "Design and Implementation of Content-based Video Database using an Integrated Video Indexing Method," Journal of KIISE, Korean Institute of Information Scientists and Engineers 7(6), pp.661-683 2001.
  13. Zubair Khan, Jianjun Ni, Xinnan Fan, Pengfei Shi "AN IMPROVED K-MEANS CLUSTERING ALGORITHM BASED ONAN ADAPTIVE INITIAL PARAMETER ESTIMATION PROCEDUREFOR IMAGE SEGMENTATION," International Journal of Innovative Computing, Information and Control Volume 13 Number 5, pp.1509-1525, 2017.