Browse > Article
http://dx.doi.org/10.9717/kmms.2018.21.8.829

The Implementing a Color, Edge, Optical Flow based on Mixed Algorithm for Shot Boundary Improvement  

Park, Seo Rin (Dept. of IT Media Engineering, Duksung Women's University)
Lim, Yang Mi (Dept. of IT Media Engineering, Duksung Women's University)
Publication Information
Abstract
This study attempts to detect a shot boundary in films(or dramas) based on the length of a sequence. As films or dramas use scene change effects a lot, the issues regarding the effects are more diverse than those used in surveillance cameras, sports videos, medical care and security. Visual techniques used in films are focused on the human sense of aesthetic therefore, it is difficult to solve the errors in shot boundary detection with the method employed in surveillance cameras. In order to define the errors arisen from the scene change effects between the images and resolve those issues, the mixed algorithm based upon color histogram, edge histogram, and optical flow was implemented. The shot boundary data from this study will be used when analysing the configuration of meaningful shots in sequences in the future.
Keywords
Shot Boundary Detection; Scene Change Effect; Color Histogram; Optical Flow; Meaningful Shot;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S.Y. Kim, A Study on Scene Change Detection Using Frame Similarity in Video, Master's Thesis of Yonsei University, 2003.
2 S.Y. Shin, "New Shot Boundary Detection Using Local $X^2$-Histogram and Normalization," Journal of the Korea Society of Computer and Information, Vol. 12, No. 2, pp. 103-109, 2007.
3 S.H. Yoen and J.M. Kim, "Robust Illumination Change Detection Using Image Intensity and Texture," Journal of Korea Multimedia Society, Vol. 16, No. 2, pp. 169-179, 2013.   DOI
4 H.J. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic Partitioning of Full-motion Video," Journal of Multimedia Systems, Vol. 1, No. 1, pp. 10-28, 1993.   DOI
5 J.H. Song, R. Sakong, and J.H. Nang, "A Video Shot Boundary Detection Method Based on Video Partition and Convolutional Neural Network," Proceeding of Korea Information Science Society, pp. 865-867. 2017.
6 J.S. Lee, M.H. Tak, S.K. Kim, B.J. Uoo and Y.H. Joo, "Identification and Tracking of Moving Objects Using Optical Flow Algorithm And Histogram," Journal of The Korean Institute of Electrical Engineers, Vol. 7. pp. 1436-1437, 2014.
7 The GitHub, https://github.com/uoip/KCFpy. (accessed Aug., 30 2018)
8 J.E. Eom, S.R. Park, and Y.M. Lim, "The System Design and Implementation for Detecting the Types of Shot Size," Proceeding of International Conference of the Korea Multimedia Society, Vol. 21, No. 1, pp. 968-969, 2018.
9 H.W. Yoo, D.S. Jang, and Y.K. Na, "Video Shot Boundary Detection Using Correlation of Luminance and Edge Information," Journal of Institute of Control, Robotics and Systems, Vol. 7, No. 4, pp. 304-308, 2001.
10 A.M. Alattar, "Detecting and Compressing Dissolve Regions in Video Sequences with DVI Multimedia Image Compression Algorithm," Proceeding of International Symposium on Circuits and Systems, pp. 13-16, 1993.
11 Y.M. Lim, "The Climax Expression Analysis Based on the Shot-List Data of Movies," Journal of Broadcast Engineering, Vol. 21, No. 6, pp. 965-976, 2016.   DOI
12 M.O. Huy, K.M. Kim and B.T. Jang, "Deep Learning based Video Story Learning Technology," Journal of Korea Multimedia Society, Vol. 20, No. 3, pp. 23-40, 2016.
13 G. Pal, D. Rudrapaul, S. Acharjee, R. Ray, S. Chakraborty, and N. Dey, "Video Shot Boundary Detection: A Review," Emerging ICT for Bridging the Future-Proceedings of the 49th Annual Convention of the Computer Society of India CSI, Vol. 2, pp. 119-127, 2015.
14 A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II , pp. 113-127, 1991.
15 S.Y. Shin and P.S. Bae, "Video Browsing Using An Efficient Scene Change Detection in Telematics," Journal of Korea Society of Computer Information, Vol. 11, No. 4, pp. 147-154, 2006.