Browse > Article
http://dx.doi.org/10.3745/KIPSTD.2007.14-D.3.381

Analysis of Music and Photo for User Creative Movie  

Chung, Myoung-Bum (숭실대학교 대학원 미디어학과)
Ko, Il-Ju (숭실대학교 미디어학부)
Publication Information
The KIPS Transactions:PartD / v.14D, no.4, 2007 , pp. 381-388 More about this Journal
Abstract
Consumers changed to the subject to produce a digital contents as data transmission technique is advanced and a digital machine is diffused variously. Users are interested greatly in a user creative movie (UCM) production among various online contents. The UCM production method which uses the music and picture is the method that users make the UCM more easily. However, the UCM production service has the problem that any association does not exist in the music and picture and that the picture changes according to fixed time interval without the relation at a music rhythm. To solve this problem, we propose the UCM production method which uses a music analysis and picture analysis in the paper. A music analysis finds a picture change time according to the rhythm and a picture analysis finds the association of the picture. A music analysis finds strong parts of the sound which uses Root-Mean-Square (RMS). And a picture analysis classifies the picture as a scenery picture and people picture which uses structure simplicity of the picture(SSP) and face region detection. A picture analysis got correct result of 86.4% in the experiment and we can finds the association at each picture and arranges the sequence which the picture appears. Therefore, if we use a music and picture analysis at the UCM production, users may make natural and efficient movie.
Keywords
Contents product method; Photo analysis; Music analysis; Digital Signal Processing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Mohan, C. Papageorgiou, T. Poggio, 'Example-based object detection in images by components,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No.4, pp 349-361, Apr. 2001   DOI   ScienceOn
2 S. Kiranyaz, A.F. Qureshi, M.Gabbouj, 'A fuzzy approach towards perceptual classification and segmentation of MP3/AAC audio,' International Symposium on Control, Communications and Signal Processing, pp.727-730, Hammamet, Tunisia, Mar. 2004   DOI
3 Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi, 'Dancing-to-Music Character Animation,' In Computer Graphics Forum, Vol.25, No.3, May. 2006
4 The Guardian, 'A Bigger bang,' The guardian Weekend, Nov. 2006
5 Wikipedia, 'User-generated content,' http://en.wikipedia.org/wiki/User-generated_content
6 김문형, 남제호, 홍진우, 'UCC의 동향 및 전망,; 정보통신연구진흥원, ITFIND 주간기술동향, 제1262호, 2006. 9
7 Enid Burns, 'Nealy 50MM Americans Create Web Content,' ClickZ Network, ClickZ News, May 30, 2006
8 EnVible(Learners Video Network), http://www.envible.com/
9 Haruto Takeda, Takuya Nishimoto, Shigeki Sagayama, 'Rhythm and Tempo Recognition of Music Performance from a probabilistic Approach,' ISMIR 2004, pp.357-364, Oct. 2004
10 N. Whiteley, A. T. Cemgil, and S. J. Godsill. 'Bayesian modelling of temporal structure in musical audio,' ISMIR 2006, pp.29-34, Victoria, 2006
11 Rainer Lienhart, Jochen Maydt, 'An Extended Set of Hear-like Features for Rapid Object Detection,' IEEE ICIP 2002, Vol.1, pp.900-903, Sep. 2002
12 Mohamed E. El-Hawary, 'Principles of Electric Machines with Power Electronic Applications,' 2nd Ed, 496page, Wiley-IEEE Press, Jun. 2002
13 J. Abel, D. Berners, 'On Peak-Detecting and RMS Feedback and Feedforward Compressors,' Audio Engineering Society, ISSU 5914, Britain, 2003
14 Karl-Heinz, Brandenburg, 'MP3 and MC Explained,' AES, 17th Interenational Conference, Florence, Italy, Aug. 1999
15 Jon C. Schmidt, Janet C. Rutledge, 'Multichannel Dynamic Range Compression For Music Signals,' Acoustics, Speech, and Signal Processing 1996, Vol.2, pp.1013-1016, Atlanta, May. 1996