The Journal of The Korea Institute of Intelligent Transport Systems (한국ITS학회 논문지)

The Korea Institute of Intelligent Transport Systems (한국ITS학회)
권호 표지

Automatic Music-Story Video Generation Using Music Files and Photos in Automobile Multimedia System

자동차 멀티미디어 시스템에서의 사진과 음악을 이용한 음악스토리 비디오 자동생성 기술

  • 김형국 (광운대학교 전자융합공학과)
  • Received : 2010.07.19
  • Accepted : 2010.09.08
  • Published : 2010.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents automated music story video generation technique as one of entertainment features that is equipped in multimedia system of the vehicle. The automated music story video generation is a system that automatically creates stories to accompany musics with photos stored in user's mobile phone by connecting user's mobile phone with multimedia systems in vehicles. Users watch the generated music story video at the same time. while they hear the music according to mood. The performance of the automated music story video generation is measured by accuracies of music classification, photo classification, and text-keyword extraction, and results of user's MOS-test.

본 논문에서는 차량 내의 멀티미디어 시스템에 장착되는 엔터테인먼트 기능 중의 하나인 음악스토리 자동생성 기술을 소개한다. 음악스토리 비디오 자동생성 기술은 개인이 소지하고 있는 휴대폰을 차량 내의 멀티미디어 시스템과 연결하여, 휴대폰 안에 저장된 음악과 사진의 결합을 통해 음악비디오를 자동으로 생성하는 멀티미디어 요소기술로서, 사용자에게 분위기에 맞게 음악을 들으면서 생성된 음악스토리 비디오를 즐기는 기능을 제공한다. 음악스토리 비디오 자동생성 기술에 대한 성능은 음악분류, 사진분류, 핵심단어 검출 등의 정확도와 생성된 음악스토리 비디오를 시청한 사용자의 MOS 결과를 통해 측정되었다.

Keywords

References

  1. X. S. Hua, L. Lu and H. J. Zhang, "Photo2Video-A system for automatically converting photographic series into video," IEEE Tans, on Circuits and Systems for Video Technology, vol. 16, no. 7, pp. 803-819, July 2006. https://doi.org/10.1109/TCSVT.2006.877394
  2. X. S. Hua, L. Lu and H. J. Zhang, "Automatic music video generation based on temporal pattern analysis," Proc. 12th ACM Intl, Conference on Multimedia, October 2004.
  3. D. A. Shamma, B. Pardo and K. J. Hammond, "MusicStory: a personalized music video creator," Proc. 13th ACM Intl, Conference on Multimedia, October 2005.
  4. L. Lu, D. Liu and H. J. Zhang, "Automatic mood detection and tracking of music audio signals," IEEE Trans. on Audio, Speech and Language Processing, vol. 14, no. 1, pp. 5-18, January 2006. https://doi.org/10.1109/TSA.2005.860344
  5. J. C. Chen, W. T. Chu, J. H. Kuo, C. Y. Weng and J. L. Wu, "Tiling slideshow," Proc. 14th ACM Intl, Conference on Multimedia, October 2006.
  6. T. L. Wu and S. K. Jeng, "Probabilities estimation of a novel music emotion model," Proc. 14th Int,. Multimedia Modeling Conference, January 2008.
  7. S. Yang, Y. M. Ro, P. Viola and M. Jones, "Two-Layered photo classification based on semantic and syntactic features," Proc. First Intl, Workshop on Semantic-Enhanced Multimedia Presentation Systems, December 2006.
  8. T. S. Chua, L.-L. Tan and B. C. Ooi, "Fast signature-based color-spatial image retrieval," Proc. Intl, Conference Multimedia Computing System, pp. 362-369, June 1997.
  9. J. Platt, "AutoAlbum: clustering digital photographs using probabilistic model merging," Proc. IEEE Workshop Content-Based Accesses Image Video Libraries, pp. 96-100, June 2000.
  10. X. Zhu, Y. Y. Shi, H. G. Kim and K. W. Eom, "An integrated music recommendation system," IEEE Transactions on Consumer Electronics, vol. 52, Issue 3, pp. 917-925, August 2006. https://doi.org/10.1109/TCE.2006.1706489