Intelligent Broadcasting System and Services for Personalized Semantic Contents Consumption

개인화된 의미 기반 콘텐츠 소비를 위한 지능형 방송 시스템과 서비스

  • Jin, Sung Ho (Dept. of Engineering, Information and Communications University) ;
  • Cho, Jun Ho (Dept. of Engineering, Information and Communications University) ;
  • Ro, Yong Man (Dept. of Engineering, Information and Communications University) ;
  • Kim, Jae-Gon (Broadcasting Media Group, Electonics and Telecommunications Research Institute)
  • 진성호 (한국정보통신대학교 공학부) ;
  • 조준호 (한국정보통신대학교 공학부) ;
  • 노용만 (한국정보통신대학교 공학부) ;
  • 김재곤 (한국전자통신연구원 방송 미디어 연구 그룹)
  • Published : 2005.09.01

Abstract

Compared with analog broadcasting, digital broadcasting supports technical background to provide personalize the TV watching environment by offering broadcasting services that can adapt to viewers' preferences. However, current digital broadcasting shows limited services such as reservation recording, simple program guiding with an electronic program guide (EPG) on a personal video recorder system, and primitive data broadcasting by broadcasters. Therefore, the purpose of this paper is to suggest a new broadcasting environment which gives a person facility and a difference fur watching TV by serving enhanced personalized services. For that reason, we propose an intelligent broadcasting system which can minimize viewer's actions, and enhanced broadcasting services which are based on understanding of the semantics of broadcasting contents. To implement the system, agent technology as well as the MPEG-7 and TV-Anytime Forum (TVAF) are employed. For content-level services, real-time content filtering and personalized video skimming are designed and implemented. To verify the usefulness of the proposed system, we demonstrate it with a test-bed on which content-level personalized services are implemented.

디지털 방송은 아날로그 방송에 비해 시청자의 선호에 기반한 방송 서비스를 제공함으로써, 시청자에게 개인화된 TV시청환경을 위한 기술적 배경을 제공할 수 있다. 하지만, 현재의 디지털 방송은 개개인에 따라 차별화 된 방송 서비스에 관련하여 전자 프로그램 가이드 (EPG) 나 초기 단계의 데이터 방송 정도의 한계를 보여주고 있다. 따라서, 본 논문에서는 진보된 개인화된 방송 서비스를 시청자에게 제공함으로써, 보다 시청자 개인에게 차별성과 편의성을 제공하는 방송 환경을 개발하고자 한다. 상기의 목적을 위하여, 시청자의 행위를 최소화할 수 있는 지능형 방송 시스템과 단순한 콘텐츠 부가정보가 아닌, 콘텐츠 레벨의 시멘틱(semantic) 정보에 기반한 방송 서비스들을 제안한다 지능적인 방송 시스템을 구현하기 위해, 지능형 에이전트 기술을 적용하고 콘텐츠의 시멘틱 정보의 생성을 위하여, MPEG-7 과 TV-Anytime Forum (TVAF)의 규격을 이용하였다. 콘텐츠 레벨의 방송 서비스들로써 사용자 단말에서 실시간 콘텐츠 필터링(filtering)과 개인화된 비디오 스키밍(skimming) 서비스들을 설계하였다. 본 논문에서는 제안된 시스템의 유용함을 증명하기 위하여 멀티 에이전트 플랫폼을 이용한 테스트 베드를 제작하고, 이를 기반으로 제안하는 방송 서비스들을 입증하였다.

Keywords

References

  1. Nevenka D., Herman E., Thomas M., Eugene L., Lalitha A., 'An Architecture for Video Content Filtering Consumer Domain, Coding and Computing,' Proc. of ITCC'00, pp.214, 2000
  2. Tivo, http://www.tivo.com
  3. J. Whitaker, Interactive Television Demystified, McGraw-Hill, New York, 2001
  4. H. Ghenniwa, M. N. Huhns and W. Shen, 'eMarketplaces for enterprise and cross enterprise integration,' Data & Knowledge Engineering, Vol. 52, No. 1, pp. 33-59, 2005 https://doi.org/10.1016/j.datak.2004.06.005
  5. Y. Shoham, 'What we talk about when we talk about software agents,' IEEE Intelligent Systems, vol.14, no.2, pp. 28-31, 1999 https://doi.org/10.1109/5254.757628
  6. FIPA, 'FIPA Audio/Visual Entertainment and Broadcasting Specification,' XC00081B, 2001
  7. S. Niiranen, A. Lugmayr, S. Kalli, 'Agent-based personalization in digital television,' Proc. of 5th Nordic Signal Processing Symposium, 2002
  8. FACTS, AC317 FACTS Workpackage A2 Public deliverable Phase 1 Deliverable Part 1- Project Overview, AC317/NN/WP2/ DS/P/011/b1, 1999
  9. M. Bais, J. Cosmas, C. Dosch, A. Engelsberg, A. Erk, P.S. Hansen, P. Healey, G.K. Klungsoeyr, R. Mies, J.-R. Ohm, Y. Paker, A. Pearmain, L. Pedersen, A. Sandvand, R. Schafer, P. Schoonjans, and P. Stammnitz, 'Customized television: standards compliant advanced digital television,' IEEE Trans. on Broadcasting, vol. 48, no.2, pp. 151-158, 2002 https://doi.org/10.1109/TBC.2002.1021281
  10. M. Rovira, J. Gonzdlez, A. Lopez, J. Mas, A. Puig, J. Fabregat, and G. Fernandez, 'IndexTV: a MPEG-7 based personalized recommendation system for digital TV,' IEEE International Conf. on Multimedia and Expo, pp. 823- 826, 2004
  11. L. Ardissono, C. Gena, P. Torasso, F. Bellifemine, A. Chiarotto, A. Difino, B. Negro, 'Personalized Recommendation of TV Programs,' Lecture Notes in Artificial Intelligence, Vol. 2829, pp. 474-486, 2003
  12. W.-P. Lee and T.-H. Yang, 'Personalizing information appliances: a multi-agent framework for TV programme recommendations,' Expert Systems with Applications, Vol. 25, No. 3, pp. 331-341, 2003 https://doi.org/10.1016/S0957-4174(03)00074-5
  13. FIPA, 'FIPA Abstract Architecture Specification,' XC00001J, 2001
  14. FIPA. 'FIPA Agent Management Specification,' SC00023K, 2003
  15. S. Kang, J. Lim, and M. Kim, 'Modeling the user preference on broadcasting contents using Bayesian networks,' Proc. of SPIE 2004, vol. 5308, pp. 958 - 967, 2004 https://doi.org/10.1117/12.526264
  16. TVAF, 'Specification Series: S-3 on Metadata Part A: Metadata Schemes,' SP003v1.2, 2002
  17. TVAF, 'Specification Series: S-2 on System Description,' SP002v1.3, 2001
  18. T. M. Bae, S. H. Jin, J. H. Choo, M. Park, Y. M. Ro, H. Kim, and K. Kang, 'Video Segmentation by Hidden Markov Model Using Multimodal MPEG-7 descriptors,' Proc. of SPIE2004, vol.5304, pp. 214-223, 2004
  19. S. H. Jin, T. M. Bae, J. H. Choo, and Y. M. Ro, 'Video genre classification using multimodal features,' Proc. of SPIE2004, vol. 5307, pp. 307-318, 2004
  20. C. S. Kim, H. K. Lee, J. Nam, K. Kang, and Y. M. Ro, 'Semantic Event Detection using MPEG-7 Descriptors for Interactive Broadcasting,' Proc. of CISST2002, vol.1, pp. 391-395, 2002
  21. B. S. Manjunath, P. Salembier, and T. Sikor, Introduction to MPEG-7, John Wiley & Sons, NewYork, N.Y. 2002
  22. J. R. Kim, S. Suh, and S. Sull, 'Fast Scene Change Detection for Personal Video Recorder,' IEEE Trans. Consumer Electronics, Vol.49, No.3, pp. 683-688, 2003 https://doi.org/10.1109/TCE.2003.1233802
  23. Ekin, A., Tekalp, A.M., Mehrotra, R., 'Automatic Soccer Video Analysis and Summarization,' IEEE Transaction on Image Processing, Vol. 12, No. 7, pp. 796-807, 2003 https://doi.org/10.1109/TIP.2003.812758
  24. Ekin, A., Tekalp, A.M., 'Generic Play-break Event Detection for Summarization and Hierarchical Sports Video Analysis,' Proceedings of International Conference on Multimedia & Expo 2003, pp. 27-29, 2003
  25. Zhong, D., Chang, S., 'Real-time view recognition and event detection for sports video,' Journal of Visual Communication & Image Representation, Vol. 15, Issue 3, pp. 330-347, 2004 https://doi.org/10.1016/j.jvcir.2004.04.009
  26. Kumano, M., Ariki, Y., Tsukada, K., Hamaguchi, S., Kiyose, H., 'Automatic Extraction of PC Scenes Based on Feature Mining for a Real Time Delivery System of Baseball Highlight Scenes,' Proceedings of IEEE International Conference on Multimedia and Expo 2004, pp. 277-280, 2004
  27. S. H. Jin, J. H. Cho, T. M. Bae, Y. M. Ro, and K. Kang, 'Content Filtering for Broadcasting Media,' Proc. of SPIE2005, Vol. 5670, pp. 260-271, 2005 https://doi.org/10.1117/12.587764
  28. H. Shin, 'A Storage and Retrieval Method of XML-basedMetadata in PVR Environment,' IEEE Trans. Consumer Electronics, Vol. 49. No. 4, pp. 1136-1140, 2003 https://doi.org/10.1109/TCE.2003.1261208
  29. S. H. Jin, J. H. Cho, and Y. M. Ro, 'Real-time Filtering System on Content Semantics for Live Broadcasting,' International Symposium on Consumer Electronics 2005, pp 98, 2005
  30. M. Park, C. Park, H. Kim, S. Im, D. Shin, S. Yang, 'Content-based Music Information Retrieval using Pitch Histogram of Band Pass Filter Signal,' Proc. of AIRS2004, pp. 245-248 Oct. 2004
  31. S. H. Jin, T. M. Bae, and Y. M. Ro, 'Intelligent Agent-based System for Personalized Broadcasting Services,' Proc. of CISST2004, pp.613-619, June.2004
  32. Y. Li and C.-C. J. Kuo, Video Content Analysis Using Multimodal Information, Kluwer Academic Publishers, Norwell, Massachusetts, 2003
  33. 김문조, 임정연, 강상길 김문철, 강경옥, '시청자 프로파일 추론 기법을 이용한 표적광고 서비스,' 한국방송공학회 논문지, 제 10권, 제 1호, pp. 43-56, 2005
  34. TVAF, 'Exchanging TV-Anytime Metadata over IP Networks,' AN462, 2002
  35. TVAF, 'Specification Series: S-6 on Delivery of Metadata over a Bi-directional Network,' SP006v1.0, 2002
  36. TVAF, 'Specification Series: S-4 on Content Referencing,' SP006v1.2, 2002
  37. Sung Ho Jin, Tae Meon Bae, Jun Ho Cho, Yong Man Ro and Kyeongok Kang, 'User-Centric Broadcasting Environment Using Intelligent Agents,' Journal of Korea Multimedia Society, Vol. 8, No.6, pp. 814-826, 2005