DOI QR코드

DOI QR Code

XMARS : XML-based Multimedia Annotation and Retrieval System

XMARS : XML 기반 멀티미디어 주석 및 검색 시스템

  • 남윤영 (아주대학교 정보통신전문대학원) ;
  • 황인준 (아주대학교 정보통신전문대학원)
  • Published : 2002.10.01

Abstract

This paper proposes an XML based Multimedia Annotation and Retrieval System, which can represent and retrieve video data efficiently using XML. The system provides a graphical user interface for annotating, searching, and browsing multimedia data. It is Implemented based on the hierarchical metadata model to represent multimedia information. The metadata about video is organized based on multimedia description schema using XML Schema that basically conforms to the MPEG-7 standard. Also, for the effective indexing and retrieval of multimedia data, video segments are annotated and categorized using the closed caption.

본 논문에서는 XML을 이용하여 멀티미디어 데이터를 구조적으로 표현하고 효율적으로 추출하기 위한 XML 기반 멀티미디어 주석 및 검색 시스템을 제안한다. 이 시스템은 멀티미디어 데이터에 대한 주석이나 검색, 브라우징을 위한 그래픽 인터페이스를 제공하며 멀티미디어 정보를 표현하기 위해 계층적 메타데이터 모델을 기반으로 하여 구현되었다. 비디오에 대한 메타데이터는 MPEG-7 표준에 정의되어 있는 멀티미디어 서술 스키마를 기반으로 XML 스키마를 사용하여 작성하였다. 또한, 멀티미디어 데이터의 효율적인 인덱싱과 추출을 위하여 자막과 주석을 바탕으로 한 카테고라이징 기법을 사용한다.

Keywords

References

  1. Moving Picture Experts Group, 'Overview of the MPEG-7 standard(Version 6.0),' ISO/IEC JTC1/SC29/WG11 N4509, Pattaya, Thailand, December, 2001
  2. Virginia E. Ogle and Michael Stonebraker, 'Chabot : Retrieval from a Relational Database of Images,' IEEE Computer, Vol.28, No.9, pp.40-48, September, 1995 https://doi.org/10.1109/2.410150
  3. J. R. Smith and S. F. Chang, 'VisualSEEk : a fully automated content-based image query system,' ACM Multimedia, Boston, May, 1996 https://doi.org/10.1145/244130.244151
  4. Flickner, Myron, et. al., 'Query by Image and Video Content : The QBIC System,' IEEE Computer, Vol.28, No.9, September, 1995 https://doi.org/10.1109/2.410146
  5. H. Kosch, R. Tusch, L. Boszormenyi, A. Bachlechner, B. Doflinger, C. Hofbauer, and C. Riedler, 'The SMOOTH Video DB-Demonstration of an integrated generic indexing approach, ACM Multimedia Conference, LA, USA, pp.495-496, October-November, 2000 https://doi.org/10.1145/354384.376413
  6. S. F. Chang, W. Chen, H. Meng, H. Sudaram, and D. Zhong, 'VideoQ : An Automated Content Based Video Search System Using Visual Cues,' ACM Multimedia Conference, Seattle, USA, pp. 313-324, November, 1997 https://doi.org/10.1145/266180.266382
  7. Informedia Project at Carnegie Mellon University, http://www.informedia.cs.cmu.edu/
  8. Virage. Inc, http://www.virage.com/
  9. World Wide Web Consortium (W3C) Recommendations, http://www.w3.org/
  10. Moving Picture Experts Group, 'DDL Working Draft 4.0,' ISO/IEC JTC1/SC29/ WG11 N3575, Beijing, China, July, 2000
  11. B. Y. Ricardo and R. N. Berthier, Modern Information Retrieval, ACM press, 1999
  12. W. Zhu, C. Toklu, and S. P. Liou, 'Automatic News Video Segmentation and Categorization Based on Closed-Captioned Text,' 2001 IEEE International Conference on Multimedia and Expo (ICME2001), Tokyo, Japan, pp.1036-1039, August, 2001
  13. D. Bargeron, A. Gupta, J. Grudin, and E. Sanocki, 'Annotations for Streaming Video on the Web : System Design and Usage Studies,' The Eighth International World Wide Web Conference, Toronto,Canada, pp.61-75, May, 1999
  14. A. Berger and J. Lafferty, 'Information Retrieval as Statistical Translation,' ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '99), California, USA, pp.222-229, August, 1999 https://doi.org/10.1145/312624.312681
  15. M. Christel, D. Winkler, and R. Taylor, 'Improving Access to a Digital Video Library,' The 6th IFIP Conference on Human Computer Interaction, Sydney, Australia, pp.524-531, July, 1997
  16. B. Emond, M. Brooks, and A. Smith, 'A Broadband Web-based Application for Video Sharing and Annotation,' ACM Multimedia 2001, Ottawa, Canada, September-October, 2001 https://doi.org/10.1145/500141.500256
  17. H. Rehatschek, and H. Muller, 'A Generic Annotation Model for Video Databases,' The 3rd International Conference on VISUAL '99, Amsterdam, Netherlands, pp.383-390, June, 1999
  18. M. V. Setten and E. Oltmans, 'Demonstration of A Distributed MPEG-7 Video Search and Retrieval Application in the Educational Domain,' ACM Multimedia 2001, Ottawa, Canada, September-October, 2001 https://doi.org/10.1145/500141.500252
  19. L. Wilcox and J. Boreczky, 'Annotation and Segmentation for Multimedia Indexing and Retrieval,' The 31st Annual Hawaii International Conference on System Sciences, Vol. II, Wailea, Hawaii, pp.259-267, January, 1998 https://doi.org/10.1109/HICSS.1998.651708
  20. W. Zhu, C. Toklu, and S. P. Liou, 'Automatic News Video Segmentation and Categorization Based on Closed-Captioned Text,' 2001 IEEE International Conference on Multimedia and Expo (ICME2001), Tokyo, Japan, pp.1036-1039, August, 2001
  21. M. Carrer, L. Ligresti, G. Ahanger, and T. D. C. Little, 'An Annotation Engine for Supporting Video Database Population,' Multimedia Tools and Applications 5, pp.233-258, November, 1997 https://doi.org/10.1023/A:1009647624347
  22. D. Bargeron, A. Gupta, J. Grudin, and E. Sanocki, 'Annotations for Streaming Video on the Web : System Design and Usage Studies,' The Eighth International World Wide Web Conference, Toronto, Canada, pp.61-75, May, 1999