Browse > Article

Design and Implementation of Multimedia Retrieval a System  

노승민 (아주대학교 정보통신전문대학원)
황인준 (아주대학교 정보통신전문대학원)
Abstract
Recently, explosive popularity of multimedia information has triggered the need for retrieving multimedia contents efficiently from the database including audio, video and images. In this paper, we propose an XML-based retrieval scheme and a data model that complement the weak aspects of annotation and conent based retrieval methods. The Property and hierarchy structure of image and video data are represented and manipulated based on the Multimedia Description Schema (MDS) that conforms to the MPEG-7 standard. For audio contents, pitch contours extracted from their acoustic features are converted into UDR string. Especially, to improve the retrieval performance, user's access pattern and frequency are utilized in the construction of an index. We have implemented a prototype system and evaluated its performance through various experiments.
Keywords
Multimedia Database; Image; Video; Audio; Indexing; XML; MPEG-7;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K. Tan, B. Ooi and C. Yee, 'An Evaluation of Color-Spatial Retrieval Techniques for Large Image Databases,' Multimedia Tools and Applications, Vol. 14, pp. 55-78, 2001   DOI   ScienceOn
2 Guojun Lu, 'Indexing and Retrieval of Audio: A Survey,' Journal of Multimedia Tools and Applications, Vol. 15, pp. 269-290, 2001   DOI   ScienceOn
3 N. Kosugi, Y. Nishihara, and T. Sakata, 'A Practical Query-By-Humming System for a Large Music Database,' Proc. of ACM Multimedia 2000 Conference, November 2000   DOI
4 E. Hwang and Y. Nam, 'XVIDEO: XML Based Video Annotation and Retrieval,' Proc. of Int'l Conf. on Internet Computing, Las Vegas, June 2002
5 C. Carson, S. Belongies, H. Greenspan and J. Malik, 'Region-based image querying,' Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, June 1997   DOI
6 jMusic Java library, http://jmusic.ci.qut.edu.au/
7 L. H. Rodrigues, Building Imaging Applications with Java Technology, Addison Wesley, 2001
8 M. Carrer, L. Ligresti, and T.D.C. Little, 'A Tcl/Tk-Based Video Annotation Engine,' Proc. USENIX, Fifth Annual Tcl/Tk Workshop, Summer 1997
9 B.Y. Ricardo and R.N. Berthier, Modem Information Retrieval, ACM press, 1999
10 L. Wilcox and J. Boreczky, 'Annotation and Segmentatoin for Multimedia Indexing and Retrieval,' The 31st Annual Hawaii International Conference on System Sciences, Vol. II, pp. 259-267, Wailea, Hawaii, January 1998   DOI
11 B. Emond, M. Brooks, and A. Smith, 'A Broadband Web-based Application for Video Sharing and Annotation,' ACM Multimedia 2001, Ottawa, Canada, September 30-October 5, 2001   DOI
12 S. Blackburn and D. DeRoure, 'A Tool for Content Based Navigation of Music,' Proc. of ACM Multimedia, 1998   DOI
13 J.T. Foote, 'Content-Based Retrieval of Music and Audio,' Multimedia Storage and Archiving Systems II - Proc. of SPIE, Vol. 3229, pp. 138-147, 1997
14 Huron, D., C.S. Sapp, and B. Aarden, Theme-finder. 2000. http://www.themefinder.org
15 C. Carson, M. Thomas, et al., 'Blobworld: A system for region-based image indexingand retrieval,' In Proc. Int. Conf. Visual Inf. Sys., 1999
16 A. Ghias, J.Logan, D. Chamberlin, and B. Smith, 'Query by humming-musical information retrieval in an audio database,' Proc. of ACM Multimedia Conference, San Francisco, 1995   DOI
17 R.J. McNab, L.A. Smith, D. Bainbridge, and I.H. Witten, 'The New Zealand digital library MELody inDEX,' D-Lib Magazine, May 1997
18 M. Flickner et al., 'Query by image and video content: The QBIC system,' IEEE computer, vol. 28, no. 9, pp. 23-32, 1995   DOI   ScienceOn
19 Song, Yong-Jun, Hyoung-Joo, et al., 'TIVRON: The Integrated Video Retrieval System based on OODBMS,' Journal of Korean Institute of Communication Sciences, April. 1999
20 H. kosch, R Tusch, et al., 'The SMOOTH Video DB - Demonstration of an integrated generic indexing approach,' ACM Multimedia Conference, pp. 495-496, Los Angeles, USA, October-November 2000   DOI
21 Alex Pentland, Rosalind Picard, and Stan Sclaroff, 'Photobook: Tools for Content-Based Manipulation of Image Databases,' SPIE PAPER 2185-05 Storage and Retrieval of Image and Video Databases II, San Jose, CA. February 6-10, 1994
22 E. Hwang and S. Lee, 'Spatial Similarity and Annotation-Based Image Retrieval System,' IEEE 4th International Symposium on Multimedia Software Engineering, California, December 2002   DOI
23 E. Hwang and D. Park, 'Popularity-Adaptive Index Scheme For Fast Music Retrieval,' Proc. of IEEE Multimedia and Expo, Lausanne, Switzerland, August 2002   DOI
24 Virginia E. Ogle and Michael Stonebraker, 'Chabot : Retrieval from a Relational Database of Images,' IEEE Computer, vol. 28, no. 9, 1995   DOI   ScienceOn
25 J. R. Smith and S.-F. Chang. 'VisualSEEk: a fully automated content-based image query system,' ACM Multimedia, Boston, May 1996