Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2004.11B.5.587

XCRAB : A Content and Annotation-based Multimedia Indexing and Retrieval System  

Lee, Soo-Chelo (아주대학교 정보통신 전문대학원)
Rho, Seung-Min (아주대학교 정보통신 전문대학)
Hwang, Een-Jun (아주대학교 정보통신 전문대학원)
Publication Information
The KIPS Transactions:PartB / v.11B, no.5, 2004 , pp. 587-596 More about this Journal
Abstract
During recent years, a new framework, which aims to bring a unified and global approach in indexing, browsing and querying various digital multimedia data such as audio, video and image has been developed. This new system partitions each media stream into smaller units based on actual physical events. These physical events within oath media stream can then be effectively indexed for retrieval. In this paper, we present a new approach that exploits audio, image and video features to segment and analyze the audio-visual data. Integration of audio and visual analysis can overcome the weakness of previous approach that was based on the image or video analysis only. We Implement a web-based multi media data retrieval system called XCRAB and report on its experiment result.
Keywords
Multimedia Database; Multimedia Information Retrieval; Indexing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Dongge Li, Ishwar K. Sethi, Nevenka Dimitrova, Thomas McGee, 'Classification of general audio data for content-based retrieval,'Pattern Recognition Letters, Vol.22, No.5, pp.533-544, 2001   DOI   ScienceOn
2 M. Flickner et al., 'Query by Image and Video Content : The QBIC System,' Computer, Vol.28, No.9, pp.23-32, 1995   DOI   ScienceOn
3 B. Y. Ricardo and R. N. Berthier, Modern Information Retrieval, ACM press, 1999
4 W. Niblack, et al., 'The QBIC project : Query images by content using color, texture and shape,' SPIE V 1908, 1993   DOI
5 J. R. Smith and S.-F. Chang, 'VisualSEEk : a fully automated content-based image query system,' ACM Multimedia, Boston, May, 1996   DOI
6 N. Kosugi, Y. Nishihara and T. Sakata, 'A Practical Query-By-Humming System for a Large Music Database,' Proc. of ACM Multimedia 2000 Conference, November, 2000   DOI
7 V. E. Ogle and M. Stonebraker, 'Chabot : Retrieval from a Relational Database of Images,' IEEE Computer, Vol.28, No.9, September, 1995   DOI   ScienceOn
8 S. Rho and E. Hwang, 'FMF(Fast Melody Finder) : A Web-based Music Retrieval System,' Lecture Notes in Computer Science, Springer-Verlag, Vol.2771, pp.179-192, 2003
9 M. Nabil, A. H. H. Ngu and J. Shepherd, 'Picture Similairty Retrieval Using the 2D Projection Interval Representation,' IEEE Trans. Knowledge and Data Eng., Vol.8, No.4, pp.533-539, Aug., 1996   DOI   ScienceOn
10 A. Ghias, J. Logan, D. Chamberlin and B. Smith, 'Query by humming-musical information retrieval in an audio database,' Proc. of ACM Multimedia Conference, San Francisco, 1995   DOI
11 M. Carrer, L. Ligresti and T. D. C. Little, 'A Tcl/Tk-Based Video Annotation Engine,' Proc. USENIX, Fifth Annual Tcl/Tk Workshop, Summer, 1997
12 K. Hirata and T. Kato, 'Query by visual example-content based image retrieval,' Advances in Database Technology(EDBT '92), pp.56-71, 1992   DOI
13 S. Adali., et al., 'The Advanced Video Information System : data structures and query processing,' ACM Multimedia Systems, Vol.4, No.4, pp.172-186, 1996   DOI
14 H. Kosch, R. Tusch, et al., 'The SMOOTH Video DB-Demonstration of an integrated generic indexing approach,' ACM Multimedia Conference, Los Angeles, USA, pp.495-496, October-November, 2000   DOI
15 Lee, S. Y. and F. J. Hsu, 'Spatial reasoning and similarity retrieval of images using 2-D-C String knowledge representation,' Pattern Recognition, Vol.25-3, pp.305-318, 1992   DOI   ScienceOn
16 S. Lee and E. Hwang, 'Spatial Similarity and Annotation-Based Image Retrieval System,' IEEE Fourth International Symposium on Multimedia Software Engineering, Newport Beach, CA, December, 2002   DOI
17 R. J. McNab, L. A. Smith, D. Bainbridge and I. H. Witten, 'The New Zealand digital library MELody inDEX,' D-Lib Magazine, May, 1997
18 Huron, D., C. S. Sapp and B. Aarden, Themefinder, 2000. http://www.themefinder.org
19 W. E. Mackay, G. Davenport, 'Virtual video editing in interactive multimedia applications,' Communications on ACM. 32, pp.802-810, 1989   DOI   ScienceOn
20 S. Rho and E. Hwang, 'Video Scene Determination using Audiovisual Data Analysis,' Proc. of the 24th International Conference on Distributed Computing Systems (ICDCS '04) Workshops-Multimedia Network Systems and Applications (MNSA '04), Tokyo. Japan, pp.124-129, March, 2004   DOI