Browse > Article

Video retrieval method using non-parametric based motion classification  

Kim Nac-Woo (BcN Research Div., ETRI)
Choi Jong-Soo (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.43, no.2, 2006 , pp. 1-11 More about this Journal
Abstract
In this paper, we propose the novel video retrieval algorithm using non-parametric based motion classification in the shot-based video indexing structure. The proposed system firstly gets the key frame and motion information from each shot segmented by scene change detection method, and then extracts visual features and non-parametric based motion information from them. Finally, we construct real-time retrieval system supporting similarity comparison of these spatio-temporal features. After the normalized motion vector fields is created from MPEG compressed stream, the extraction of non-parametric based motion feature is effectively achieved by discretizing each normalized motion vectors into various angle bins, and considering a mean, a variance, and a direction of these bins. We use the edge-based spatial descriptor to extract the visual feature in key frames. Experimental evidence shows that our algorithm outperforms other video retrieval methods for image indexing and retrieval. To index the feature vectors, we use R*-tree structures.
Keywords
video retrieval; non-parametric motion model; motion classification; key frame;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 M. Rautiainen, M. Hosio, I. Hanski, M. Varanka, J. Kortelainen, T. Ojala, and T. Seppnen, 'TRECVID 2004 experiments at MediaTeam Oulu,' Proc. TRECVID Workshop at Text Retrieval Conference TREC 2004, in press, 2004
2 N. Beckmann, H.-P. Kriegel, R. Schneider, and B. Seeger, 'The R*-tree; An efficient and robust access method for points and rectangles', Proc. ACM SIGMOD, pp. 322-331, 1990   DOI
3 H.J. Zhang, C.Y. Low, S.W. Smoliar, and J.H Wu, 'Video parsing retrieval. and browsing: An integrated and content-based solution,' in Proc. ACM Multimedia, pp. 15-24, 1995   DOI
4 A. Pentland, R. Picard, and S. Sclaroff, 'Photobook: Content-based manipulation of image databases,' IJCV, vol. 18, no. 3, pp. 233-254, 1996   DOI
5 R. Brunelli, O. Mich, C.M. Modena, 'A survey on video indexing,' IRST-Technical Report 9612-06, 1996
6 이미숙, 황본우, 이성환, '내용 기반 영상 및 비디오 검색 기술의 연구 현황,' 정보과학회지, 제15권, 제9호, pp, 10-19, 1997   과학기술학회마을
7 N.W. Kim, T.Y. Kim, and J,S. Choi, 'Edge-based spatial descriptor using color vector angle for effective image retrieval,' LNAI, vol. 3558, 2005   DOI   ScienceOn
8 V. Ogle and M. Stonebraker, 'Chabot: Retrieval from a relational database of images,' IEEE computer, vol. 28, no. 9, pp. 40-48, 1995   DOI   ScienceOn
9 J. R. Smith and S.-F. Chang, 'VisualSEEK: A fully automated content-based image query system,' in ACM Multimedia Conf., 1996   DOI
10 M. Flickner et al., 'Query by image and video content: The QBIC system,' IEEE computer, vol. 28, no. 9, pp. 23-32, 1995   DOI   ScienceOn
11 E. Ardizzone, M.L. Cascia, A. Avanzato, and A. Bruna, 'Video indexing using MPEG motion compensation vectors,' IEEE Int. conf. on multimedia computing and systems, vol. 2, pp. 725-729, 1999   DOI
12 W. Chen and S.-F. Chang, 'VISMap: An interactive image/video retrieval system using visualization and concept maps,' in Proc. IEEE int, Conf. Image Processing, vol. 3, pp. 588-591 2001   DOI
13 J. Huang, S. R Kumar, M. Mitra, W. J, Zhu, and R Zabih, 'Image indexing using color correlograrns,' CVPR, pp. 762-768, 1997   DOI
14 G. Pass and R Zabih, 'Histogram refinement for content-based image retrieval,' IEEE WACV, pp. 96-102, 1996   DOI
15 Y. Deng, C. Kenney, M.S. Moore, and B.S. Manjunath, 'Peer group filtering and perceptual color image quantization,' Proc. of IEEE Intl. Symposium on Circuits and Systems, vol. 4, pp. 21-24 1999   DOI
16 W. Wolf, 'Key frame selection by motion analysis,' in Proc. IEEE Int. Conf. Acoust., Speech, and Signal Proc., 1996   DOI
17 N.W. Kim, E.K Kang, et al., 'Scene change detection and classification algorithm on compressed video streams,' Proc. of the ITC-CSCC 2001, vol. 1, pp. 279-282, 2001
18 T. Yu and Y. Zhang, 'Motion feature extraction for content-based video sequence retrieval,' Internet Image Ⅱ, SPIE-4311, pp. 378-388, 2001   DOI
19 T. Yu and Y. Zhang, 'Retrieval of video clips using global motion information,' Electron. Lett., vol. 37, no. 14, pp. 893-895, 2001   DOI   ScienceOn
20 N.W. Kim, T.Y. Kim, and J,S. Choi, 'Probability-based motion analysis using bi-directional prediction-independent framework in compressed domain,' Optical engineering, vol. 44, no. 6, 2005   DOI   ScienceOn
21 R. Wang R., T Huang, 'Fast camera motion analysis in .MPEG domain,' International Conference on Image Processing, vol. 3, pp. 691-694, 1999   DOI
22 J. Huang, S. R. Kumar, M. Mitra, W. J. Zhu, and R. Zabih, 'Image indexing using color correlograms,' CVPR, pp. 762-768, 1997   DOI
23 E. Izquierdo, J. Xia, and R. Mech, 'A generic video analysis and segmentation system,' in Proc. IEEE Int., Conf. Acoustics, Speech, and Signal Processing, vol. 4, pp. 3592-3595, 2002   DOI
24 R. Zabih, J. Miller, K. Mai, 'A feature-based algorithm for detecting and classifying scene breaks,' ACM International Conference on Multimedia, pp. 189-200, 1995   DOI
25 J. Meug, Y. Juan, S.F. Chang, 'Scene change detection in a MPEG compressed video sequence,' Digital Video Compression: Algorithms and Technologies, SPIE-2419, pp. 14-25, Feb. 1995   DOI
26 . Mann and R.W. Picard, 'Video orbits of the projective group: A simple approach to featureless estimation of parameters,' IEEE Trans. Image Processing, vol. 6, pp, 1281-1295, 1997   DOI   ScienceOn
27 Y. Nakajima, K Ujihara, A. Yoneyama, 'Universal scene change detection on MPEG-coded data domain,' in Proc. SPIE Visual Comm. and Image Proc., pp. 992-1003, 1997   DOI
28 B.L. Yeo, B. Liu, 'Rapid scene analysis on compressed video,' IEEE Trans. on Circuits and Systems for Video Technology, vol. 5, no. 6, pp. 533-544, 1995   DOI   ScienceOn
29 B. Adams et al., 'IBM Research TREC-2002 video retrieval system,' Proc. Text Retrieval Conference TREC 2002 Video Track, 2002