Browse > Article

Rate-Constrained Key Frame Selection Method using Iteration  

Lee, Hun-Cheol (Division of Electrical Engineering, Dept. of Electrical Engineering and Computer Science, KAIST)
Kim, Seong-Dae (Division of Electrical Engineering, Dept. of Electrical Engineering and Computer Science, KAIST)
Publication Information
Abstract
Video representation through representative frames (key frames) has been addressed frequently as an efficient way of preserving the whole temporal information of sequence with a considerably smaller amount of data. Such compact video representation is suitable for the purpose of video browsing in limited storage or transmission bandwidth environments. In a case like this, the controllability of the total key frame number (i.e. key frame rate) depending on the storage or bandwidth capacity is an important requirement of a key frame selection method. In this paper, we present a sequential key frame selection method when the number of key frames is given as a constraint. It first selects the desired number of initial key frames and determines non-overlapping initial time intervals that are represented by each key frame. Then, it adjusts the positions of key frames and time intervals by iteration, which minimizes the distortion. Experimental result demonstrates the improved performance of our algorithm over the existing approaches.
Keywords
비디오 검색;주요 화면 선택;비디오 요약;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Hanjalic, R.L. Lagendijk, J. Boemond, 'A Content Representation', Proceedings of the First Intemational Workshop on Image Databases and Multi-Media Search, Amsterdam (NL), 1997
2 R. L. Lagendijk,A. Hanjalic, M. Cecarelli, M. Soletic, and E. Persoon 'Visual Search in a SMASH System', Proceedings of ICIP 96, Vol. 3, pp. 671-674, 1996   DOI
3 Hun-Cheol Lee and Seong-Dae Kim, 'Rate-driven Key Frame Selection using Temporal Variation of Visual Content', Electronics Letters, Vol. 38, Issue 5, pp. 217-218, Feb. 2002   DOI   ScienceOn
4 Hyun Sung Chang, Sanghoon Sulll and Sang Uk Lee, 'Efficient Video Indexing Scheme for Content-based Retroeval', IEEE Trans. Circuits and Systems for Video Technology, pp. 1269-1279, Vol. 9, 'No. 8, 1999   DOI   ScienceOn
5 Minerva M. Yeung and Bede Liu, ' Efficient Matching and Clustering of Video Shoes', Proceedings of ICIP 95, 1995, pp. 338-342
6 Y, Zhuang, Y. Rui, T. S. Huang and S. Mehrotra, ' Adaptive Key frame Extraction using Unsupervised Clustering', Proc. ICIP, pp. 866-870, 1998
7 Nikolaos D. Doulamis, Anastasios,D. Doulamis, Yannis, S. Avrithis and Stefanos D. Kollias, 'Video Content Representation using Optimal Extraction of Frames and Scene', Proceedings of ICIP 98, Vol.1, pp. 875-879, 1998   DOI
8 Monerva M, Yeung and Boon-Lock Yeo, 'Segmentation of Video by Clustering and Graph Analysis', Computer Vision and Image Understanding, Vol. 71, No. 1, pp. 94-109, 1998   DOI   ScienceOn
9 A. Nagasaka and Y. Tanaka, 'Automatic video indexing and full-video search for object appearances,' in Visual Database systems II, 1992
10 B. Shahrary and D. C. Gibbon, 'Automatic generation of pictorial transcript of video programs', in Proc IS&T/SPIE Digital Video Compression: Algorithms and Technologies San Jose, CA, 1995, pp. 512-519
11 Yap-Peng Tan, Sanjeev R. Kulkarmi and Peter J. Ramadge, 'A Framework for Measuring Video Similarity and Its Application to Video Query by Example', Proc. Int'l Conference on Image Processing, 1999   DOI
12 Monerva M. Yeung and Boon-Lock Yeo, 'Video Visualization for Compact Presentation and Fast Browsing of Pictorial Content', IEEE Trans Circuits and Systems for Video Technology, pp. 771-785, Vol. 7, No. 5, 1997   DOI   ScienceOn
13 Huncheol Lee, CheongWoo Lee and SeongDae Kim, 'Abrupt shot change detection using an unsupervised clustering of multiple features', Proc. of ICASSP2000, Vol. 4, pp. 2015-2018   DOI
14 R. Brunelli, O. Mich, and C.Modena, 'A Survey of the Automatic Indexing of Video Date', Journal of Visual Communication and Image Representation, Vol.10, pp. 78-112,1999   DOI   ScienceOn
15 Ullas Gargi, Tangachar Kasturi, and Susan H. Srayer, 'Performance Characterization of Videl-Shot-Change Detection Methods', IEEE Trans. Circuits and Systems for Video Technology, pp.1-13, Vol. 10, No.1, 2000   DOI   ScienceOn
16 F. Idris and S. Panchanathan, 'Review of Image and Video Indexing Techniques', Journal of Visual Communication and Image Representation, Vol. 8, No. 2, June, pp. 146-166, 1997   DOI   ScienceOn
17 Man-Kwan Shan and Suh-Yin Lee, 'Contentbased Video Tetrieval based on Similarity of Frame Sequence', Proc. Int'l Workshop on multimedia Database Management Systems, pp. 90-97, 1998
18 MPEG-7: Context, Objectives and Technical Roadmap, V. 11, ISO/IEC JTC1/SC29/WG11/N2729, March 1999, Seoul
19 Hong Jiang Zhang, Jianhua Wu, Di Zhong and Stephen W, Smoliar, 'An Integrated System for Content-based Video Tetrieval and Browsing', Pattern Recognition, Vol. 30, No.4, pp. 643-658, 1997   DOI   ScienceOn