Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Content-Based Video Retrieval Algorithms using Spatio-Temporal Information about Moving Objects

객체의 시공간적 움직임 정보를 이용한 내용 기반 비디오 검색 알고리즘

  • 정종면 (한국전자통신연구원 방송미디어연구부) ;
  • 문영식 (한양대학교 컴퓨터공학과)
  • Published : 2002.10.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper efficient algorithms for content-based video retrieval using motion information are proposed, including temporal scale-invariant retrieval and temporal scale-absolute retrieval. In temporal scale-invariant video retrieval, the distance transformation is performed on each trail image in database. Then, from a given que교 trail the pixel values along the query trail are added in each distance image to compute the average distance between the trails of query image and database image, since the intensity of each pixel in distance image represents the distance from that pixel to the nearest edge pixel. For temporal scale-absolute retrieval, a new coding scheme referred to as Motion Retrieval Code is proposed. This code is designed to represent object motions in the human visual sense so that the retrieval performance can be improved. The proposed coding scheme can also achieve a fast matching, since the similarity between two motion vectors can be computed by simple bit operations. The efficiencies of the proposed methods are shown by experimental results.

Keywords

References

  1. V. E. Ogle, 'Chabot : Retrieval from a Relational Database of Images,' IEEE Computer, vol. 28, no. 9, pp.40-48, Sep. 1995 https://doi.org/10.1109/2.410150
  2. A. Mojsilovic, J. Hu, 'A Method for Color Content Matching of Images,' Proc. of the 2000 Int. Conf. on Multimedia and Expo, vol. 2, pp. 649-652, Jul. 2000 https://doi.org/10.1109/ICME.2000.871446
  3. B. S. Manjunath and W. Y. Ma, 'Texture Features for Browsing and Retrieval of Image Data,' IEEE Trans. on Pattern Anal. Machine Intell.,' vol.18, no.8, pp. 837-842, Aug. 1996 https://doi.org/10.1109/34.531803
  4. M. Flickner, M. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hanfner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, 'Query by image and Video Content : The QBIC System,' IEEE Computer, vol. 28, no. 32, pp. 23-32, Sep. 1995 https://doi.org/10.1109/2.410146
  5. R. Brunelli, O. Mich and C. M. Modena, 'A Survey on the Automatic Indexing of Video Data,' J. of Visual Comm. and Image Rep., vol.2, no. 10, pp. 78-112, Jun. 1999 https://doi.org/10.1006/jvci.1997.0404
  6. E. Ardizzone and M. L. Cascia, 'Video Indexing Using Optical Flow Field,' Proc. of Int. Conf. on Image Processing, vol. 3, pp. 831-834, Sep. 1996 https://doi.org/10.1109/ICIP.1996.560876
  7. C. Colombo, A. D. Bimbo, and P. Pala, 'Semantics in Visual Information Retrieval,' IEEE Multimedia, vol. 6, no. 3, pp. 38-53, Sep. 1999 https://doi.org/10.1109/93.790610
  8. D. Zhong and S. F. Chang, 'Region Feature Based Similarity Searching of Semantic Video Objects,' Proc. of Int. Conf. on Image Processing, vol. 2, pp. 111-115, 1999 https://doi.org/10.1109/ICIP.1999.822865
  9. J. R. Smith and S. F. Chang, 'VisualSEEk : A Fully Automated Content-Based Image Query System,' In ACM Multimedia Conf., pp. 87-98, Nov. 1996. [Online]. Available WWW : http://www.ctr.columbia.edu/ VisualSEEk https://doi.org/10.1145/244130.244151
  10. A. Hanrapur, A. Gupta, B. Horowitz, C. F. Shu, C. Fuller, J. Bach, M. Gorkani, and R. Jain, 'Virage Video Engine,' Proc. of SPIE in Storage and Retrieval for Image and Video Databases V, vol. 3022, pp. 188-197, Feb. 1997 https://doi.org/10.1117/12.263407
  11. H. D. Wactlar, T. Kanade, M. A. Smith, S. M. Stevens, 'Intelligent Access to Digital Video : Informedia Project,' IEEE Computer, vol. 29, no. 5, pp. 46-52, May 1996 https://doi.org/10.1109/2.493456
  12. A. Pentland, R. W. Picard, and S. Sclaroff, 'Photobook : Content-Based Manipulation of Image Database,' Int. J. of Computer Vision, vol. 18, no. 3, pp. 233-254, 1996 https://doi.org/10.1007/BF00123143
  13. S. F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, 'A Fully Automated Content-Based Video Search Engine Supporting Spatiotemporal Queries,' IEEE Trans. Circuits and Sys. for Video Tech., vol. 8, no. 5, pp. 602-615 Sep. 1998 https://doi.org/10.1109/76.718507
  14. S. Dagtas, W. Al-Khatib, A. Ghafoor and R. L. Kashyap, 'Models for Motion-Based Video Indexing and Retrieval,' IEEE Trans. on Image Processing , vol. 9, no. 1, pp. 88-101, Jan. 2000 https://doi.org/10.1109/83.817601
  15. A. Yoshitaka, Y. Hosoda, M. Yoshimitsu, 'VIOLONE : Video Retrieval by Motion Example,' J. of Visual Languages and Computing, vol. 7, no. 4, pp. 423-443, 1996 https://doi.org/10.1006/jvlc.1996.0022
  16. K. W. Lee, W. S. You and J. Kim, 'Video Retrieval based on the Object's Motion Trajectory,' Proc. of SPIE in Visual Comm. and Image Processing, vol. 4067, pp. 114-124, 2000 https://doi.org/10.1117/12.386558
  17. W. Chen and S. F. Chang, 'Motion Trajectory Matching of Video Objects,' Proc. of SPIE, on Storage and Retrieval for Media Databases, vol. 3972, pp. 544-553, 2000 https://doi.org/10.1117/12.373587
  18. Z. Aghbari, K. Kaneko and A. Makinouchi, 'Modeling and Querying Videos by Content Trajectories,' Proc. of 2000 IEEE Int. Conf. on Multimedia and Expo, vol. 1, Aug. 2000 https://doi.org/10.1109/ICME.2000.869639
  19. N. H. AbouGhazaleh, Y. E. Gamal, 'Compressed Video Indexing Based on Object Motion,' Proc. of SPIE in Visual Comm. and Image Processing, vol. 4067, pp. 986-993, 2000 https://doi.org/10.1117/12.386702
  20. S. Panchanathan, F. Golshani, Y. C. Park, 'VideoRoadMap : A System for Interactie Classification and Indexing of Still and Motion Pictures,' Proc. IEEE Instrumentation and Measurement Tech. Conf., pp. 18-21, 1998 https://doi.org/10.1109/IMTC.1998.679635
  21. V. Singla,Y. C. Park, S. Panchanathan, F. Golshani, 'Video Composition and Retrieval,' Proc. of Int. Conf. on Multimedia and Expo, vol. II, pp.1163-1166, 2000 https://doi.org/10.1109/ICME.2000.871567
  22. G. Borgefors, 'Hierarchical Chamfer Matching : A Parametric Edge Matching Algorithm,' IEEE Trans. on Pattern Anal. Machine Intell., vol. 10, no. 6, pp.849-865, Nov. 1988 https://doi.org/10.1109/34.9107
  23. N. Dimitrova and F. Golshani, 'Motion Recovery for Video Content Classification,' ACM Trans. on Information Sys., vol. 13, no. 4, pp.408-439, Oct. 1995 https://doi.org/10.1145/211430.211433
  24. 김소연, 노영만, '압축 영역에서 객체 움직임 맵에 의한 효율적인 비디오 인덱싱 방법에 관한 연구', 한국 정보처리학회 논문지, 제7권 제5호, pp. 1570-1578, 2000년 5월
  25. D. H. Ballard, C. M. Brown, Computer Vision, Prentice-Hall, 1992
  26. I. K. Sethi and R. Jain, 'Finding Trajectories of Feature Points in an Monocular Image Sequence,' IEEE Trans. on Pattern Anal. Machine Intell., vol. 9, no. 1, pp. 56-73, Jan. 1987 https://doi.org/10.1109/TPAMI.1987.4767872
  27. K. Rangarajan and M. Shah, 'Establishing Motion Correspondence,' CVGIP : Image Understanding, vol. 54, no. 1, pp. 56-73, 1991 https://doi.org/10.1016/1049-9660(91)90075-Z