Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2008.15-B.5.391

Efficient Representation and Matching of Object Movement using Shape Sequence Descriptor  

Choi, Min-Seok (삼육대학교 경영정보학과)
Publication Information
The KIPS Transactions:PartB / v.15B, no.5, 2008 , pp. 391-396 More about this Journal
Abstract
Motion of object in a video clip often plays an important role in characterizing the content of the clip. A number of methods have been developed to analyze and retrieve video contents using motion information. However, most of these methods focused more on the analysis of direction or trajectory of motion but less on the analysis of the movement of an object itself. In this paper, we propose the shape sequence descriptor to describe and compare the movement based on the shape deformation caused by object motion along the time. A movement information is first represented a sequence of 2D shape of object extracted from input image sequence, and then 2D shape information is converted 1D shape feature using the shape descriptor. The shape sequence descriptor is obtained from the shape descriptor sequence by frequency transform along the time. Our experiment results show that the proposed method can be very simple and effective to describe the object movement and can be applicable to semantic applications such as content-based video retrieval and human movement recognition.
Keywords
Shape sequence descriptor; Shape sequence; Movement recognition; Movement retrieval;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. F. Chang et al, “A Fully Automated Content-Based Video Search Engine Supporting Multi-Objects Spatio-Temporal Queries,” IEEE Transaction on Circuit and Systems for Video Technology, Vol.8, No.5, pp.602-615, 1998   DOI   ScienceOn
2 Y. P Tan, S. R. Kulkarni and P. J Ramadge, “Rapid estimation of camera motion from compressed video with application to video annotation,” IEEE Transaction on Circuit and Systems for Video Technology, Vol.10, No.1, pp.133-146, 2000   DOI   ScienceOn
3 J. Aggarwal and Q. Cai, “Human Motion Analysis: A review,” Computer Vision and Image Understanding, Vol.73, No.3, pp.428-440, 1999   DOI   ScienceOn
4 Aron F. Bobick and James W. Davis, “The Recognition of Human Movement Using Temporal Templates,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.23, No.3, pp.257-267, 2001   DOI   ScienceOn
5 F. J. Perales and J. Torres, “A system for human motion matching between synthetic and real image based on a biomechanic graphical model,” Proceedings of IEEE Computer Society Workshop on Motion of Non-Rigid and Articulated Objects, pp.83-88, November 1994   DOI
6 J. Rehg and T. Kanade, “Model-Based Tracking of Self-Occluding Articulated Objects,” Proceedings of Int'l Conference on Computer Vision, pp.612-617, August 1995   DOI
7 D. Hogg, “Model-Based Vision: A Paradigm to See a Walking Person,” Image and Vision Computing, Vol.1, No.1, pp.5-20, 1983   DOI   ScienceOn
8 K. Akita, “Image Sequence Analysis of Real World Human Motion,” Pattern Recognition, Vol.17, No.1, pp.73-83, 1984   DOI   ScienceOn
9 T. Darrell and A. Pentland, “Space-Time Gestures,” Proceedings of Computer Vision and Pattern Recognition, pp.335-340, 1993   DOI
10 J. A. Webb and J. K. Aggarwal, Visually interpreting the motion of objects in space, IEEE Computer, Vol.14, No.8, pp.40-46, 1981   DOI   ScienceOn
11 K. Rohr, “Towards Model-Based Recognition of Human Movements in Image Sequences,” CVGIP, Image Understanding, Vol.59, No.1, pp.94-115, 1994   DOI   ScienceOn
12 Y. Cui, D. Swets and J. Weng, “Learning-Based Hand Sign Recognition Using Shoslif-m,” Proceedings of Int'l Conference on Computer Vision, pp.631-636, August 1995   DOI
13 Y. Yacoob and L. Davis, “Recognizing Human Facial Expressions Form Long Image Sequences Using Optical Flow,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.18, No.6, pp.636-642, 1996   DOI   ScienceOn
14 B. S. Manjunath, Philippe Salembier and Thomas Sikora, Introduction to MPEG-7: multimedia content description interface, West Sussex, England: John Wiley & Sons, 2002
15 J. Yamato, J. Ohya and K. Ishii, “Recognizing Human Action in Time Sequential Images Using Hidden Markov Models,” Proceedings of Computer Vision and Pattern Recognition, pp.379-385, 1992   DOI
16 A. Wilson and A. Bobick, “Learning Visual Behavior for Gesture Analysis,” Proceedings of IEEE Int'l. Symposium on Computer Vision, November 1995   DOI
17 J. Little and J. Boyd, “Describing Motion for Recognition,” Proceedings of IEEE Int'l Symposium on Computer Vision, pp.235-240, November 1995   DOI
18 L. Goncalves, E. DiBernardo, E. Ursella and P. Perona, “Monocular Tracking of the Human Arm in 3D,” Proceedings of Int'l Conference on Computer Vision, pp.764-770, August 1995   DOI
19 R. Polana and R. Nelson, “Low Level Recognition of Human Motion,” Proceedings of IEEE Workshop Non- Rigid and Articulated Motion, pp.77-82, 1994   DOI
20 E. Shavit and A. Jepson, “Motion Understanding Using Phase Portraits,” Proceedings of IJCAI Workshop: Looking at People, pp.101-108, 1993
21 MPEG-7 Visual Group, “Descriptor of Core Experiments for MPEG-7 Color/Texture Descriptors,” ISO/IEC JTC1/ SC29/WG11 N2929, Melbourne, October 1999
22 MPEG-7 Visual Group, “Text of ISO/IEC 15938-3/FDIS Information technology - Multimedia content description interface - Part 3 Visual”, ISO/IEC JTC1/ SC29/WG11 N4358, Sydney, July 2001
23 J. M. Siskind, “Grounding Language in Perception,” Artificial Intelligence Rev., Vol.8, pp.371-391, 1995   DOI
24 I. Essa and A. Pentland, “Coding, Analysis, Interpretation, and Recognition of Facial Expressions,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.19, No.7, pp.757-763, 1997   DOI   ScienceOn
25 Ashok Veeraraghavan, Amit K. Roy-Chowdhury and Rama Chellappa, “Matching Shape Sequences in Video with Applications in Human Movement Analysis,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.27, No.12, pp.1896-1909, 2005   DOI   ScienceOn
26 Min-seok Choi and Whoi-yul Kim, “The description and retrieval of a sequence of moving objects using Shape Variation Map,” Patten Recognition Letters, Vol.25, issue 12, pp.1369-1375, 2004   DOI   ScienceOn