• The KIPS Transactions:PartB
• /
• v.15B no.5
• /
• pp.391-396
• /
• 2008

Motion of object in a video clip often plays an important role in characterizing the content of the clip. A number of methods have been developed to analyze and retrieve video contents using motion information. However, most of these methods focused more on the analysis of direction or trajectory of motion but less on the analysis of the movement of an object itself. In this paper, we propose the shape sequence descriptor to describe and compare the movement based on the shape deformation caused by object motion along the time. A movement information is first represented a sequence of 2D shape of object extracted from input image sequence, and then 2D shape information is converted 1D shape feature using the shape descriptor. The shape sequence descriptor is obtained from the shape descriptor sequence by frequency transform along the time. Our experiment results show that the proposed method can be very simple and effective to describe the object movement and can be applicable to semantic applications such as content-based video retrieval and human movement recognition.

• Journal of Korea Multimedia Society
• /
• v.12 no.4
• /
• pp.492-501
• /
• 2009

Information on movement of objects in videos can be used as an important part in categorizing and separating the contents of a scene. This paper is proposing a shape-based movement-matching algorithm to effectively find the movement of an object in video streams. Information on object movement is extracted from the object boundaries from the input video frames becoming expressed in continuous 2D shape information while individual 2D shape information is converted into a lD shape feature using the shape descriptor. Object movement in video can be found as simply as searching for a word in a text without a separate movement segmentation process using the sequence of the shape descriptor listed according to order. The performance comparison results with the MPEG-7 shape variation descriptor showed that the proposed method can effectively express the movement information of the object and can be applied to movement search and analysis applications.

• Journal of Broadcast Engineering
• /
• v.22 no.2
• /
• pp.234-239
• /
• 2017

A real-time violence detection algorithm based on a new descriptor using the magnitude and direction changes of movement in images is proposed. The descriptor was developed from the observation that the changes of violent actions are much larger than those of normal movements. Descriptor feature vectors consisting of descriptor values during several frames are obtained and these are inputs to SVM(Support Vector Machine) classifier for discriminating violence actions from and non-violence actions. Comparison experiments between the ViF(Violent Flow) and the proposed algorithm were conducted with three different types of datasets. The experimental results show that the proposed algorithm outperforms the ViF in every case.

• Journal of Convergence for Information Technology
• /
• v.12 no.1
• /
• pp.15-21
• /
• 2022

In the content-based video retrieval applications, the information on the movement of an object can be used as important in classifying the content. In particular, analyzing and classifying human movement can be used for various purposes as well as retrieval. In this paper, a method to improve the performance of the shape variation descriptor and shape sequence to describe and classify movement using shape information that changes according to the movement of an object is proposed. By selecting a shape descriptor to more efficiently describe the shape information of an object and comparing the distance function used to measure the similarity, the description and retrieval efficiency of movement information can be increased. Through experiments, it was shown that the proposed method can describe movement information more efficiently and increase the retrieval efficiency compared to the previous method.

• Proceedings of the IEEK Conference
• /
• 2001.09a
• /
• pp.355-358
• /
• 2001

본 논문에서는 객체의 움직임에 의한 모양 변화를 표현하기 위하여 MPEG-7 에 제안된 모양 시퀀스 기술자(Shape Sequence Descriptor)에 대하여 설명하고, 모양 시퀀스 기술자 추출에 필요한 Shape Variation Map 생성을 위한 두 가지 방법을 비교하였다. 기존의 방법은 물체의 평균 적인 모양에 가중치를 두어 생성되며, 새로운 방법은 물체의 움직임에 의해 변화되는 부분에 더 가중치를 두는 방법으로 생성된다. 또한 최종적으로 사용되는 특징 값으로 Zernike moment를 이용하는 방법과 ART(Angular Radial Transform)을 이용하는 방법을 비교하여 모양 시퀀스 검색을 위한 가장 효율적인 방법을 제안하였다.

• The KIPS Transactions:PartB
• /
• v.11B no.1
• /
• pp.1-6
• /
• 2004

Motion Information in a video clip often plays an important role in characterizing the content of the clip. A number of methods have been developed to analyze and retrieve video contents using motion information. However, most of these methods focused more on the analysis of direction or trajectory of motion but less on the analysis of the movement of an object. In this paper, we introduce the shape variation descriptor for describing shape variation caused by object movement along time, and propose a method to describe and retrieve the shape variation of the object using shape variation map. The experimental results shows that the proposed method performed much better than the previous method by l1％ and is very effective for describing the shape variation which is applicable to semantic retrieval applications.

• Journal of Information Processing Systems
• /
• v.15 no.1
• /
• pp.67-90
• /
• 2019

Accurate detection, tracking and analysis of human movement using robots and other visual surveillance systems is still a challenge. Efforts are on to make the system robust against constraints such as variation in shape, size, pose and occlusion. Traditional methods of detection used the sliding window approach which involved scanning of various sizes of windows across an image. This paper concentrates on employing a state-of-the-art, hierarchical graph based method for segmentation. It has two stages: part level segmentation for color-consistent segments and object level segmentation for category-consistent regions. The tracking phase is achieved by employing SIFT keypoint descriptor based technique in a combined matching and tracking scheme with validation phase. Localization of human region in each frame is performed by keypoints by casting votes for the center of the human detected region. As it is difficult to avoid incorrect keypoints, a consensus-based framework is used to detect voting behavior. The designed methodology is tested on the video sequences having 3 to 4 persons.

• Journal of Korea Multimedia Society
• /
• v.14 no.4
• /
• pp.504-516
• /
• 2011

In this paper, we will present a method to detect human hand and recognize hand gesture. For detecting the hand region, we use the feature of human skin color and hand feature (with boundary complexity) to detect the hand region from the input image; and use algorithm of optical flow to track the hand movement. Hand gesture recognition is composed of two parts: 1. Posture recognition and 2. Motion recognition, for describing the hand posture feature, we employ the Fourier descriptor method because it's rotation invariant. And we employ PCA method to extract the feature among gesture frames sequences. The HMM method will finally be used to recognize these feature to make a final decision of a hand gesture. Through the experiment, we can see that our proposed method can achieve 99% recognition rate at environment with simple background and no face region together, and reduce to 89.5% at the environment with complex background and with face region. These results can illustrate that the proposed algorithm can be applied as a production.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.3
• /
• pp.8-15
• /
• 2007

Recently, it is important to process multimedia data efficiently. Especially, in case of retrieval of multimedia information, technique of user interface and retrieval technique are necessary. This paper proposes a new technique which detects cuts effectively in compressed image information by MPEG. A cut is a turning point of scenes. The cut-detection is the basic work and the first-step for video indexing and retrieval. Existing methods have a weak point that they detect wrong cuts according to change of a screen such as fast motion of an object, movement of a camera and a flash. Because they compare between previous frame and present frame. The proposed technique detects shots at first using DC(Direct Current) coefficient of DCT(Discrete Cosine Transform). The database is composed of these detected shots. Features are extracted by HMMD color model and edge histogram descriptor(EHD) among the MPEG-7 visual descriptors. And detections are performed in sequence by the proposed matching technique. Through this experiments, an improved video segmentation system is implemented that it performs more quickly and precisely than existing techniques have.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.256-257
• /
• 2022

In this paper, we introduce a method of extracting three-dimensional feature points through the movement of a single mobile device. Using a monocular camera, a 2D image is acquired according to the camera movement and a baseline is estimated. Perform stereo matching based on feature points. A feature point and a descriptor are acquired, and the feature point is matched. Using the matched feature points, the disparity is calculated and a depth value is generated. The 3D feature point is updated according to the camera movement. Finally, the feature point is reset at the time of scene change by using scene change detection. Through the above process, an average of 73.5% of additional storage space can be secured in the key point database. By applying the algorithm proposed to the depth ground truth value of the TUM Dataset and the RGB image, it was confirmed that the\re was an average distance difference of 26.88mm compared with the 3D feature point result.