Browse > Article
http://dx.doi.org/10.6109/JKIICE.2007.11.1.102

Video Editing using Hand Gesture Tracking and Recognition  

Bae, Cheol-Soo (관동대학교)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.11, no.1, 2007 , pp. 102-107 More about this Journal
Abstract
In this paper presents a gesture based driven approach for video editing. Given a lecture video, we adopt novel approaches to automatically detect and synchronize its content with electronic slides. The gestures in each synchronized topic (or shot) are then tracked and recognized continuously. By registering shots and slides md recovering their transformation, the regions where the gestures take place can be known. Based on the recognized gestures and their registered positions, the information in slides can be seamlessly extracted not only to assist video editing, but also to enhance the quality of original lecture video. In experiment with two videos, the proposed system showd each gesture recognition rate 95.5%,96.4%.
Keywords
Gesture Recognition; Gesture Tracking; Video Editing; HMM;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. F. S. -Mahmood, 'Indexing for topics in videos using foils,' Int. Conf. CVPR, pp. 312-319,2000
2 Q. Liu, Y. Rui, A. Gupta & J. J. Cadiz, 'Automatic Camera Management for Lecture Room Environment,' Int. Conf. on Human Fectirs in Computing Systems, 200 1
3 S. G. Deshpande & J.-N. Hwang, 'A Real-time Interactive Virtual Classroom Multimedia Distance Learning System,' IEEE Trans on Multimedia, vol. 3, no. 4, pp. 432-444, 2001   DOI   ScienceOn
4 D. Phung, S. Venkatesh & C. Dorai, 'High Level Segmentation of Instructional Videos Based on Content Density,' ACM Multimedia, 2002
5 J. Martin & J. B. Durand, 'Automatic Gestures Recognition Using Hidden Markov Models,' Int. Conf. Automatic Face and Gesture Recognition, 2000
6 L. He, E. Sanocki, A. Gupta & J. Grudin, 'Auto-Summarization of Audio-Video Presentations,' ACM Multimedia, pp. 489-498, 1999
7 P. Peer, J. Kovac & F. SOLINA, 'Human skin colour clustering for face detection,' Int. Conf. on Computer as a Tool, 2003
8 S. Mukhopadhyay & B. Smith, 'Passive Capture and Structuring of Lectures,' ACM Multimedia, 1999
9 C. W. Ngo, T. C. Pong & T. S. Huang, 'Detection of Slide Transition for Topic Indexing,' Int. Conf. on Multimedia Expo, 2002
10 S. X. Ju et. al, 'Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture,' IEEE Trans on CSVT, vol. 8, no. 5, pp. 686-696,1998
11 G. D. Abowd et. al., 'Teaching and Leaming as Multimedia Authoring: The Classroom 2000 Project,' ACM Multimedia, pp. 187-198, 2000
12 F.Wang, C. W. Ngo & T. C. Pong, 'Synchronization of Lecture Videos and Electronic Slides by Video Text Analysis,' ACM Multimedia Conference, 2003