Browse > Article

Interaction with Agents in the Virtual Space Combined by Recognition of Face Direction and Hand Gestures  

Jo, Gang-Hyeon (울산대학교 제어계측공학과)
Kim, Seong-Eun (ETRI 가상현실연구센터)
Lee, In-Ho (ETRI 컴퓨터소프트웨어연구소)
Publication Information
Journal of the Institute of Electronics Engineers of Korea CI / v.39, no.3, 2002 , pp. 62-78 More about this Journal
Abstract
In this paper, we describe a system that can interact with agents in the virtual space incorporated in the system. This system is constructed by an analysis system for analyzing human gesture and an interact system for interacting with agents in the virtual space using analyzed information. An implemented analysis system for analyzing gesture extracts a head and hands region after taking image sequence of an operator's continuous behavior using CCD cameras. In interact system, we construct the virtual space that exist an avatar which incarnating operator himself, an autonomous object (like a Puppy), and non-autonomous objects which are table, door, window and object. Recognized gesture is transmitted to the avatar in the virtual space, then transit to next state based on state transition diagram. State transition diagram is represented in a graph in which each state represented as node and connect with link. In the virtual space, the agent link an avatar can open and close a window and a door, grab or move an object like a ball, order a puppy to do and respond to the Puppy's behavior as does the puppy.
Keywords
HCI(Human-Computer Interaction); gesture recognition; state transition diagram;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 C.H. Sul, S.K. Jung and K.Y. Wohn, 'Synthesis of Human Motion using Kalman Filter,' Proceedings of CapTech'98, First International Workshop on Modeling and Motion Capture Technologies for Virtual Environments, 26-28 November 1998, Geneva,Switzerland
2 Zhengyou Zhang, 'A Flexible New Technique for Camera Calibration,' Technical Report, MSR-TR-98-71, Microsoft Research, One Microsoft Way, Redmond, WA 98052-6399. USA
3 Emanuele Trucco and Alessandro Verri, 'Introductory Techniques for 3-D Computer Vision,' Prentice Hall, New Jersey, 1998
4 Matheen Sidiqui, 'Calibration an its Application to Stereo,' ENG SC467, Senior Honors Thesis, Fall 1999
5 Ismail Haritaoglu, David Harwood, and Larry S. Davis, 'W4: Real-Time Surveillance of People and Their Activities,' IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, August 2000   DOI   ScienceOn
6 Pattie Maes, Bruce Blumberg, Trevor Darrell and Alex Pentland, 'The Alive System: Wireless, Full-body Interaction with Autonomous Agents,' ACM Multimedia Systems, 5:105-112, 1997   DOI
7 J.K. Aggarwal and Q. Cai, 'Human Motion Analysis: A Review,' Computer Vision and Image Understanding, Vol. 73, No. 3, pp. 428-440, March 1999   DOI   ScienceOn
8 Christopher Wren, Ali Azarbayejanj, Trevor Darrell, Alex Pentland, 'Pfinder: Real-Time Tracking of the Human Body,' IEEE Trans. Pattern Analysis and Machine Intelligence , Vol. 19, No. 7, pp. 780-785, July 1997   DOI   ScienceOn
9 Christopher R. Wren and Alex P. Pentland, 'Dynamic Models of Human Motion,' IEEE International Conference on Automatic Face and Gesture Recognition, Japan, April 14-16, 1998   DOI
10 Ali Azarbayejani and Alex Pentland, 'Real-time self-calibrating stereo person tracking using 3-D shape estimation from blob features,' ICPR'96, Vienna,Austria, August 1996   DOI
11 David J. Beyme,'Face Recognition Under Varying Pose' A.I. Memo No. 1461, Artificial Intelligence Lab., MIT, 1993
12 F. Parke, 'Parameterized models for facial animation,' IEEE Computer Graphics and Applications, 2(9): 61-68, November, 1982   DOI   ScienceOn
13 D. Terzopoulos and K. Waters, 'Physically-based facial modeling, analysis,and animation,' Visualization and Computer Animation, 1:73-80, 1990   DOI   ScienceOn
14 Y. Lee D. Terzopoulosv,,and K. Waters, 'Realistic Modeling for Facial Animation,' In Computer Graphics Proceedings, Annual Conference Series, 1995, ACM SIGGRAPH, pp. 55-62   DOI
15 Lawrence R. Rabiner, 'A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,' Proc. of the IEEE, Vol. 77, No. 2, pp. 257-286, Feb. 1989   과학기술학회마을   DOI   ScienceOn
16 김성은, 조강현, 전희성, 최원호, 박경섭, '인간의 행동인식을 위한 얼굴방향과 손 동작 해석,' 제어 자동화 시스템 공학논문지, Vol. 7, No. 4, pp. 309-318, April. 2001
17 Francis K.H. Quek, 'Unencumbered Gestural Interaction,' IEEE MultiMedia, Vol. 3, No. 4, pp. 36-47, Winter 1996   DOI   ScienceOn
18 Ming-Hsuan Yang and Narendra Ahuja, 'Extraction and Classification of Visual Motion Patterns for Hand Gesture Recognition,' In Proceeding of the IEEE CVPR, pp. 892-897, Santa Barbara, 1998   DOI
19 K.H. Jo, Y. Kuno and Y. Shirai, 'Manipulative hand gesture recognition using task knowledge for human computer interaction,' Proc 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 468-473, 1998   DOI
20 Maylor K. Leung and Yee-Hong Yang, 'First Sight: A Human Body Outline Labeling System,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 17, No. 4, April 1995   DOI   ScienceOn
21 Greg Welch and Gray Bishop, 'An Introduction to the Kalman Filter,' TR 95-041, University of North Carolina at Chapel Hill, February 8, 2001