Browse > Article

Hierarchical Visualization of the Space of Facial Expressions  

Kim Sung-Ho (숭의여대 정보통신계열)
Jung Moon-Ryul (서강대학교 영상대학원 미디어공학과)
Publication Information
Journal of KIISE:Computer Systems and Theory / v.31, no.12, 2004 , pp. 726-734 More about this Journal
Abstract
This paper presents a facial animation method that enables the user to select a sequence of facial frames from the facial expression space, whose level of details the user can select hierarchically Our system creates the facial expression space from about 2400 captured facial frames. To represent the state of each expression, we use the distance matrix that represents the distance between pairs of feature points on the face. The shortest trajectories are found by dynamic programming. The space of facial expressions is multidimensional. To navigate this space, we visualize the space of expressions in 2D space by using the multidimensional scaling(MDS). But because there are too many facial expressions to select from, the user faces difficulty in navigating the space. So, we visualize the space hierarchically. To partition the space into a hierarchy of subspaces, we use fuzzy clustering. In the beginning, the system creates about 10 clusters from the space of 2400 facial expressions. Every tine the level increases, the system doubles the number of clusters. The cluster centers are displayed on 2D screen and are used as candidate key frames for key frame animation. The user selects new key frames along the navigation path of the previous level. At the maximum level, the user completes key frame specification. We let animators use the system to create example animations, and evaluate the system based on the results.
Keywords
facial motion capture; facial animation; navigation; fuzzy clustering; hierarchical visualization;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ying Zhao and George Karypis, 'Evaluation of hierarchical clustering algorithms for document datasets,' pages 515-524. ACM Press, 2002   DOI
2 S. C. Johnson, 'Hierarchical Clustering Schemes,' Psychometrika, 2:241-254, 1967   DOI
3 Seber, G.A.F., 'Multivariate Observations,' Wiley, New York, 1984
4 J.C Bezdek, 'Pattern Recognition with Fuzzy Objective Function Algorithms:, Plenum Press, New York, 1981
5 R.O. Duda and P.E. Hart, 'Pattern Classification and Scene Analysis,' Wiley, New York, 1973
6 J. C. Dunn, 'A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters,' Journal of Cybernetics 3: 32-57, 1973   DOI
7 Uprendra Shardanand, 'Social information filtering for music recommendation,' Master's thesis, MIT, 1994
8 Ya Chang, Changbo Hu, and Turk, M., 'Manifold of Facial Expression,' In IEEE International Workshop on Analysis and Modeling of Faces and Gesture, pp. 28-35, Oct. 17, 2003
9 Jehee Lee, Jinxiang Chai, Paul Reitsma, Jessica Hodgins, and Nancy Pollard, 'Interactive Control of Avatars Animated with Human Motion Data,' ACM Transactions on Graphics (SIGGRAPH 2002), volume 21, number 3, 491-500, July 2002   DOI
10 T. Cox and M. Cox. 'Multidimensional Scaling,' Chapman & Hall, London, 1994
11 R. W. Floyd, 'Algorithm 97 : Shortest Path,' CACM Vol.5, pp. 345, 1962   DOI
12 Kwangjin Choi and Hyeongseok Ko, 'On-line motion retargetting,' In Proceedings of the International Pacific Graphics '99, 1999   DOI
13 Erol Fatih, Gudukbay Ugur, 'An Interactive Facial Animation System,' WSCG'2001 Conference Proceeding, 2001
14 Zhang Y., Prakash E., Sung E., 'Real-time Facial Expression Animation on An Individualized Face Using Adaptive Simulation Algorithm,' September 16 - September 21, GraphicCon'2002, 2002
15 M. Gleicher, 'Retargetting Motion to New Characters,' ACM SIGGRAPH 98, pp.33-42, 1998   DOI
16 Cyriaque Kouadio, Pierre Poulin, and Pierre Lachapelle, 'Real-time facial animation based upon a bank of 3D facial expressions,' Proc. Computer Animation 98, June 1998   DOI
17 M. Escher, G. Sannier, N. Magnenat-Thalmann, 'Real-Time Interactive Facial Animation,' WSCG'99, Pilzen, 1999
18 F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, D. Salesin, 'Synthesizing Realistic Facial Expressions from Photographs,' SIGGRAPH98 Proceedings, pp.75-84, 1998   DOI
19 Frederic I. Parke, Keith Waters, 'Computer facial animation,' A K Peters, 1996
20 Demetri Terzopoulos, Barbara Mones-Hattal, Beth Hofer, Frederic Parke, Doug Sweetland, Keith Waters, 'Facial animation : Past, present and future,' Panel, SIGGRAPH97   DOI
21 Brian Guenter, Cindy Grimm, Daniel Wood, Henrique Malvar, and Frederic Pighin. 'Making Faces,' In SIGGRAPH 98 Conference Proceedings. ACM SIGGRAPH, July 1998