Browse > Article

Noise-Robust Capturing and Animating Facial Expression by Using an Optical Motion Capture System  

Park, Sang-Il (Department of Digital Contents, Sejong University)
Abstract
In this paper, we present a practical method for generating facial animation by using an optical motion capture system. In our setup, we assumed a situation of capturing the body motion and the facial expression simultaneously, which degrades the quality of the captured marker data. To overcome this problem, we provide an integrated framework based on the local coordinate system of each marker for labeling the marker data, hole-filling and removing noises. We justify the method by applying it to generate a short animated film.
Keywords
3D animation; character animation; facial animation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Joshi, P., Tien, W. C., Desbrun, M., Pighin, F., "Learning controls for blend shape based realistic facial animation", In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 187-192, 2003
2 Pyun, H., Kim, Y., Chae. W., Kang. H. W., Shin, S. Y., "An example-based approach for facial expression cloning", In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 167-176, 2003
3 Ju, E., Lee, J., "Expressive Facial Gestures from motion capture data", Computer Graphics Forum, vol. 27(2), pp. 381-388, 2008   DOI   ScienceOn
4 Pighin. F., Hecker., J., Lischinski, D., Salesin, D., Szeliski, R., "Synthesizing Realistic Facial Expressions", In Proceedings of SIGGRAPH 98, pp. 75-84, 1998
5 Ma, W., Jones, A., Chiang, J., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., Debevec, P., "Facial performance synthesis using deformation-driven polynomial displacement maps", ACM Transactions on Graphics, vol. 27(5), article 121, 2008
6 Lipman, Y., Sorkine, O., Levin, D., Cohen-Or, D., "Linear Rotation-invariant Coordinates for Meshes", ACM Transactions on Graphics, Vol. 24(3), pp. 479-487, 2005   DOI   ScienceOn
7 Park, S., Hodgins, J., "Capturing and Animating skin deformation in human motion", ACM Transactions on Graphics, vol. 25(3), pp. 881-889, 2005
8 Horn, B., "Closed-form solution of absolute orientation using unit quaternions", Journal of the Optical Society of America, vol. A(4), pp. 629-642, 1987
9 Deng, Z., Neumann, U., "efase: expressive facial animation synthesis and editing with phoneme-isomap controls", In Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 251-260, 2006
10 Brand, M., "Voice Puppertry", In Proceedings of SIGGRAPH 99, pp. 21-28, 1992.
11 Kshirsagar, S., Magnenat-Thalmann, N., "Visyllable based speech animation", Computer Graphics Forum, vol. 22(3), pp 632-640
12 Chuang, E., Bregler, C., "Mood swings: expressive speech animation", ACM Transactions on Graphics, vol. 24(2), pp. 331-347, 2005   DOI   ScienceOn