Browse > Article
http://dx.doi.org/10.9717/kmms.2021.24.9.1279

A Study on Facial Blendshape Rig Cloning Method Based on Deformation Transfer Algorithm  

Song, Jaewon (eNgine Visual Wave, Inc.)
Im, Jaeho (eNgine Visual Wave, Inc.)
Lee, Dongha (eNgine Visual Wave, Inc.)
Publication Information
Journal of Korea Multimedia Society / v.24, no.9, 2021 , pp. 1279-1284 More about this Journal
Abstract
This paper addresses the task of transferring facial blendshape models to an arbitrary target face. Blendshape is a common method for the facial rig; however, production of blendshape rig is a time-consuming process in the current facial animation pipeline. We propose automatic blendshape facial rigging based on our blendshape transfer method. Our method computes the difference between source and target facial model and then transfers the source blendshape to the target face based on a deformation transfer algorithm. Our automatic method provides efficient production of a controllable digital human face; the results can be applied to various applications such as games, VR chating, and AI agent services.
Keywords
Digital Human; Virtual Human; Facial Animation;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R.W. Sumner and J. Popovic. "Deformation Transfer for Triangle Meshes," ACM Transactions on Graphics Vol. 23, Issue 4, 399-405, 2004.   DOI
2 C. Cao, et al. "FaceWarehouse: A 3D Facial Expression Database for Visual Computing," IEEE Transactions on Visualization and Computer Graphics, Vol. 20, Issue 3, pp. 413-425, 2013.   DOI
3 Z. Gaspard, et al. "Data-driven Extraction and Composition of Secondary Dynamics in Facial Performance Capture," ACM Transactions on Graphics, Vol. 39, Issue 4, 107-1, 2020.
4 C. Lee, I. Kim, and S. Cho, "Designing and Implementing 3D Virtual Face Aesthetic Surgery System Based on Korean Standard Facial Data," Journal of Korea Multimedia Society, Vol. 12, No. 5, pp. 737-744, 2009.
5 T. Igarashi, T. Moscovich, and J. F. Hughes, "As-rigid-as-possible Shape Manipulation," ACM Transaction on Graphics, Vol. 24, Issue 3, pp. 1134-1141, 2005.   DOI
6 P. Ekman. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the Facial Action Coding System, 1997.
7 F.I. Parke, "Computer Generated Animation of Faces," Proceedings of the ACM annual conference, Vol. 1, pp. 451-457, 1972.
8 L. Hao, T. Weise, and M. Pauly, "ExampleBased Facial Rigging," ACM Transactions on Graphics, Vol. 29, Issue 4, pp. 1-6, 2010.
9 J.P. Lewis, et al. "Practice and Theory of Blendshape Facial Models," Eurographics State of the Art Reports, Vol 1, No. 8, pp. 199-218, 2014.
10 H. Byun, "Real-time Facial Modeling and Animation based on High Resolution Capture," Journal of Korea Multimedia Society, Vol. 11, No. 8, pp. 1138-1145, 2008.
11 T. Cho, J. Jung, and S. Choi, "3D Emotional Avatar Creation and Animation using Facial Expression Recognition," Journal of Korea Multimedia Society, Vol. 17, No. 9, pp. 1076-1083, 2008.   DOI