Browse > Article
http://dx.doi.org/10.15701/kcgs.2015.21.3.55

Virtual Make-up System Using Light and Normal Map Approximation  

Yang, Myung Hyun (Life Media Department, Ajou University)
Shin, Hyun Joon (Life Media Department, Ajou University)
Abstract
In this paper, we introduce a method to synthesize realistic make-up effects on input images efficiently. In particular, we focus on shading on the make-up effects due to the lighting and face curvature. By doing this, we can synthesize a wider range of effects realistically than the previous methods. To do this, the information about lighting information together with the normal vectors on all pixels over the face region in the input image. Since the previous methods that compute lighting information and normal vectors require relatively heavy computation cost, we introduce an approach to approximate lighting information using cascade pose regression process and normal vectors by transforming, rendering, and warping a standard 3D face model. The proposed method consumes much less computation time than the previous methods. In our experiment, we show the proposed approximation technique can produce naturally looking virtual make-up effects.
Keywords
Virtual makeup; light approximation; normal map;
Citations & Related Records
연도 인용수 순위
  • Reference
1 I. Kemelmacher-Shlizerman and R. Basri, "3d face reconstruction from a single image using a single reference face shape," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 33, no. 2, pp. 394-405, 2011.   DOI
2 R. Ramamoorthi and P. Hanrahan, "An efficient representation for irradiance environment maps," in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '01. New York, NY, USA: ACM, 2001, pp. 497-500. [Online]. Available: http://doi.acm.org/10.1145/383259.383317   DOI
3 P. DolIar, P. Welinder, and P. Perona, "Cascaded pose regression," in Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2010, pp. 1078-1085.
4 M. Valstar, B. Martinez, X. Binefa, and M. Pantic, "Facial point detection using boosted regression and graph models," in Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2010, pp. 2729-2736.
5 X. Cao, Y.Wei, F.Wen, and J. Sun, "Face alignment by explicit shape regression," International Journal of Computer Vision, vol. 107, no. 2, pp. 177-190, 2014.   DOI
6 N. Duffy and D. Helmbold, "Boosting methods for regression," Machine Learning, vol. 47, no. 2-3, pp. 153-200, 2002.   DOI
7 D. F. Dementhon and L. S. Davis, "Model-based object pose in 25 lines of code," International journal of computer vision, vol. 15, no. 1-2, pp. 123-141, 1995.   DOI
8 H. Araujo, R. L. Carceroni, and C. M. Brown, "A fully projective formulation to improve the accuracy of lowe's poseestimation algorithm," Computer Vision and Image Understanding, vol. 70, no. 2, pp. 227-238, 1998.   DOI
9 C. Cao, Y. Weng, S. Zhou, Y. Tong, and K. Zhou, "Facewarehouse: a 3d facial expression database for visual computing," Visualization and Computer Graphics, IEEE Transactions on, vol. 20, no. 3, pp. 413-425, 2014.   DOI
10 K.-C. Lee and B. Moghaddam, "A practical face relighting method for directional lighting normalization," in Analysis and Modelling of Faces and Gestures. Springer, 2005, pp. 155-169.