Journal of International Society for Simulation Surgery

International Society for Simulation Surgery (국제컴퓨터가상수술학회)
권호 표지
DOI QR코드

DOI QR Code

Reconstructing 3-D Facial Shape Based on SR Imagine

  • Hong, Yu-Jin (University of Science and Technology, HCI Robotics) ;
  • Kim, Jaewon (Korea Institute of Science and Technology, Imaging Media Center) ;
  • Kim, Ig-Jae (Korea Institute of Science and Technology, Imaging Media Center)
  • Received : 2014.11.27
  • Accepted : 2014.12.05
  • Published : 2014.12.20
Download PDF
⟨ Previous Next ⟩

Abstract

We present a robust 3D facial reconstruction method using a single image generated by face-specific super resolution technique. Based on the several consecutive frames with low resolution, we generate a single high resolution image and a three dimensional facial model based on it. To do this, we apply PME method to compute patch similarities for SR after two-phase warping according to facial attributes. Based on the SRI, we extract facial features automatically and reconstruct 3D facial model with basis which selected adaptively according to facial statistical data less than a few seconds. Thereby, we can provide the facial image of various points of view which cannot be given by a single point of view of a camera.

Keywords

References

  1. Xin L, Orchard MT. "New edge-directed interpolation," IEEE Trans. Image Processing, 2001:1521-1527
  2. Morse BS, Schwartzwald D. "Image magnification using level-set reconstruction," IEEE Conference on Computer Vision and Pattern Recognition, 2001:333-340
  3. Bouman CA, Atkins CB, Allebach JP. "Optimal image scaling using pixel classification," IEEE Conference on Image Processing, 2001: 864-867
  4. Shum HY Liu C, Zhang CS. "A two-step approach to hallucinating faces: Global parametric model and local non-parametric model," IEEE Conference on Computer Vision and Pattern Recognition, 2001: 192-198
  5. Yeung D, Chang H, Xiong Y. "Super-resolution through neighbor embedding," IEEE Conf. on Computer Vision and Pattern Recognition, 2004:275-282
  6. Pighin F, Hecker J, Lischinski D, Szeliski R, Salesin DH. "Synthesizing realistic facial expressions from photographs," In Proceedings of SIGGRAPH, 1998:75-84
  7. Blanz V, Vetter T. "A morphable model for the synthesis of 3d faces," In Proceedings of SIGGRAPH, 1999:187-194
  8. Vetter T, Blanz V, Scherbaum K, Seidel HP. "Exchanging faces in images," 2004
  9. Milborrow S, Nicolls F. "Locating facial features with an extended active shape model," October 2008.
  10. Protter M, Elad M. "Super resolution with probabilistic motion estimation," IEEE TRANSACTIONS ON IMAGE PROCESSING, vol. 18, no. 8, 2009.
  11. Kim IJ, Ko HS. "Intuitive quasi-eigen faces," ACM International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, December 2007.
  12. "http://www.3d3solutions.com".