Browse > Article
http://dx.doi.org/10.9723/jksiis.2019.24.5.017

Fashion-show Animation Generation using a Single Image to 3D Human Reconstruction Technique  

Ahn, Heejune (서울과학기술대학교 전기정보공학과)
Minar, Matiur Rahman (서울과학기술대학교 전기정보공학과)
Publication Information
Journal of Korea Society of Industrial Information Systems / v.24, no.5, 2019 , pp. 17-25 More about this Journal
Abstract
In this paper, we introduce the technology to convert a single human image into a fashion show animation video clip. The technology can help the customers confirm the dynamic fitting result when combined with the virtual try on technique as well as the interesting experience to a normal person of being a fashion model. We developed an extended technique of full human 2D to 3D inverse modeling based on SMPLify human body inverse modeling technique, and a rigged model animation method. The 3D shape deformation of the full human from the body model was performed by 2 part deformation in the image domain and reconstruction using the estimated depth information. The quality of resultant animation videos are made to be publically available for evaluation. We consider it is a promising approach for commercial application when supplemented with the post - processing technology such as image segmentation technique, mapping technique and restoration technique of obscured area.
Keywords
Inverse modeling; Computer graphics; Animation; Virtual fashion show; SMPLify;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ahn H., (2018a). Online Virtual Try On using Mannequin Cloth Pictures, Journal of the Korea Industrial Information Systems Research, 23(6), 29-38.   DOI
2 Ahn H., (2018b). Image-based Virtual Try-On System, Journal of Korean Computer Game Society, 31(3), 37-45.
3 Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., and Black, M. J. (2016). Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image, European Conference on Computer Vision, pp. 561-578.
4 Bookstein, F. L. (1989). Principal Warps: Thin-plate Splines and the Decomposition of Deformations, IEEE Transactions on PAMI, 11(6), 567-585.   DOI
5 Cao, Z., Simon, T., Wei, S. E., and Sheikh, Y. (2017). Realtime Multi-person 2D Pose Estimation using Part Affinity Fields, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291-7299.
6 Chen, L. C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A. L. (2017). Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs, IEEE Transactions on PAMI, 40(4), 834-848.
7 Guo, H., Miao, Z., Zhu, F., Zhang, G., and Li, S. (2014). Automatic Labanotation Generation based on Human Motion Capture Data, Chinese Conference on Pattern Recognition, pp. 426-435.
8 Liu, F., Shen, C., and Lin, G. (2015). Deep Convolutional Neural Fields for Depth Estimation from a Single Image, Proceedings of the IEEE CVPR, pp. 5162-5170.
9 Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., and Black, M. J. (2016). SMPL: A Skinned Multi-person Linear Model, ACM Transactions on Graphics (TOG), 34(6), 248-258.
10 Parent R. (2012). Computer Animation, Algorithms and Techniques, 3rd Edition, Morgan Kaufmann.
11 Zanfir, M., Popa, A. I., Zanfir, A., and Sminchisescu, C. (2018). Human Appearance Transfer, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5391-5399.
12 Weng, C. Y., Curless, B., and Kemelmacher-Shlizerman, I. (2019). Photo Wake-up: 3d Character Animation from a Single Photo, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5908-5917.