Browse > Article
http://dx.doi.org/10.9723/jksiis.2019.24.6.025

Performance Evaluation of VTON (Virtual-Try-On) Algorithms using a Pair of Cloth and Human Image  

Tuan, Thai Thanh (서울과학기술대학교 전기정보공학과)
Minar, Matiur Rahman (서울과학기술대학교 전기정보공학과)
Ah, Heejune (서울과학기술대학교 전기정보공학과)
Publication Information
Journal of Korea Society of Industrial Information Systems / v.24, no.6, 2019 , pp. 25-34 More about this Journal
Abstract
VTON (Virtual try-on) is a key technology that can activate the online commerce of fashion items. However, the early 3D graphics-based methods require the 3D information of the clothing or the human body, which is difficult to secure realistically. In order to overcome this problem, Image-based deep-learning algorithms such as VITON (Virtual image try-on) and CP-VTON (Characteristic preserving-virtual try-on) has been published, but only a sampled results on performance is presented. In order to examine the strength and weakness for their commercialization, the performance analysis is needed according to the complexity of the clothes, the object posture and body shape, and the degree of occlusion of the clothes. In this paper, IoU and SSIM were evaluated for the performance of transformation and synthesis stages, together with non-DL SCM based method. As a result, CP-VTON shows the best performance, but its performance varies significantly according to posture and complexity of clothes. The reasons for this were attributed to the limitations of secondary geometric deformation and the limitations of the synthesis technology through GAN.
Keywords
Virtual-Try-On; Deep-learning; Image-based; 2D deformation; Quality evaluation;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ahn H., (2018a). Online Virtual Try On using Mannequin Cloth Pictures, Journal of the Korea Industrial Information Systems Research, 23(6), 29-38.   DOI
2 Ahn H., (2018b). Image-based Virtual Try-On System, Journal of Korean Computer Game Society, 31(3), 37-45.
3 Belongie, S., Malik, J., and Puzicha, J. (2002). Shape Matching and Object Recognition using Shape Contexts, IEEE Transactions on PAMI, 25(4), 509-522.   DOI
4 Cao, Z., Simon, T., Wei, S. E., and Sheikh, Y. (2017). Realtime Multi-person 2d Pose Estimation using Part Affinity Fields, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291-7299.
5 Han, X., Wu, Z., Wu, Z., Yu, R., and Davis, L. S. (2018). Viton: An Image-based Virtual Try-on Network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7543-7552.
6 Liang, X., Gong, K., Shen, X., and Lin, L. (2018). Look into Person: Joint Body Parsing & Pose Estimation Network and a New Benchmark. IEEE Transactions on PAMI, 41(4), 871-885.   DOI
7 Raj, A., Sangkloy, P., Chang, H., Lu, J., Ceylan, D., and Hays, J. (2018). Swapnet: Garment Transfer in Single View Images, Proceedings of the European Conference on Computer Vision, pp. 666-682.
8 Wang, B., Zheng, H., Liang, X., Chen, Y., Lin, L., and Yang, M. (2018). Toward Characteristic-preserving Image-based Virtual Try-on Network, Proceedings of the European Conference on Computer Vision, pp. 589-604.
9 Weng, C. Y., Curless, B., and Kemelmacher-Shlizerman, I. (2019). Photo Wake-up: 3d Character Animation from a Single Photo, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5908-5917.
10 Zanfir, M., Popa, A. I., Zanfir, A., and Sminchisescu, C. (2018). Human Appearance Transfer, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5391-5399.