Browse > Article
http://dx.doi.org/10.9723/jksiis.2018.23.6.029

Online Virtual Try On using Mannequin Cloth Pictures  

Ahn, Heejune (서울과학기술대학교 전기정보공학과)
Publication Information
Journal of Korea Society of Industrial Information Systems / v.23, no.6, 2018 , pp. 29-38 More about this Journal
Abstract
In this paper, we developed a virtual cloth try-on (VTON) technology that segement the cloth image worn on the mannequin and applies it to the user 's photograph. The two-dimensional image-based virtual wear study which does not require three-dimensional information of cloth and model is of practical value, but the research result shows that there are limitations of of the current technology for the problem of occlusion or distortion. In this study, we proposed an algorithm to apply the results obtained from the DNN- based segmentation and posture estimation to the user 's photograph, assuming that the mannequin cloth reduces the difficulties in this part. In order to improve the performance compared with the existing one, we used the validity check of the pre-attitude information, the improvement of the deformation using the outline, and the improvement of the divided area. As a result, a significantly improved result image of more than 50% was obtained.
Keywords
VTON; Deep Learning; Mannequin; Segmentation; Deformation;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Yamaguchi, K., Kiapour, M. H., Ortiz, L. E., and Berg, T. L., "Parsing Clothing in Fashion Photographs," in Proc. of Computer Vision and Pattern Recognition (CVPR), 2012.
2 Yamaguchi, K., Kiapour, M. H., and Berg, T. L., "Paper Doll Parsing: Retrieving Similar Styles to Parse Clothing Items," in Proc. of International Conference Computer Vision (ICCV), 2013.
3 Kim, J., and Forsythe, S., "Adoption of Virtual Try-on Technology for Online Apparel Shopping," Journal of Interactive Marketing, Vol. 22, No. 2, pp. 45-59, 2008.   DOI
4 Liang, X., Liu, S., Shen, X., Yang, J., Liu, L., Dong, J., and Yan, S., "Deep Human Parsing with Active Template Regression," IEEE Tran. on Pattern Analysis and Machine Intelligence, Vol. 37, No. 12, pp. 2402-2414, 2015.   DOI
5 Ahn, H., "Image-Based Virtual Try-On System," J. of Korean Computer Game Society, Vol. 31, No 3, pp. 37-45, 2018.
6 Johnson S., and Everingham, M., "Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation," In Proc. of the 21st British Machine Vision Conference (BMVC2010, 2010.
7 Andriluka, M., Pishchulin, L., Gehler, P., and Bernt, S., "2D Human Pose Estimation: New Benchmark and State of the Art Analysis," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
8 Long, J., Shelhamer, E., and Darrell, T., "Fully Convolutional Networks for Semantic Segmentation," In Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3431-3440, 2015.
9 Vijay, B., Kendall, A., and Cipolla, R., "Segnet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 12, pp. 2481-2495, 2017.   DOI
10 Krahenbuhl, P. and Koltun, V., "Efficient Inference in Fully Connected Crfs with Gaussian Edge Potentials," In Advances in Neural Information Processing Systems, 2011.
11 Insafutdinov, E., Pishchulin, L., Andres, B., Andriluka, M., and Schiele, B., "DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model," In European Conference on Computer Vision (ECCV), 2016.
12 Insafutdinov, E., Andriluka, M., Pishchulin, L., Tang, S., Levinkov, E., Andres, B., and Schiele, B., "ArtTrack: Articulated Multi-person Tracking in the Wild," In Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
13 Bookstein, F. L., "Principal Warps: Thin-Plate Splines and the Decomposition of Deformations," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, No. 6, pp. 567-585, 1989.   DOI
14 Baudisch, P., and Gutwin, C., "Multiblending: Displaying Overlapping Windows Simultaneously without the Drawbacks of Alpha Blending," In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ACM, pp. 367-374, 2004.
15 Igarashi, T., Moscovich, T., and Hughes, J. F., "As-Rigid-as-possible Shape Manipulation," ACM Transactions on Graphics, Vol. 24, No. 3, pp. 1134-1141, 2005.   DOI
16 Kim, N., Yoon, J. C., and Lee, I. K., "Image-Based Dress up System," In ACM SIGGRAPH'09, pp. 35, 2009.
17 Rother, C., Kolmogorov, V., and Blake, A., "Grabcut: Interactive Foreground Extraction Using Iterated Graph Cuts," In ACM Transactions on Graphics (TOG), Vol. 23, No. 3, pp. 309-314, 2004.   DOI
18 Wang, B., Zheng, H., Liang, X., Chen, Y., Lin, L., and Yang, M., "Toward Characteristic-Preserving Image-Based Virtual Try-On Network," In Proc. of the European Conference on Computer Vision (ECCV), pp. 589-604, 2018.
19 Lee, J. H., Kim, B. M., and Shin, Y. S., "Effects of Preprocessing and Feature Extraction on CNN-Based Fire Detection Performance," J. Korea Industrial Information System Research, Vol. 23, No. 4, pp. 41-53, 2018.   DOI
20 Kim, D. H. Choi, S. W., and Kwak, S. Y., "Deep Learning Based Fake Face Detection," J. Korea Industrial Information System Research, Vol. 23, No. 5, pp. 9-17, 2018.   DOI
21 Ahn, H., "A Study on Compression of Connections in Deep Artificial Neural Networks," J. Korea Industrial Information System Research, Vol. 22, No. 5. pp. 17-24, 2017.   DOI