Browse > Article
http://dx.doi.org/10.9728/dcs.2017.18.8.1509

Automatic Arm Region Segmentation and Background Image Composition  

Kim, Dong Hyun (Dept. of Computer Science and CCBM, Graduate School, Gyeongsang Nat'l University)
Park, Se Hun (Dept. of Computer Science and CCBM, Graduate School, Gyeongsang Nat'l University)
Seo, Yeong Geon (Dept. of Computer Science and CCBM, Graduate School, Gyeongsang Nat'l University)
Publication Information
Journal of Digital Contents Society / v.18, no.8, 2017 , pp. 1509-1516 More about this Journal
Abstract
In first-person perspective training system, the users needs realistic experience. For providing this experience, the system should offer the users virtual and real images at the same time. We propose an automatic a persons's arm segmentation and image composition method. It consists of arm segmentation part and image composition part. Arm segmentation uses an arbitrary image as input and outputs arm segment or alpha matte. It enables end-to-end learning because we make use of FCN in this part. Image composition part conducts image combination between the result of arm segmentation and other image like road, building, etc. To train the network in arm segmentation, we used arm images through dividing the videos that we took ourselves for the training data.
Keywords
Arm region; Arm segmentation; Background composition; FCN;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 M. Abadi et al, "TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems", 2016.
2 M. Cha et al, "A virtual reality based fire training simulator integrated with fire dynamics data", Fire Safety Journal, Vol. 50, pp. 12-24, 2012.   DOI
3 Q. Kennedy et al, "Age and Expertise Effects in Aviation Decision Making and Flight Control in a Flight Simulator", Aviation, Space, and Environmental Medicine, Vol. 81, No. 5, pp. 489-497, 2010.   DOI
4 P. Backlund et al, "Games for traffic education: An experimental study of a game-based driving simulator", Simulation & Gaming, Vol. 41, No. 2, pp. 145-169, 2010.   DOI
5 P. Salamin et al, "Quantifying effects of exposure to the third and first-person perspectives in virtual-reality-based training", IEEE Transactions on Learning Technologies, Vol. 3, No. 3, pp. 272-276, 2010.   DOI
6 F. S. Dean, P. Garrity and C. B. Stapleton, "Mixed reality: A tool for integrating live, virtual and constructive domains to support training transformation", The Interservice/Industry Training, Simulation and Education Conference (I/ITSEC), 2004.
7 A. Levin, D. Lischinski and Y. Weiss, "A closed-form solution to natural image matting", IEEE Trans. Pattern Anal. Mach. Intell., Vol. 30, No. 2, pp. 228-242, 2008.   DOI
8 Q. Chen, D. Li and C. Tang, "KNN matting", IEEE Trans. Pattern Anal. Mach. Intell., Vol. 35, No. 9, pp. 2175-2188, 2013.   DOI
9 D. Cho, Y. Tai and I. Kweon, "Natural image matting using deep convolutional neural networks", European Conference on Computer Vision, pp. 626-643, 2016.
10 N. Xu et al, "Deep Image Matting", Available: http://arxiv.org/abs/1703.03872, 2017.
11 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition", 2014.
12 X. Shen et al, "Automatic Portrait Segmentation for Image Stylization", Computer Graphics Forum, Vol. 35, No. 2, pp. 93-102, 2016.   DOI
13 X. Shen et al, "Deep automatic portrait matting," European Conference on Computer Vision, pp. 92-107, 2016.
14 A. Krizhevsky, I. Sutskever and G. E. Hinton, "Imagenet classification with deep convolutional neural networks", Advances in Neural Information Processing Systems, pp. 1097-1105, 2012.
15 J. Long, E. Shelhamer and T. Darrell, "Fully convolutional networks for semantic segmentation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431-3440, 2015.
16 H. Noh, S. Hong and B. Han, "Learning deconvolution network for semantic segmentation", Proceedings of the IEEE International Conference on Computer Vision, pp. 1520-1528, 2015.
17 J. Redmon et al, "You only look once: Unified, real-time object detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779-788, 2016.
18 Y. Lecun et al, "Gradient-based learning applied to document recognition", Jproc, Vol. 86, No. 11, pp. 2278-2324, 1998.
19 S. Jang and H. Jang, "Training Artificial Neural Networks and Convolutional Neural Networks Using WFSO Algorithm", Journal of Digital Contents Society, Vol. 18, No. 5, pp. 969-976, 2017.   DOI
20 D. P. Kingma and J. Ba, "Adam: A Method for Stochastic Optimization", 2014.