Browse > Article
http://dx.doi.org/10.7315/CADCAM.2014.111

Construction of Skin Color Map for Resolving Hand Occlusion in AR Environments  

Park, Sang-Jin (Department of Industrial Engineering, Chosun University)
Park, Hyungjun (Department of Industrial Engineering, Chosun University)
Publication Information
Korean Journal of Computational Design and Engineering / v.19, no.2, 2014 , pp. 111-118 More about this Journal
Abstract
In tangible augmented reality (AR) environments, the user interacts with virtual objects by manipulating their physical counterparts, but he or she often encounters awkward situations in which his or her hands are occluded by the augmented virtual objects, which causes great difficulty in figuring out hand positions, and reduces both immersion and ease of interaction. To solve the problem of such hand occlusion, skin color information has been usefully exploited. In this paper, we propose an approach to simple and effective construction of a skin color map which is suitable for hand segmentation and tangible AR interaction. The basic idea used herein is to obtain hand images used in a target AR environment by simple image subtraction and to represent their color information by a convex polygonal map in the YCbCr color space. We experimentally found that the convex polygonal map is more accurate in representing skin color than a conventional rectangular map. After implementing a solution for resolving hand occlusion using the proposed skin color map construction, we showed its usefulness by applying it to virtual design evaluation of digital handheld products in a tangible AR environment.
Keywords
Augmented reality interaction; Convex polygon; Hand occlusion; Image processing; Skin color map; YCbCr color space;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Park, H., Moon, H.C. and Lee, J.Y., 2009, Tangible augmented prototyping of digital handheld products, Computers in Industry, 60(2), pp.114-125.   DOI   ScienceOn
2 OpenCV, http://opencv.org/
3 Park, H. and Moon, H.C., 2011, Resolving Hand Region Occlusion in Tangible Augmented Reality Environments, Transactions of the Society of CAD/CAM Engineers, 16(4), pp.227-284.
4 Van Krevelen, D.W.F. and Poelman, R., 2010, A Survey of Augmented Reality Technologies, Applications and Limitations, The International Journal of Virtual Reality, 9(2), pp.1-20.
5 Park, H. and Moon, H.C., 2008, Design Evaluation of Portable Electronic Products Using AR-Based Interaction and Simulation, Transactions of the Society of CAD/CAM Engineers, 13(3), pp.209-216.   과학기술학회마을
6 Yoon, H.S., Sho, J., Bea, C.S., Chun, B.T. and Min, B.W., 1997, Window Manager Control using Hand Gesture Recognition, Workshop of the Institute of Electronics Engineering of Korea, 9(1), pp.264-269.
7 Song, H.S. and Yang, Y.M., 1998, Hand Tracking and Region Extraction based on Optical Flow, Korean Institute of Information Scientists and Engineerings, 25(1), pp.634-644.
8 Tanibata, N., Shimada, N. and Shirai, Y., 2002, Extraction of Hand Features for Recognition of Sign Language Words, Proceedings of International Conference on Vision Interface, pp.391-398.
9 Moghaddam, B. and Pentland, A., 1995, Probabilistic Visual Learning for Object Detection, Proceedings of the 5th International Conference on Computer Vision, pp.786-793.
10 Imagawa, K., Shan, L. and Igi, S., 1996, Color-based Hands Tracking System for Sign Language Recognition, Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, Killington, pp.151-156.
11 Wengun, T., Wu, C., Shuyiong, Z. and Shuo, C., 2009, Hand Extraction Using Geometric Moments Based on Active Skin Color Model, Proceedings of IEEE International Conference on Intelligent Computing and Intelligent Systems, pp.468-471.
12 Lee, W.H. and Park, J., 2005, Augmented Foam: A Tangible Augmented Reality for Product Design, Proceedings of ISMAR, pp.106-109.
13 Chun, J. and Lee, B., 2010, Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands, KSII Transactions on Internet and Information Systems, 4(4), pp.618-632.   과학기술학회마을   DOI   ScienceOn
14 Lee, T. and Hollerer, T., 2007, Handy AR:Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking, Proceedings of IEEE International Symposium on Wearable Computers, pp.83-90.
15 Moon, H.C. and Park, H., 2011, Resolving Hand Region Occlusion in Tangible Augmented Reality Environments, Transactions of the Society of CAD/CAM Engineers, 16(4), pp.277-284.
16 Tan, W., Wu, C., Zhao, S. and Chen, S., 2009, Hand Extraction Using Geometric Moments Based on Active Skin Color Model, Proceedings of IEEE International Conference on Intelligent Computing and Intelligent Systems, pp.468-471.
17 Park, H. and Moon, H.C., 2011, AR-based Tangible Interaction Using a Finger Fixture for Digital Handheld Products, Transactions of the Society of CAD/CAM Engineers, 16(1), pp.1-10.   과학기술학회마을