Browse > Article

Vision-based Motion Control for the Immersive Interaction with a Mobile Augmented Reality Object  

Chun, Jun-Chul (경기대학교 컴퓨터과학과)
Publication Information
Journal of Internet Computing and Services / v.12, no.3, 2011 , pp. 119-129 More about this Journal
Abstract
Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.
Keywords
Mobile Augmented Reality; Morker-less AR; Marker-based AR; Rotating Calipers Algorithm; Hand Tracking;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Shamos, M.I. "Computational geometry", Yale University, PhD. thesis, 1978.
2 Z. Zhang, "A flexible new technique for camera calibration", IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 22, No.11, pp. 1330-1334, 2000.   DOI   ScienceOn
3 G. Borgefors, "Distance transformations in digital images," Computer Vision, Graphics and Image Processing, Vol. 34, pp. 344-371, 1986   DOI   ScienceOn
4 Lee, T. and Hollerer, T., "Initializing Markerless Tracking Using a Simple Hand Gesture", In Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 1-2, 2007.
5 Lee, T. and Hollerer, T.,"Hybrid Feature Tracking and User Interaction for Markerless Augment Reality", In IEEE Int'l Conference on Virtual Reality, pp. 145-152, 2008.
6 Lee, B and Chun, J, "Interactive manipulation of augmented objects in marker-less AR using vision-based hand mouse", In Int'l Conference on Information Technology, pp. 398-403, 2010.
7 D. Stricker, D. Klinker and D. Reiners, "A fast and robust line-based optical tracker for augmented reality application", In Proceedings on 1st IEEE International Workshop on Augmented Reality, pp. 31-46, 1998.
8 Chun, J and Lee, B, "Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands", TIIS Vol. 4, No.4, pp. 618-632, 2010.
9 G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces", In Proceedings of 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225-234, 2007.
10 D. Wagner and D. Schmalstieg, "ARToolKitPlus for Pose Tracking on Mobile Devices", In Proc. of 12th Computer Vision Winter Workshop, pp. 139-146, 2007.
11 J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani and M. Ivkovic, "Augmented reality, technologies, systems, and applications", Multimedia Tools and Applications, Vol 51, Issue 1, pp. 341-377, 2011.   DOI   ScienceOn
12 Y. Cho, J. Lee and U. Neumann, "A multi-ring fiducial system and an intensityinvariant detection method for scalable augment reality", In Proceedings on 1st IEEE International Workshop on Augmented Reality, pp.147-156, 1998.
13 S. Vogt, A. Khamene, F. Sauer and H. Niemann, "Single camera tracking of marker clusters: Multiparameter cluster optimization and experimental verification", In Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 127-136, 2002.
14 Lee, T. and Hollerer, T., "Hand AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking", In Proceedings of IEEE International Symposium on Wearable Computers, pp. 83-90, 2007.
15 Min, K, Chun, J and Park, G, "A Nonparametric Skin Color Model for Face Detection from Color Images", LNCS Vol. 3320, pp. 115-119, 2004.
16 D.W.F. van Krevelen and R. Poelman, "A survey of Augmented Reality Technologies, Applications, and Limitations", The Intl. Journal of Virtual Reality, Vol 9. No. 2, pp. 1-20, 2010.
17 M. Fiala, "ARTag, a fiducial marker system using digital techniques", In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol 2, pp. 590-596, 2005.
18 H. Kato and M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system", In Proceedings on 2nd IEEE International Workshop on Augmented Reality, pp. 85-94, 1999.
19 G. Klein and D. Murray, "Parallel Tracking and Mapping on a Camera Phone" In Proceedings of IEEE International Symposium on Mixed and Augmented Reality, pp. 83-86, 2009.
20 D. Wagner, G. Reitmayr, A. Mulloni, Tom Drummond4, Dieter Schmalstieg, "Pose Tracking from Natural Features on Mobile Phones", In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 125 - 134, 2008.