Browse > Article
http://dx.doi.org/10.9717/kmms.2013.16.6.720

Augmented Reality Authoring Tool with Marker & Gesture Interactive Features  

Shim, Jinwook (연세대학교 컴퓨터과학과)
Kong, Minje (연세대학교 컴퓨터과학과)
Kim, Hayoung (연세대학교 컴퓨터과학과)
Chae, Seungho (연세대학교 컴퓨터과학과)
Jeong, Kyungho (연세대학교 컴퓨터과학과)
Seo, Jonghoon (연세대학교 컴퓨터과학과)
Han, Tack-Don (연세대학교 컴퓨터과학과)
Publication Information
Journal of Korea Multimedia Society / v.16, no.6, 2013 , pp. 720-734 More about this Journal
Abstract
In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.
Keywords
Augmented Reality; Authoring tool; Marker; Hand Gesture; Interaction;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R.T. Azuma, "A Survey of Augmented Reality," Teleoperators and Virtual Environments, Vol. 6, No. 4, pp. 355-385, 1997.   DOI
2 H. Kaufmann, "Collaborative Augmented Reality in Education," Position paper for keynote speech at Imagina 2003 Conference, 2003.
3 A. Dunser, "Supporting Low Ability Readers With Interactive Augmented Reality," Annual Review of CyberTherapy and Telemedicine: Changing the Face of Healthcare, Interactive Media Institute, Vol. 6, pp. 41-48, 2008.
4 R. Moreno, R.E. Mayer, H.A. Spires, and J.C. Lester, "The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When they Interact with Animated Pedagogical Agents?," Cognition and Instruction, Vol. 19, No. 2, pp. 177-213, 2001.   DOI   ScienceOn
5 D. Wagner, D. Schmalstieg, and H. Bischof, "Multiple Target Detection and Tracking with Guaranteed Framerates on Mobile Phones," Proc. of the 8th IEEE/ACM Int. Symposium on Mixed and Augmented Reality (ISMAR '09), pp. 57-64, 2009.
6 K. Kim, V. Lepetit, and W. Woo, "Scalable Real-Time Planar Targets Tracking for Digilog Books," The Visual Computer, Vol. 26, No. 6-8, pp. 1145-1154, 2010.   DOI
7 ARToolKit, http://www.hitl.washington.edu/artoolkit/, 2007.
8 ARToolKit plus, http://handheldar.icg.tugraz.at/artoolkitplus.php, 2011.
9 Y. Wang, T. Langlotz, M. Billinghurst, and T. Bell, "An Authoring Tool for Mobile Phone AR Environments," Proc. of the New Zealand Computer Science Research Student Conference 09, pp. 1-4, 2009.
10 R. Grasset, J. Looser, and M. Billibghurst, "OSGARToolKit: Tangible+Transitional 3D Collaborative Mixed Reality Framework," 15th Int. Conf. on Artificial Reality and Telexistence (ICAT 2005), pp. 5-8, 2005.
11 B. Maclntyre, M. Gandy, S. Dow, and J.D. Bolter, "DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences," Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology, pp. 197-206, 2004.
12 H. Kaufmann and D. Schmalstieg, "Mathematics and Geometry Education with Collaborative Augmented Reality," Computer & Graphics, Vol. 27, No. 3, pp. 339-345, 2003.   DOI   ScienceOn
13 H. Seichter, J. Looser, and M. Billinghurst, "ComposAR: An Intuitive Tool for Authoring AR Applications," Proc. of the 7th IEEE/ACM Int. Symposium on Mixed and Augmented Reality, pp. 177-178, 2008.
14 Qualcomm AR SDK, https://ar.qualcomm.at/qdevnet/, 2011
15 S.C. Yuen, G. Yaiyuneyoung, and E. Johson, "Augmented Reality: An Overview and Five Directions for AR in Education," Journal of Educational Technology Development and Exchange, Vol. 4, No. 1, pp. 119-140, 2011.
16 H. Kato, M. Billinghurst, I. Poupyev, K. Inamoto, and K. Tachibana, "Virtual Object Manipulation on a Table-top AR Environment," Proc. of the IEEE/ACM Int. Symposium on Augmented Reality, pp. 111-119, 2000.
17 B.H. Thomas and W. Piekarski, "Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment," Virtual Reality: Research, Development, and Application, Vol. 6, No. 3, pp. 167-180, 2002.   DOI
18 K. Dorfmuller-Ulhaas and D. Schmalstieg, "Finger Tracking for Interaction in Augmented Environments," Proc. of the IEEE/ACM Int. Symposium on Augmented Reality, pp. 55-64, 2001.
19 T. Lee and T. Hollerer, "Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking," 2007 11th Int. Symposium on Wearable Computers, pp. 83-90, 2007.
20 J. Shim, J. Seo, and T.D. Han, "MSL_ARToolKit: AR Authoring tool with Interactive features," Virtual and Mixed Reality-New Trends, Lecture Notes in Computer Science, Vol. 6773, pp. 105-112, 2011.   DOI   ScienceOn
21 P. Tissainayagam and D. Suter, "Assessing the Performance of Coner Detectors for Point Feature Tracking Applications," Image and Vision Computing, Vol. 22, No. 8, pp. 663-679, 2004.   DOI   ScienceOn
22 F. Dadgostar and A. Sarrafzadeh, "An Adaptive Real-time Skin Detector based on Hue Thresholding: A Comparison on two motion tracking methods," Pattern Recognition Letters, Vol. 27, No. 12, pp. 1342-1352, 2006.   DOI   ScienceOn
23 J. Segen and S. Kumar, "Human-Computer Interaction using Gesture Recognition and 3D Hand Tracking," Int. Conf. on Image Processing, Vol. 3, pp. 188-192, 1998.
24 J. Nilsen and R. Molich, "Heuristic Evaluation of User Interfaces," Proc. of the Conf. on Human Factors in Computing Systems, pp. 249-256, 1990.
25 최광운, 정다운, 이석한, 최종수, "손동작을 이용한 상호작용 증강현실 시스템," 멀티미디어학회 논문지, 제15권, 제4호, pp. 425-438, 2012.   과학기술학회마을   DOI   ScienceOn
26 P. Garg, N. Aggarwal, and S. Sofat, "Vision Based Hand Gesture Recognition," World Academy of Science, Engineering and Technology, Vol. 49, pp. 972-977, 2009.