Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Augmented Reality Authoring Tool with Marker & Gesture Interactive Features

마커 및 제스처 상호작용이 가능한 증강현실 저작도구

  • 심진욱 (연세대학교 컴퓨터과학과) ;
  • 공민제 (연세대학교 컴퓨터과학과) ;
  • 김하영 (연세대학교 컴퓨터과학과) ;
  • 채승호 (연세대학교 컴퓨터과학과) ;
  • 정경호 (연세대학교 컴퓨터과학과) ;
  • 서종훈 (연세대학교 컴퓨터과학과) ;
  • 한탁돈 (연세대학교 컴퓨터과학과)
  • Received : 2013.03.18
  • Accepted : 2013.04.16
  • Published : 2013.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.

본 논문에서는 사용자들이 손쉽게 마커기반과 제스처 상호작용 방법들을 적용한 증강현실 콘텐츠를 제작할 수 있는 증강현실 저작도구 시스템을 제안한다. 기존의 증강현실 저작도구들은 가상의 객체를 증강하는데 초점이 맞춰져 있었고, 이러한 증강현실 콘텐츠와 상호작용을 하기 위해서는 사용자가 마커나 센서를 이용하는 방법을 사용하였다. 우리는 이러한 제한적인 상호작용 방법의 문제점을 마커기반 상호작용 방법과 깊이 인식 카메라인 Kinect를 사용한 제스처 상호작용 방법을 적용시킴으로써 해결하고자 한다. 제안하는 시스템에서는 사용자가 인터페이스를 통하여 간단한 형태의 마커기반 증강현실 콘텐츠를 쉽게 제작할 수 있다. 또한, 능동적으로 사용자가 증강현실 콘텐츠와 상호작용할 수 있는 방법들을 제공하고 있다. 본 연구에서 제공하는 상호작용 방법으로는 마커기반의 상호작용 방법으로 2개의 마커를 이용한 방법과 마커의 가림현상(Occlusion)을 이용한 방법이 있다. 그리고 사용자의 맨손을 인식, 추적하여 객체의 확대 축소, 이동, 회전이 가능한 제스처 상호작용 방법을 제공한다. 저작도구 시스템에 대한 사용성 평가와 마커 및 제스처 상호작용에 대한 사용성을 비교평가하여, 본 연구의 긍정적 결과를 확인하였다.

Keywords

References

  1. R.T. Azuma, "A Survey of Augmented Reality," Teleoperators and Virtual Environments, Vol. 6, No. 4, pp. 355-385, 1997. https://doi.org/10.1162/pres.1997.6.4.355
  2. H. Kaufmann, "Collaborative Augmented Reality in Education," Position paper for keynote speech at Imagina 2003 Conference, 2003.
  3. A. Dunser, "Supporting Low Ability Readers With Interactive Augmented Reality," Annual Review of CyberTherapy and Telemedicine: Changing the Face of Healthcare, Interactive Media Institute, Vol. 6, pp. 41-48, 2008.
  4. R. Moreno, R.E. Mayer, H.A. Spires, and J.C. Lester, "The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When they Interact with Animated Pedagogical Agents?," Cognition and Instruction, Vol. 19, No. 2, pp. 177-213, 2001. https://doi.org/10.1207/S1532690XCI1902_02
  5. D. Wagner, D. Schmalstieg, and H. Bischof, "Multiple Target Detection and Tracking with Guaranteed Framerates on Mobile Phones," Proc. of the 8th IEEE/ACM Int. Symposium on Mixed and Augmented Reality (ISMAR '09), pp. 57-64, 2009.
  6. K. Kim, V. Lepetit, and W. Woo, "Scalable Real-Time Planar Targets Tracking for Digilog Books," The Visual Computer, Vol. 26, No. 6-8, pp. 1145-1154, 2010. https://doi.org/10.1007/s00371-010-0490-6
  7. ARToolKit, http://www.hitl.washington.edu/artoolkit/, 2007.
  8. ARToolKit plus, http://handheldar.icg.tugraz.at/artoolkitplus.php, 2011.
  9. Y. Wang, T. Langlotz, M. Billinghurst, and T. Bell, "An Authoring Tool for Mobile Phone AR Environments," Proc. of the New Zealand Computer Science Research Student Conference 09, pp. 1-4, 2009.
  10. R. Grasset, J. Looser, and M. Billibghurst, "OSGARToolKit: Tangible+Transitional 3D Collaborative Mixed Reality Framework," 15th Int. Conf. on Artificial Reality and Telexistence (ICAT 2005), pp. 5-8, 2005.
  11. B. Maclntyre, M. Gandy, S. Dow, and J.D. Bolter, "DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences," Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology, pp. 197-206, 2004.
  12. H. Kaufmann and D. Schmalstieg, "Mathematics and Geometry Education with Collaborative Augmented Reality," Computer & Graphics, Vol. 27, No. 3, pp. 339-345, 2003. https://doi.org/10.1016/S0097-8493(03)00028-1
  13. H. Seichter, J. Looser, and M. Billinghurst, "ComposAR: An Intuitive Tool for Authoring AR Applications," Proc. of the 7th IEEE/ACM Int. Symposium on Mixed and Augmented Reality, pp. 177-178, 2008.
  14. Qualcomm AR SDK, https://ar.qualcomm.at/qdevnet/, 2011
  15. S.C. Yuen, G. Yaiyuneyoung, and E. Johson, "Augmented Reality: An Overview and Five Directions for AR in Education," Journal of Educational Technology Development and Exchange, Vol. 4, No. 1, pp. 119-140, 2011.
  16. H. Kato, M. Billinghurst, I. Poupyev, K. Inamoto, and K. Tachibana, "Virtual Object Manipulation on a Table-top AR Environment," Proc. of the IEEE/ACM Int. Symposium on Augmented Reality, pp. 111-119, 2000.
  17. B.H. Thomas and W. Piekarski, "Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment," Virtual Reality: Research, Development, and Application, Vol. 6, No. 3, pp. 167-180, 2002. https://doi.org/10.1007/s100550200017
  18. K. Dorfmuller-Ulhaas and D. Schmalstieg, "Finger Tracking for Interaction in Augmented Environments," Proc. of the IEEE/ACM Int. Symposium on Augmented Reality, pp. 55-64, 2001.
  19. T. Lee and T. Hollerer, "Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking," 2007 11th Int. Symposium on Wearable Computers, pp. 83-90, 2007.
  20. J. Shim, J. Seo, and T.D. Han, "MSL_ARToolKit: AR Authoring tool with Interactive features," Virtual and Mixed Reality-New Trends, Lecture Notes in Computer Science, Vol. 6773, pp. 105-112, 2011. https://doi.org/10.1007/978-3-642-22021-0_13
  21. P. Tissainayagam and D. Suter, "Assessing the Performance of Coner Detectors for Point Feature Tracking Applications," Image and Vision Computing, Vol. 22, No. 8, pp. 663-679, 2004. https://doi.org/10.1016/j.imavis.2004.02.001
  22. F. Dadgostar and A. Sarrafzadeh, "An Adaptive Real-time Skin Detector based on Hue Thresholding: A Comparison on two motion tracking methods," Pattern Recognition Letters, Vol. 27, No. 12, pp. 1342-1352, 2006. https://doi.org/10.1016/j.patrec.2006.01.007
  23. J. Segen and S. Kumar, "Human-Computer Interaction using Gesture Recognition and 3D Hand Tracking," Int. Conf. on Image Processing, Vol. 3, pp. 188-192, 1998.
  24. J. Nilsen and R. Molich, "Heuristic Evaluation of User Interfaces," Proc. of the Conf. on Human Factors in Computing Systems, pp. 249-256, 1990.
  25. 최광운, 정다운, 이석한, 최종수, "손동작을 이용한 상호작용 증강현실 시스템," 멀티미디어학회 논문지, 제15권, 제4호, pp. 425-438, 2012. https://doi.org/10.9717/kmms.2012.15.4.425
  26. P. Garg, N. Aggarwal, and S. Sofat, "Vision Based Hand Gesture Recognition," World Academy of Science, Engineering and Technology, Vol. 49, pp. 972-977, 2009.

Cited by

  1. Design and Implementation of Interactive Authoring Tool for Mobile Augmented Reality Content vol.16, pp.4, 2015, https://doi.org/10.7472/jksii.2015.16.4.25
  2. A Study on Training System for Fire Prevention based on Virtual Reality vol.17, pp.3, 2016, https://doi.org/10.9728/dcs.2016.17.3.189