A Study on Online Real-Time Strategy Game by using Hand Tracking in Augmented Reality

  • Jeon, Gwang-Ha (Department of Multimedia Engineering, Hansung University) ;
  • Um, Jang-Seok (Department of Multimedia Engineering, Hansung University)
  • Published : 2009.12.30

Abstract

In this paper, we implemented online real time strategy game using hand as the mouse in augmented reality. Also, we introduced the algorithm for detecting hand direction, finding fingertip of the index finger and counting the number of fingers for interaction between users and the virtual objects. The proposed method increases the reality of the game by combining the real world and the virtual objects. Retinex algorithm is used to remove the effect of illumination change. The implementation of the virtual reality in the online environment enables to extend the applicability of the proposed method to the areas such as online education, remote medical treatment, and mobile interactive games.

Keywords

References

  1. ARToolKit, http://www.hitl.washington.edu/artoolkit
  2. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, "Pose tracking from natural features on mobile phones," Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, 125-134, 2008.
  3. Andrew J. Davison, lan D. Reid, Nicholas D. Molton, and Olivier Stasse, "MonoSLAM: Real-Time Single Camera SLAM," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.29, No.6, June 2007.
  4. G. Klein and D. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," Proc. International Symposium on Mixed and Augmented Reality (ISMAR'07), Nara, 2007.
  5. JinKook Kim and Jongwon Lee, "Board Game Framework in AR," Journal of Information Science and Engineering (Korean), Vol.26, No.3, pp. 40-45, 2008. 3.
  6. H. Jones and M. Snyder, "Supervisory control of Multiple Robots Based on a Real-Time Strategy Game Interaction Paradigm.," IEEE International Conference on Systems, Man, and Cybernetics, Vol.1, pp. 383-388, 2001.
  7. Kil, Hyejin and Yi, Juneho, "Real-Time Skin Co;or Segmentation Using a Retinex Algorithm and Principle Component Analysis," Journal of Sungkyunkwan University, Science and Tecnology, Vol.53, No.2, pp. 19-34, 2002.
  8. F. Gasparini and R. Schettini, "Skin segmentation using multiple thresholding," Proceedings of the SPlE - The international Society for Optical Engineering, Vol.6061, pp. 60610F, 2006.
  9. G. Raphael, B. Laurence, G. Jean-Dominique, and D. Schmalstieg, "Interactive Mediated Reality," Proceedings et the Sixth Australasian conference on User interface, Vol.40, pp. 21-29, 2005.
  10. Squire, Kurt D. Jan, and Mingfong, "Mad City Mystery: Developing Scientific Argumentation Skills with a Place-based Augmented Reality Game on Handheld Computers," Journal of science education and technology, Vol.16 No.1, pp. 5-29, 2007. https://doi.org/10.1007/s10956-006-9037-z
  11. Won Hyung Kang, "A study on Handheld Game System in Augmented Reality using Dynamic Environment," KAIST, Master thesis, 2007.