Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Infants Music Education Application Using Augmented Reality

  • Received : 2017.12.08
  • Accepted : 2018.01.05
  • Published : 2018.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

Augmented Reality (AR) technology has rapidly been applied to various application areas including e-learning and e-education. Focusing on the design and development of android tablet application, this study targeted to develop infant music education using AR technology. We used a tablet instead of personal computer because it is more easily accessible and more convenient. Our system allows infant users to play with teaching aids like blocks or puzzles to mimic musical play like game. The user sets the puzzle piece on the playground in front of the tablet and presses the play button. Then, the system extracts a region of interest among the images acquired by internal camera and separates the foreground image from the background image. The block recognition software analyzes, recognizes and shows the result using AR technology. In order to have reasonably working recognition ratio, we did experiments with more than 5,000 frames of actual playing scenarios. We found that the recognition rate can be secured up to 95%, when the threshold values are selected well using various condition parameters.

Keywords

References

  1. M. Ulas, S.M. Tasci, and S. Ulas, "Augmented Reality and Application Sample on Education," International Journal of Advances in Software Engineering and Research Methodology, Vol. 2, No. 1, pp. 44-46, 2015.
  2. M. Ulas and S. Tasci, "A Review About Augmented Reality Tools And Developing A Virtual Reality Application Based On Education," Academic Journal of Science, Vol. 2, No. 3, pp. 139-146, 2014.
  3. D.J. Johnson and H.R. Myklebust, Learning Disabilities: Educational Principles and Practices, Grune and Stratton, New York, 1967.
  4. R.A. Duschl and J. Osborne, "Supporting and Promoting Argumentation Discourse in Science Education," Studies in Science Education, Vol. 38, No. 38, p. 39-72, 2002. https://doi.org/10.1080/03057260208560187
  5. M. Felder and L. Silverman, "Learning and Teaching Styles in Engineering Education," Proceeding of Frontiers in Education Conference, Vol. 78, No. 7, pp. 674-681, 1988.
  6. J. Luo and D. Crandall, "Color Object Detection Using Spatial-Color Joint Probability Functions," Institute of Electrical and Electronics Engineers Transactions on Image Processing, Vol. 15, No. 6, pp. 1443-1453, 2006.
  7. K.J. Lee, “A Study on Gesture Recognition Using Edge Orientation Histogram and HMM,” Korea Institute of Information and Communication Engineering, Vol. 15, No. 12, pp. 2648-2654, 2011.
  8. D.G. Lowe, "Distinctive Image Features From Scale-Invariant Keypoints," International Journal of Computer Vision, Vol. 60, No. 2, pp. 91-110, 2004 https://doi.org/10.1023/B:VISI.0000029664.99615.94
  9. H. Bay, E. Andreas, T. Tuytelaars, and L.V. Gool, "Speeded-up Robust Features," Computer Vision and Image Understanding, Vol 110, No. 3, pp 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  10. E. Rublee, V. Rabaud, and K. Konolige, "ORB: An Efficient Alternative to SIFT or SURF," Proceeding of Computer Vision and 2011 Institute of Electrical and Electronics Engineers International Conference, pp. 2564-2571, 2011.
  11. L. Stefan, M. Chli, and R.Y. Siegwart, "BRISK: Binary Robust Invariant Scalable Keypoints," Proceedings of Institute of Electrical and Electronics Engineers International Conference on Computer Vision, pp. 2548-2555, 2011.
  12. T.R. Park, “Implementation of Real Time Based Multi-Object Recognition Algorithm,” Journal of Institute of Korean Electrical and Electronics Engineers, Vol. 17, No. 1, pp. 51-56, 2013.
  13. Y.H. Cho, “Shape Image Recognition by Using Histogram-Based Correlation,” Korean Institute of Intelligent Systems, Vol. 20, No. 4, pp. 548-553, 2010. https://doi.org/10.5391/JKIIS.2010.20.4.548
  14. M. Resnick, J. Maloney, A. Monroy-hernadez, N. Rusk, E. Eastmond, K. Brennan, et al, "Scratch: Programming for All," Communication of Association for Computing Machinery, Vol. 52, No. 11, pp. 60-67, 2009.
  15. S. Meeklai, K. Obara, K. Sripraprutchai, Y. Hirai, and K. Kanekoa, "Development Of A Programming Experience System By Using Operation Cards," Proceedings of ISERD International Conference, pp. 31-37, 2016.
  16. A. Boyaci and M. Ulas, "Augmented Reality Based Expert Learning Assistant Model," Proceedings of 66th The International Institute of Engineers and Researchers International Conference, pp. 4-7, 2016.
  17. M. Kim, "Image Retrieval Using Histogram Refinement Based on Local Color Difference," Journal of Korea Multimedia Society, Vol. 18, No. 12, pp. 1453-1461, 2015. https://doi.org/10.9717/kmms.2015.18.12.1453
  18. S.H. Ko, M.H. Yang, S.H. Oh, S.H. Hong, and S.S. Hwang, "Image Matching-based Mobile Application Providing Indoor Place Information," Journal of Korea Multimedia Society, Vol. 19, No. 8, pp. 1424-1432, 2016. https://doi.org/10.9717/kmms.2016.19.8.1424

Cited by

  1. Evaluation of the Effect of Educational Smartphone App for Nursing Students vol.7, pp.2, 2018, https://doi.org/10.17703/ijact.2019.7.2.60