Journal of Korea Game Society (한국게임학회 논문지)

Korea Game Society (한국게임학회)
권호 표지
DOI QR코드

DOI QR Code

Development of AR-based Coding Puzzle Mobile Application Using Command Placement Recognition

명령어 배치 인식을 활용한 AR 코딩퍼즐 모바일앱 개발

  • 서범주 (홍익대학교 게임학부 게임소프트웨어전공) ;
  • 조성현 (홍익대학교 게임학부 게임소프트웨어전공)
  • Received : 2020.05.11
  • Accepted : 2020.06.07
  • Published : 2020.06.20
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we propose a reliable command placement recognition algorithm using tangible commands blocks developed for our coding puzzle platform, and present its performance measurement results on an Augmented Reality testbed environment. As a result, it can recognize up to 30 tangible blocks simultaneously and their placements within 5 seconds reliably. It is successfully ported to an existing coding puzzle mobile app and can operate an IoT attached robot via bluetooth connected mobile app.

본 연구에서는 현재 운영 중인 코딩교육 플랫폼인 코딩퍼즐 시스템에서 학습자들이 직접 손으로 조작할 수 있는 탠저블 블록형태로 제작된 코딩퍼즐 입력용 명령어들의 배치를 증강현실 환경에서 제한 시간 안에 안정적으로 다수의 블록을 인식할 수 있는 인식시스템의 설계 및 배치 인식 성능 측정 결과를 제시한다. 그 결과, 5초 이내로 30개 이상의 탠저블 블록 형태의 명령어들의 배치를 안정적으로 인식할 수 있었다. 본 인식시스템을 기존 코딩퍼즐 모바일 앱에 성공적으로 이식하였으며, 블루투스에 연동되는 모바일 앱을 통해 IoT 로봇을 구동할 수 있다.

Keywords

References

  1. Beomjoo Seo and Sung Hyun Cho, "Design and Implementation of Students' Coding Assessment System for a Coding Puzzle Game", Journal of Korea Game Society, Journal of Korea Game Society, Vol.18, No.1, pp.7-18, 2018. https://doi.org/10.7583/JKGS.2018.18.1.7
  2. Kyeonbok Park, Sung Hyun Cho, and Beomjoo Seo, "An Observation-based Movement Control for Educational Coding Robots", Journal of Korea Game Society, Vol. 16, No.6, pp.131-142, 2016. https://doi.org/10.7583/JKGS.2016.16.6.131
  3. Hanhoon Park and Jong-il Park, "Trend on Vision-Based Object Recognition and Tracking for Augmented Reality", Communications of the Korea Institute of Information Scientists and Engineers, Vol.34, No.12, pp.8-17, 2016.
  4. Hongfei Wu, Fengjing Shao, and Pencheng Sun, "Research of quickly identifying markers on Augmented Reality",
  5. Daniel Wagner and Dieter Schmalstieg, "ARToolKitPlus for Pose Tracking on Mobile Devices", pp. Computer Vision Winter Workshop, 2007. (저가 mobile device에서 상용하기 위한 ARToolKitPlus)
  6. S. Garrido-Jurado, R. Munoz-Salinas, F.J.Madrid-Cevas, "Automatic Generation and Detection of Highly Reliable Fiducial Markers Under Occlusion", Pattern Recognition, Vol. 47, No. 6, pp.2280-2292, 2014. https://doi.org/10.1016/j.patcog.2014.01.005
  7. Grishma Alshi, Mansi Dandiwala, Mikhail Cazi, and Renuka Pawar, "Interactive Augmented Reality-based System for Traditional Educational Media using Marker-derived Contextual Overlays", Proceedings of the 2nd International conference on Electronics, Communication and Aerospace Technology, pp.930-935, 2018.
  8. Vuforia SDK, available at http://www.vuforia.com.
  9. Changmin Lim, Chanran Kim, Jong-Il Park, and Hanhoon Park, "Mobile Augmented Reality based on Invisible Marker", 2016 IEEE International Symp. on mixed and Augmented Reality Adjunct Proceedings, pp.78-81.
  10. Vincent Lepetit, Francesse Moreno-Noguer, and Pascal Fua, "EPnP: An accurate O(n) solution to the PnP problem," IJCV, Vol. 81, pp. 155-166, 2009. https://doi.org/10.1007/s11263-008-0152-6
  11. Byung-Kuk Seo, HanhoonPark, Jong-Il Park, Stefan Hinterstoisser, and Slobodan Ilic, "Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds", IEEE Transactions on Vision and Computer Graphics, Vol.20, pp.99-110, 2014. https://doi.org/10.1109/TVCG.2013.94
  12. Alberto Crivellaro and Vincent Lepetit, "Robust 3D tracking with descriptor fields", 2014 IEEE Conference on Computer Vision and Pattern Recognition, 3514-3421, 2014.
  13. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints", International Journal of Computer Vision, Vol. 60, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  14. H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "Speeded-Up Robust Features (SURF)", Computer Vision and Image Understanding, Vol.110, pp.346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  15. E. Rublee, V. Rabaud, K. Konolige, G. Bradski, "ORB:An efficient alternative to SIFT or SURF", International Conference on Computer Vision, pp.2564-2571, 2011.
  16. https://lightbot.com