Browse > Article
http://dx.doi.org/10.7583/JKGS.2020.20.3.35

Development of AR-based Coding Puzzle Mobile Application Using Command Placement Recognition  

Seo, Beomjoo (School of Games, Hongik University)
Cho, Sung Hyun (School of Games, Hongik University)
Publication Information
Journal of Korea Game Society / v.20, no.3, 2020 , pp. 35-44 More about this Journal
Abstract
In this study, we propose a reliable command placement recognition algorithm using tangible commands blocks developed for our coding puzzle platform, and present its performance measurement results on an Augmented Reality testbed environment. As a result, it can recognize up to 30 tangible blocks simultaneously and their placements within 5 seconds reliably. It is successfully ported to an existing coding puzzle mobile app and can operate an IoT attached robot via bluetooth connected mobile app.
Keywords
Augmented Reality; Mobile; Marker; Placement Recognition; IoT Robot; Movement Control;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Beomjoo Seo and Sung Hyun Cho, "Design and Implementation of Students' Coding Assessment System for a Coding Puzzle Game", Journal of Korea Game Society, Journal of Korea Game Society, Vol.18, No.1, pp.7-18, 2018.   DOI
2 Kyeonbok Park, Sung Hyun Cho, and Beomjoo Seo, "An Observation-based Movement Control for Educational Coding Robots", Journal of Korea Game Society, Vol. 16, No.6, pp.131-142, 2016.   DOI
3 Hanhoon Park and Jong-il Park, "Trend on Vision-Based Object Recognition and Tracking for Augmented Reality", Communications of the Korea Institute of Information Scientists and Engineers, Vol.34, No.12, pp.8-17, 2016.
4 Hongfei Wu, Fengjing Shao, and Pencheng Sun, "Research of quickly identifying markers on Augmented Reality",
5 Daniel Wagner and Dieter Schmalstieg, "ARToolKitPlus for Pose Tracking on Mobile Devices", pp. Computer Vision Winter Workshop, 2007. (저가 mobile device에서 상용하기 위한 ARToolKitPlus)
6 S. Garrido-Jurado, R. Munoz-Salinas, F.J.Madrid-Cevas, "Automatic Generation and Detection of Highly Reliable Fiducial Markers Under Occlusion", Pattern Recognition, Vol. 47, No. 6, pp.2280-2292, 2014.   DOI
7 Grishma Alshi, Mansi Dandiwala, Mikhail Cazi, and Renuka Pawar, "Interactive Augmented Reality-based System for Traditional Educational Media using Marker-derived Contextual Overlays", Proceedings of the 2nd International conference on Electronics, Communication and Aerospace Technology, pp.930-935, 2018.
8 Vuforia SDK, available at http://www.vuforia.com.
9 Changmin Lim, Chanran Kim, Jong-Il Park, and Hanhoon Park, "Mobile Augmented Reality based on Invisible Marker", 2016 IEEE International Symp. on mixed and Augmented Reality Adjunct Proceedings, pp.78-81.
10 Vincent Lepetit, Francesse Moreno-Noguer, and Pascal Fua, "EPnP: An accurate O(n) solution to the PnP problem," IJCV, Vol. 81, pp. 155-166, 2009.   DOI
11 Byung-Kuk Seo, HanhoonPark, Jong-Il Park, Stefan Hinterstoisser, and Slobodan Ilic, "Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds", IEEE Transactions on Vision and Computer Graphics, Vol.20, pp.99-110, 2014.   DOI
12 Alberto Crivellaro and Vincent Lepetit, "Robust 3D tracking with descriptor fields", 2014 IEEE Conference on Computer Vision and Pattern Recognition, 3514-3421, 2014.
13 D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints", International Journal of Computer Vision, Vol. 60, pp. 91-110, 2004.   DOI
14 H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "Speeded-Up Robust Features (SURF)", Computer Vision and Image Understanding, Vol.110, pp.346-359, 2008.   DOI
15 E. Rublee, V. Rabaud, K. Konolige, G. Bradski, "ORB:An efficient alternative to SIFT or SURF", International Conference on Computer Vision, pp.2564-2571, 2011.
16 https://lightbot.com