Browse > Article
http://dx.doi.org/10.7583/JKGS.2020.20.3.35

Development of AR-based Coding Puzzle Mobile Application Using Command Placement Recognition  

Seo, Beomjoo (School of Games, Hongik University)
Cho, Sung Hyun (School of Games, Hongik University)
Abstract
In this study, we propose a reliable command placement recognition algorithm using tangible commands blocks developed for our coding puzzle platform, and present its performance measurement results on an Augmented Reality testbed environment. As a result, it can recognize up to 30 tangible blocks simultaneously and their placements within 5 seconds reliably. It is successfully ported to an existing coding puzzle mobile app and can operate an IoT attached robot via bluetooth connected mobile app.
Keywords
Augmented Reality; Mobile; Marker; Placement Recognition; IoT Robot; Movement Control;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Beomjoo Seo and Sung Hyun Cho, "Design and Implementation of Students' Coding Assessment System for a Coding Puzzle Game", Journal of Korea Game Society, Journal of Korea Game Society, Vol.18, No.1, pp.7-18, 2018.   DOI
2 Kyeonbok Park, Sung Hyun Cho, and Beomjoo Seo, "An Observation-based Movement Control for Educational Coding Robots", Journal of Korea Game Society, Vol. 16, No.6, pp.131-142, 2016.   DOI
3 Hanhoon Park and Jong-il Park, "Trend on Vision-Based Object Recognition and Tracking for Augmented Reality", Communications of the Korea Institute of Information Scientists and Engineers, Vol.34, No.12, pp.8-17, 2016.
4 Hongfei Wu, Fengjing Shao, and Pencheng Sun, "Research of quickly identifying markers on Augmented Reality",
5 Daniel Wagner and Dieter Schmalstieg, "ARToolKitPlus for Pose Tracking on Mobile Devices", pp. Computer Vision Winter Workshop, 2007. (저가 mobile device에서 상용하기 위한 ARToolKitPlus)
6 S. Garrido-Jurado, R. Munoz-Salinas, F.J.Madrid-Cevas, "Automatic Generation and Detection of Highly Reliable Fiducial Markers Under Occlusion", Pattern Recognition, Vol. 47, No. 6, pp.2280-2292, 2014.   DOI
7 Grishma Alshi, Mansi Dandiwala, Mikhail Cazi, and Renuka Pawar, "Interactive Augmented Reality-based System for Traditional Educational Media using Marker-derived Contextual Overlays", Proceedings of the 2nd International conference on Electronics, Communication and Aerospace Technology, pp.930-935, 2018.
8 Vuforia SDK, available at http://www.vuforia.com.
9 Changmin Lim, Chanran Kim, Jong-Il Park, and Hanhoon Park, "Mobile Augmented Reality based on Invisible Marker", 2016 IEEE International Symp. on mixed and Augmented Reality Adjunct Proceedings, pp.78-81.
10 Vincent Lepetit, Francesse Moreno-Noguer, and Pascal Fua, "EPnP: An accurate O(n) solution to the PnP problem," IJCV, Vol. 81, pp. 155-166, 2009.   DOI
11 Byung-Kuk Seo, HanhoonPark, Jong-Il Park, Stefan Hinterstoisser, and Slobodan Ilic, "Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds", IEEE Transactions on Vision and Computer Graphics, Vol.20, pp.99-110, 2014.   DOI
12 Alberto Crivellaro and Vincent Lepetit, "Robust 3D tracking with descriptor fields", 2014 IEEE Conference on Computer Vision and Pattern Recognition, 3514-3421, 2014.
13 D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints", International Journal of Computer Vision, Vol. 60, pp. 91-110, 2004.   DOI
14 H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "Speeded-Up Robust Features (SURF)", Computer Vision and Image Understanding, Vol.110, pp.346-359, 2008.   DOI
15 E. Rublee, V. Rabaud, K. Konolige, G. Bradski, "ORB:An efficient alternative to SIFT or SURF", International Conference on Computer Vision, pp.2564-2571, 2011.
16 https://lightbot.com