Browse > Article

Building a Mobile AR System Based on Visual SLAM  

Song, Ju Eun (Dept. of Electronic Information System Engineering, The Graduate School Sangmyung University)
Kook, Joongjin (Dept. of Information Security Engineering, Sangmyung University)
Publication Information
Journal of the Semiconductor & Display Technology / v.20, no.4, 2021 , pp. 96-101 More about this Journal
Abstract
The SLAM market is growing rapidly with advances in Machine Learning, Drones, Augmented Reality technologies. However, due to the absence of an open source-based SLAM library for developing AR content, most SLAM researchers are required to conduct their own research and development to customize SLAM. In this paper, we propose an opensource-based Mobile Markerless AR System by building our own pipeline based on Visual SLAM. To implement the Mobile AR System of this paper, it uses ORB-SLAM3 and Unity Engine and We experimented with running our system in a real environment and confirming it in the Unity Engine's Mobile Viewer. Through this experimentation, we can verify that the Unity Engine and the SLAM System are tightly integrated and communicate smoothly. Also, we expect to accelerate the growth of SLAM technology through this research.
Keywords
Mobile; Markerless AR; Visual SLAM;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Raul Mur-Artal, Juan D.Tardos, "ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras," IEEE Transactions and Robotics, Vol.33, No. 5, pp. 1255-1262, 2017   DOI
2 Wikipedia, "Unity(game engine)", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/Unity_(game_engine)
3 INNOPOLIS, "SLAM Market", Retrieved Sep 18, 2021, from http://www.innopolis.or.kr, (May, 2020).
4 Carlos Campos, Richard Elvira, Juan J. Gomez Rodriguez, Jose M.M. Montiel and Juan D. Tardos, "ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM," IEEE Transactions and Robotics, 2021
5 Wikipedia, "Clang", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/Clang
6 ETH, "ASL Datasets", Retrieved Oct 24, 2021, from https://projects.asl.ethz.ch/datasets/doku.php?id=kmavvisualinertialdatasets#the_euroc_mav_dataset
7 Woo ri Han, Young-Seop Kim, Yong-Hwan Lee, "Multi-Object Tracking Based on Keypoints Using Homography in Mobile Environments," Journal of the Semiconductor & Display Technology, Vol. 14, Issue 3, pp. 67-72, 2015.
8 Woo ri Han, Young-Seop Kim, Yong-Hwan Lee, "Multi-Object Tracking based on Reliability Assessment of Learning in Mobile Environment," Journal of the Semiconductor & Display Technology, Vol. 14, Issue 3, pp. 73-77, 2015.
9 Young cheon Lee, "Development of Cultural Content using a Markerless Tracking-based Augmented Reality," Smart Media Journal, Vol. 5, No. 4, pp. 90-95, 2016.
10 SAMSUNG SDS, "[Direction and Implications of the Augmented Reality Technology Development] Part 2 Augmented Reality in Industrial Fields", Retrieved Sep 19, 2021, from https://www.samsungsds.com/kr/insights/augmented_reality_2.html (April 8, 2020).
11 MAXST, "Where can Visual SLAM be used?", Retrieved Sep 19, 2021, from https://medium.com/maxst/where-can-visual-slam-be-used-b94876d161c6, (Oct 7, 2019).
12 Pangolin, "What is Pangolin", Retrieved Oct 3, 2021, from https://github.com/uoip/pangolin, (Jan 24, 2018).
13 Wikipedia, "LLVM", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/LLVM
14 Changhyun Lee, Youngseop Kim, Yeonmin Kim, Inho Park, JaeHak Choi, Yonghwan Lee, Woori Han, "Study on the Content Development of Mobile AR_HMD through a Real Time 360 Image Processing," Journal of the Semiconductor & Display Technology, Vol. 15, Issue 2, pp. 66-69, 2016.