Journal of the Semiconductor & Display Technology (반도체디스플레이기술학회지)

The Korean Society Of Semiconductor & Display Technology (한국반도체디스플레이기술학회)
권호 표지

Building a Mobile AR System Based on Visual SLAM

Visual SLAM 기반의 모바일 증강현실 시스템 구축

  • Song, Ju Eun (Dept. of Electronic Information System Engineering, The Graduate School Sangmyung University) ;
  • Kook, Joongjin (Dept. of Information Security Engineering, Sangmyung University)
  • 송주은 (상명대학교 대학원 전자정보시스템공학과) ;
  • 국중진 (상명대학교 정보보안공학과)
  • Received : 2021.11.16
  • Accepted : 2021.12.14
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The SLAM market is growing rapidly with advances in Machine Learning, Drones, Augmented Reality technologies. However, due to the absence of an open source-based SLAM library for developing AR content, most SLAM researchers are required to conduct their own research and development to customize SLAM. In this paper, we propose an opensource-based Mobile Markerless AR System by building our own pipeline based on Visual SLAM. To implement the Mobile AR System of this paper, it uses ORB-SLAM3 and Unity Engine and We experimented with running our system in a real environment and confirming it in the Unity Engine's Mobile Viewer. Through this experimentation, we can verify that the Unity Engine and the SLAM System are tightly integrated and communicate smoothly. Also, we expect to accelerate the growth of SLAM technology through this research.

Keywords

References

  1. INNOPOLIS, "SLAM Market", Retrieved Sep 18, 2021, from http://www.innopolis.or.kr, (May, 2020).
  2. SAMSUNG SDS, "[Direction and Implications of the Augmented Reality Technology Development] Part 2 Augmented Reality in Industrial Fields", Retrieved Sep 19, 2021, from https://www.samsungsds.com/kr/insights/augmented_reality_2.html (April 8, 2020).
  3. Young cheon Lee, "Development of Cultural Content using a Markerless Tracking-based Augmented Reality," Smart Media Journal, Vol. 5, No. 4, pp. 90-95, 2016.
  4. MAXST, "Where can Visual SLAM be used?", Retrieved Sep 19, 2021, from https://medium.com/maxst/where-can-visual-slam-be-used-b94876d161c6, (Oct 7, 2019).
  5. Pangolin, "What is Pangolin", Retrieved Oct 3, 2021, from https://github.com/uoip/pangolin, (Jan 24, 2018).
  6. Wikipedia, "Unity(game engine)", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/Unity_(game_engine)
  7. Raul Mur-Artal, Juan D.Tardos, "ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras," IEEE Transactions and Robotics, Vol.33, No. 5, pp. 1255-1262, 2017 https://doi.org/10.1109/TRO.2017.2705103
  8. Carlos Campos, Richard Elvira, Juan J. Gomez Rodriguez, Jose M.M. Montiel and Juan D. Tardos, "ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM," IEEE Transactions and Robotics, 2021
  9. Wikipedia, "LLVM", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/LLVM
  10. Wikipedia, "Clang", Retrieved Oct 3, 2021, from https://en.wikipedia.org/wiki/Clang
  11. ETH, "ASL Datasets", Retrieved Oct 24, 2021, from https://projects.asl.ethz.ch/datasets/doku.php?id=kmavvisualinertialdatasets#the_euroc_mav_dataset
  12. Changhyun Lee, Youngseop Kim, Yeonmin Kim, Inho Park, JaeHak Choi, Yonghwan Lee, Woori Han, "Study on the Content Development of Mobile AR_HMD through a Real Time 360 Image Processing," Journal of the Semiconductor & Display Technology, Vol. 15, Issue 2, pp. 66-69, 2016.
  13. Woo ri Han, Young-Seop Kim, Yong-Hwan Lee, "Multi-Object Tracking Based on Keypoints Using Homography in Mobile Environments," Journal of the Semiconductor & Display Technology, Vol. 14, Issue 3, pp. 67-72, 2015.
  14. Woo ri Han, Young-Seop Kim, Yong-Hwan Lee, "Multi-Object Tracking based on Reliability Assessment of Learning in Mobile Environment," Journal of the Semiconductor & Display Technology, Vol. 14, Issue 3, pp. 73-77, 2015.