Journal of the Semiconductor & Display Technology (반도체디스플레이기술학회지)

The Korean Society Of Semiconductor & Display Technology (한국반도체디스플레이기술학회)
권호 표지

OpenVSLAM-based Cooperative Mobile AR System Architecture

OpenVSLAM 기반의 협력형 모바일 SLAM 시스템 설계

  • Kook, Joongjin (Dept. of Information Security Engineering, Sangmyung University)
  • 국중진 (상명대학교 정보보안공학과)
  • Received : 2022.03.12
  • Accepted : 2022.03.25
  • Published : 2022.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we designed, implemented, and verified the SLAM system that can be used on mobile devices. Mobile SLAM is composed of a stand-alone type that directly performs SLAM operation on a mobile device, and a mapping server type that additionally configures a mapping server based on FastAPI to perform SLAM operation on the server and transmits data for map visualization to a mobile device. The mobile SLAM system proposed in this paper is to mix the two types in order to make SLAM operation and map generation more efficient. The stand-alone type SLAM system was configured as an Android app by porting the OpenVSLAM library to the Unity engine, and the map generation and performance were evaluated on desktop PCs and mobile devices. The mobile SLAM system in this paper is an open source project, so it is expected to help develop AR contents based on SLAM in a mobile environment.

Keywords

References

  1. Esparza-Jimenez, Jorge O., Michel Devy, and Jose L. Gordillo, "Visual EKF-SLAM from Heterogeneous Landmarks" Sensors 16, no. 4: 489, 2016. https://doi.org/10.3390/s16040489
  2. H. C. Roh, C. H. Sung and M. J. Chung, "Rapid SLAM using simple map representation in indoor environment," The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, 2013, pp. 225-229,
  3. Jung, Sungwook, Duckyu Choi, Seungwon Song, and Hyun Myung, "Bridge Inspection Using Unmanned Aerial Vehicle Based on HG-SLAM: Hierarchical Graph-Based SLAM" Remote Sensing 12, no. 18: 3022, 2020. https://doi.org/10.3390/rs12183022
  4. Fan, T., Wang, H., Rubenstein, M., Murphey, T., "CPL-SLAM: Efficient and Certifiably Correct Planar Graph-Based SLAM Using the Complex Number Representation," TRO, vol. 36, pp. 1719-1737, 2020.
  5. Myriam Servieres, Valerie Renaudin, Alexis Dupuis, Nicolas Antigny, "Visual and Visual-Inertial SLAM: State of the Art, Classification, and Experimental Benchmarking", Journal of Sensors, vol. 2021, Article ID 2054828, 26 pages, 2021.
  6. Engel, J.; Koltun, V.; "Cremers, D. Direct Sparse Odometry," TPAMI, vol. 40, pp. 611-625, 2018. https://doi.org/10.1109/TPAMI.2017.2658577
  7. Rosinol, A.; Abate, M.; Chang, Y.; Carlone, L., "Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mapping, " IEEE Int. Conf. Robot. Autom. (ICRA), May. 2020, pp. 1689-1696.
  8. G. Klein and D. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 2007, pp. 225-234.
  9. Engel J., Schops T., Cremers D., "LSD-SLAM: Large-Scale Direct Monocular SLAM," Lecture Notes in Computer Science, vol. 8690. Springer, Cham pp. 834-849. 2014.
  10. C. Forster, M. Pizzoli and D. Scaramuzza, "SVO: Fast semi-direct monocular visual odometry," 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 15-22.
  11. Piao, Jin-Chun, and Shin-Dug Kim, "Adaptive Monocular Visual-Inertial SLAM for Real-Time Augmented Reality Applications in Mobile Devices" Sensors 17, no. 11: 2567, 2017. https://doi.org/10.3390/s17112567
  12. J. E. Song, J. Kook, "Building a Mobile AR System Based on Visual SLAM," Journal of the Semiconductor & Display Technology, vol. 20, no. 4. pp. 96-101, 2021.
  13. Burri, M.; Nikolic, J.; Gohl, P.; Schneider, T.; Rehder, J.; Omari, S.; Achtelik, M.W.; Siegwart, R. The EuRoC micro aerial vehicle datasets. Int. J. Robot. Res. 2016, vol. 35, pp. 1157-1163. https://doi.org/10.1177/0278364915620033