DOI QR코드

DOI QR Code

Light ID and HMD-AR Based Interactive Exhibition Design for Jeonju Hanok Village Immersive 3D View

전주 한옥마을의 실감 3D View를 위한 Light ID 및 HMD-AR 기반 인터렉티브 전시 설계

  • Min, Byung-Jun (Head IT Co., Ltd) ;
  • Mariappan, Vinayagam (Graduate School of Nano IT Design Fusion, Seoul National University of Science and Technology) ;
  • Cha, Jae-Sang (Department of Electronic and IT Media Engineering, Seoul National University of Science and Technology) ;
  • Kim, Dae-Young (NCSOFT Co., Ltd,. Publishing Platform Center) ;
  • Cho, Ju-Phil (Dept. of Integrated IT & Communication Eng., Kunsan National Univ.)
  • Received : 2018.08.12
  • Accepted : 2018.08.27
  • Published : 2018.08.30

Abstract

The digital convergence looking for new ways to engage visitors by superimposing virtual content on projection over the real world captured media contents. This paper propose the Light ID based interactive 3D immersive exhibition things view using HMD AR technology. This approach does not required to add any additional infrastructure to be built-in to enable service and uses the installed Lighting or displays devices in the exhibit area. In this approach, the Light ID can be used as a Location Identifier and communication medium to access the content unlike the QR Tag which supports provide the download information through web interface. This utilize the advantages of camera based optical wireless communication (OWC) to receive the media content on smart device to deliver immersive 3D content visualization using AR. The proposed exhibition method is emulated on GALAXY S8 smart phone and the visual performance is evaluated for Jeonju Hanok Village. The experimental results shows that the proposed method can give immersive 3D view for exhibit things in real-time.

최근 디지털 컨버전스는 현실세계를 기반으로 만들어진 미디어 콘텐츠에 가상 콘텐츠를 투영시켜 사용자에게 새로운 경험을 제공 할 수 있도록 발전하고 있다. 이에 본 논문에서는 HMD AR 기술을 이용한 Light ID 및 HMD-AR 기반 인터렉티브 전시를 제안하였다. 이 접근법은 현재 사용되고 있는 전시물에 추가적인 인프라를 설치할 필요 없이 기존 사용되고 있는 조명 또는 디스플레이를 사용 할 수 있다. 또한 Light ID는 웹 콘텐츠로의 접근을 위해서만 사용되는 QR 태그와 달리 위치 인식을 위한 식별자 및 통신 매체로도 사용될 수 있는데, 이는 카메라를 기반으로 한 광 무선 통신 (OWC)의 장점을 활용하여 스마트 장치에서 미디어 콘텐츠에 대한 ID를 수신하고 AR형태로 실감 3D 콘텐츠를 시각화하여 제공한다. 본 논문에서는 안드로이드 스마트폰을 사용하여 제안한 설계 기법에 대해 전주 한옥 마을을 타겟으로 Light ID 기반 광무선통신 기술을 활용한 실감 3D View 제공 기술을 구현하고 테스트를 수행하였으며, 실험 결과 제안한 기법을 통해 전시물에 관한 실시간 몰입형 3D 뷰를 제공 할 수 있음을 확인하였다.

Keywords

References

  1. Tsouknidas Nikolaos,Kiyoshi Tomimatsu, "QR-code calibration for mobile augmented reality applications: linking a unique physical location to the digital world", International Conference on Computer Graphics and Interactive Techniques, July 2010.
  2. Vinayagam Mariappan, Jaesang Cha, "IEEE802.15.7m OWC PHY Specification Overview", IEEE COMSOC MMTC Communications - Frontiers, Vol 13, Issue 8, pp. 25-28, May 2018.
  3. Rahul Budhiraja, Gun A. Lee, Mark Billinghurst, "Using a HHD with a HMD for Mobile AR Interaction", IEEE International Symposium on Mixed and Augmented Reality, 2013.
  4. Ning Wang, Xukun Shen, "The Research on Interactive Exhibition Technology of Digital Museum Resources", IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, pp. 2017-2070, 2013.
  5. Ramya M, Jayasheela, , "Improved Color QR Codes for Real Time Applications with High Embedding Capacity", International Journal of Computer Applications, Vol 91, Issue 8, pp. 8 -12, April 2014. https://doi.org/10.5120/15899-4889
  6. Trang Nguyen, Yeong Min Jang, et al., "Current Status and Performance Analysis of Optical Camera Communication Technologies for 5G Networks", IEEE Access, Vol. 5, pp. 4574-4594, April 2017. https://doi.org/10.1109/ACCESS.2017.2681110
  7. Soonho Jung, Jaesang Cha, et al., "A study on 2D dimensional transmission based on color LED matrix", Network Security and Communication Engineering Edited by Kennis Chan, pp. 569-571, 2014.
  8. Vinayagam Mariappan, Jaesang Cha, et al., "PHY/MAC Design to Enable Internet Infrastructure Connectivity on VLC", JERECE, Vol 3, Issue 8, pp. 189-193, August 2016.
  9. Huber D F, "Automatic three-dimensional modeling from reality[D]", Doctor of Philosophy in Robotics thesis, Carnegie Mellon University , July 2002.
  10. Sinha, Steedly, Szeliski, Agrawala, Pollefeys, " Interactive 3D Architectural Modeling from Unordered Photo Collections", SIGGRAPH Asia, 2008.
  11. Kiyoshi Kiyokawa, "Trends and Vision of Head Mounted Display in Augmented Reality", International Symposium on Ubiquitous Virtual Reality, pp.14-17 , 2012.
  12. Shuxin Liu, Yan Li , Pengcheng Zhou, Xiao Li, Na Rong, Shuaijia Huang, Wenqing Lu, Yikai Su, "A multi-plane optical see-through head mounted display design for augmented reality applications", Journal of the Society for Information Display, Vol. 24, Issue 4, pp. 246-251, April 2016. https://doi.org/10.1002/jsid.435