Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Real-Time Augmented Reality on 3-D Mobile Display using Stereo Camera Tracking

스테레오 카메라 추적을 이용한 모바일 3차원 디스플레이 상의 실시간 증강현실

  • Park, Jungsik (Haanyang University, Department of Electronics and Computer Engineering) ;
  • Seo, Byung-Kuk (Haanyang University, Department of Electronics and Computer Engineering) ;
  • Park, Jong-Il (Hanyang University, Division of Computer Science and Engineering)
  • 박정식 (한양대학교 전자컴퓨터통신공학과) ;
  • 서병국 (한양대학교 전자컴퓨터통신공학과) ;
  • 박종일 (한양대학교 컴퓨터공학부)
  • Received : 2013.04.02
  • Accepted : 2013.05.27
  • Published : 2013.05.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a framework of real-time augmented reality on 3-D mobile display with stereo camera tracking. In the framework, camera poses are jointly estimated with the geometric relationship between stereoscopic images, which is based on model-based tracking. With the estimated camera poses, the virtual contents are correctly augmented on stereoscopic images through image rectification. For real-time performance, stereo camera tracking and image rectification are efficiently performed using multiple threads. Image rectification and color conversion are accelerated with a GPU processing. The proposed framework is tested and demonstrated on a commercial smartphone, which is equipped with a stereoscopic camera and a parallax barrier 3-D display.

본 논문에서는 스테레오 카메라 추적을 이용한 모바일 3차원 디스플레이 상의 실시간 증강현실 프레임웍에 대하여 기술한다. 모델 기반 추적 방법에 기초하여 카메라 포즈는 스테레오 카메라 간의 기하 관계를 만족하도록 동시 추정된다. 동시 추정된 카메라 포즈를 통해 가상 콘텐츠는 교정된 스테레오 영상에 올바르게 증강된다. 스테레오 카메라 추적과 스테레오 영상 교정은 서로 다른 쓰레드에서 수행하고, 영상 형식 변환 및 스테레오 영상 교정은 GPU로 고속으로 처리함으로써 실시간으로 수행된다. 제안된 프레임웍은 스테레오 카메라와 3차원 디스플레이가 장착된 스마트폰에서 구현되었다.

Keywords

References

  1. S. Feiner, B. MacIntyre, T. Hollerer, and A. Webster, "A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment," Personal Technologies, vol. 1, no. 4, pp. 208-217, 1997. https://doi.org/10.1007/BF01682023
  2. C. Yuan, M. Liao, X. Hu, and P. Mordohai, "Depth sensing and augmented reality technologies for mobile 3D platforms," SID Symposium Digest of Technical Papers, vol. 43, no. 1, pp. 233-236, 2012.
  3. D. Wagner and D. Schmalstieg, "ARToolKitPlus for pose tracking on mobile devices," in Proc. Computer Vision Winter Workshop, 2007, pp. 139-146.
  4. D.Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, "Real-time detection and tracking for augmented reality on mobile phones," IEEE Trans. Vis. Comput. Graphics, vol. 16, no. 3, pp. 355-368, 2010. https://doi.org/10.1109/TVCG.2009.99
  5. T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 932-946, 2002. https://doi.org/10.1109/TPAMI.2002.1017620
  6. B.-K. Seo, J. Park, H. Park, and J.-I. Park, "Real-time visual tracking of less-textured three-dimensional objects on mobile platforms," Optical Engineering, vol. 51, no. 12, pp. 127202, Dec. 2012.
  7. N. Singhal, J. W. Yoo, H. Y. Choi, and I. K. Park, "Implementation and optimization of image processing algorithms on embedded GPU," IEICE Trans. on Information and Systems, vol. E95-D, no. 5, pp. 1475 -1484, May 2012. https://doi.org/10.1587/transinf.E95.D.1475
  8. J. Park, B.-K. Seo, and J.-I. Park, "A framework of augmented reality on 3-D mobile display using stereo camera tracking," in Proc. International Workshop on Advanced Image Technology (IWAIT'13), pp. 745-748, Jan. 2013.
  9. G. Bradski and A. Kaehler, Learning OpenCV, O'Reilly, 2009.