Browse > Article
http://dx.doi.org/10.15701/kcgs.2019.25.3.65

Mixed Reality Extension System Using Beam Projectors : Beyond the Sight  

Kim, Jongyong (Dept. of Multimedia, Dongguk University)
Song, J.H (Dept. of Multimedia, Dongguk University)
Park, J.H. (Dept. of Multimedia Engineering, Dongguk University)
Nam, J. (Dept. of Multimedia Engineering, Dongguk University)
Yoon, Seung-Hyun (Dept. of Multimedia Engineering, Dongguk University)
Park, Sanghun (Dept. of Multimedia, Dongguk University)
Publication Information
Journal of the Korea Computer Graphics Society / v.25, no.3, 2019 , pp. 65-73 More about this Journal
Abstract
Recently commercial mixed-reality devices have be launched and a variety of mixed-reality content has produced, but narrow field of view, which appear to be hardware technical limitations, are mentioned as an important issue for hindering immersion and limiting the scope of use. We propose a new innovative system that cooperate multiple beam projectors and a number of mixed reality devices. Using this technology, users can maximize immersion and minimize frustration of narrow viewing angles through 3D object rendering on background of large 2D screens. This system, named BtS (Beyond the Sight), is implemented on a client-server basis and includes the ability to calibrate between devices, share spatial coordinate systems, and synchronize real-time renderings as core modules. In this paper, each configuration module is described in detail and the possibility of its performance and application is shown through the introduction of mixed reality content case created using BtS system.
Keywords
Mixed reality; Projection mapping; Calibration; Sharing coordinate systems;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Milgram and F. Kishino, "A taxonomy of mixed reality visual displays," IEICE TRANSACTIONS on Information and Systems, vol. 77, no. 12, pp. 1321-1329, 1994.
2 Y. Ohta and H. Tamura, Mixed reality: merging real and virtual worlds. Springer Publishing Company, Incorporated, 2014.
3 H. Chen, A. S. Lee, M. Swift, and J. C. Tang, "3d collaboration method over hololensTMand skypeTMend points," in Proceedings of the 3rd International Workshop on Immersive Media Experiences, ser. ImmersiveME '15. New York, NY, USA: ACM, 2015, pp. 27-30. [Online]. Available: http://doi.acm.org/10.1145/2814347.2814350
4 Y.-T. Yue, Y.-L. Yang, G. Ren, and W. Wang, "Scenectrl: Mixed reality enhancement via efficient scene editing," in Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '17. New York, NY, USA: ACM, 2017, pp. 427-436. [Online]. Available: http://doi.acm.org/10.1145/3126594.3126601
5 MagicLeap, https://www.magicleap.com/, 2019.
6 Microsoft, https://www.microsoft.com/en-us/hololens, 2019.
7 UnityTechnologies, https://unity.com/kr, 2019.
8 B. R. Jones, H. Benko, E. Ofek, and A. D. Wilson, "Illumiroom: Peripheral projected illusions for interactive experiences," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '13. New York, NY, USA: ACM, 2013, pp. 869-878. [Online]. Available: http://doi.acm.org/10.1145/2470654.2466112
9 T. Okatani and K. Deguchi, "Easy calibration of a multiprojector display system," International journal of computer vision, vol. 85, no. 1, pp. 1-18, 2009.   DOI
10 J. Zhou, L. Wang, A. Akbarzadeh, and R. Yang, "Multi-projector display with continuous self-calibration," in Proceedings of the 5th ACM/IEEE International Workshop on Projector Camera Systems, ser. PROCAMS '08. New York, NY, USA: ACM, 2008, pp. 3:1-3:7. [Online]. Available: http://doi.acm.org/10.1145/1394622.1394626
11 H. S. Oluwatosin, "Client-server model," IOSRJ Comput. Eng, vol. 16, no. 1, pp. 2278-8727, 2014.
12 M. Bailey and S. Cunningham, Graphics shaders: theory and practice. AK Peters/CRC Press, 2016.
13 A. Zucconi and K. Lammers, Unity 5. x Shaders and Effects Cookbook. Packt Publishing Ltd, 2016.
14 Microsoft, https://github.com/microsoft/MixedRealityToolkit-Unity, 2019.
15 T. Frantz, B. Jansen, J. Duerinck, and J. Vandemeulebroucke, "Augmenting microsoft's hololens with vuforia tracking for neuronavigation," Healthcare technology letters, vol. 5, no. 5, pp. 221-225, 2018.   DOI
16 HoloLens, https://docs.microsoft.com/ko-kr/windows/mixed-reality/spectator-view, 2019.
17 S. Willi and A. Grundhofer, "Robust geometric selfcalibration of generic multi-projector camera systems," in 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2017, pp. 42-51.
18 B. Jones, R. Sodhi, M. Murdock, R. Mehra, H. Benko, A. Wilson, E. Ofek, B. MacIntyre, N. Raghuvanshi, and L. Shapira, "Roomalive: Magical experiences enabled by scalable, adaptive projector-camera units," in Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '14. New York, NY, USA: ACM, 2014, pp. 637-644. [Online]. Available: http://doi.acm.org/10.1145/2642918.2647383