Journal of the HCI Society of Korea (한국HCI학회논문지)

The HCI Society of Korea (한국HCI학회)
권호 표지

Augmented Presentation Framework Design and System Implementation for Immersive Information Visualization and Delivery

몰입적 정보 표현과 전달을 위한 증강 프레젠테이션 디자인 및 시스템 구현

  • Received : 2016.12.07
  • Accepted : 2017.02.20
  • Published : 2017.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Interactive intervention of the human presenter is one of the important factors that make the visualization more effective. Rather than just showing the content, the presenter enhances the process of the information delivery by providing the context of visualization. In this paper, we define this as an augmented presentation. In augmented presentation concept, the presenter can facilitate presentation more actively by being fully immersed in the visualization space and reaching and interacting into digital information. In order to concrete the concept, we design presentation space that enables the presenter to be seamlessly immersed in the visualization. Also we increase the presenter's roles as a storyteller, controller and augmenter allowing the presenter to fully support communicative process between the audience and the visualization. Then, we present an augmented presentation system to verify the proposed concept. We rendered 3D visualization through a half-mirror film and a wall projection screen that are place in parallel and applied with stereoscopic images, then, spatially align the presenter inside the virtual visualization space. After that, we conduct a controlled experiment to investigate the subjective level of immersion and engagement of the audience to HoloStation compared to traditional presentation system. Our initial investigation suggests that the newly conceived augmented presentation has potential not only to enhance the information presentation but also to supports the delivery of visualization.

발표자의 적극적인 역할과 개입은 정보시각화를 효과적으로 표현하고 전달하는 핵심 요인임에도 불구하고, 정보 시각화 연구에서 적극적으로 다루어지지 못했다. 단순히 시각화 결과만 보여주는 것이 아니라, 발표자가 시각화와 관련된 부가적인 정보 및 맥락을 함께 제공함으로써 시각화 전달 과정을 증진시킬 수 있다. 본 논문에서는 발표자가 3차원 시각화 공간에 직접 개입하여 자신을 둘러싼 공간에 표현된 정보와 직접적으로 상호작용 하면서, 정보 표현 및 전달 과정을 적극적으로 증진시킬 수 있는 방식을 제시하고 이를 증강 프레젠테이션 (augmented presentation)이라는 프레임워크로 정의한다. 증강 프레젠테이션의 특성을 구체화하기 위해서 발표자가 개입할 수 있는 시각화 공간을 디자인하고, 발표자로 하여금 관찰자와 정보 간의 의사소통 과정을 충분히 지원할 수 있도록 발표자의 역할을 화자(storyteller), 제어자(controller), 정보증강자(augmenter)로 정의했으며, 그들의 역할 가능성을 제안하였다. 또한, 증강 프레젠테이션 특성을 실제로 구현할 수 있는 프로토타입 시스템을 제작하였다. 하프미러 필름 (half-mirror film)과 일반 프로젝션 스크린을 일정 간격을 띄운 후 평행하게 위치시키고, 각 스크린에 입체 영상을 적용한 후, 발표자가 스크린 사이에 표현된 3차원 시각화 공간 내에 직접 개입하여 정보와 상호작용할 수 있는 형태이다. 이후, 초기 단계에서 몰입적 정보 표현과 정보 전달 플랫폼으로서 증강 프레젠테이션의 가능성을 확인하기 위해서 기존의 프레젠테이션 시스템과 증강 프레젠테이션 시스템을 비교하는 예비 실험 (pilot test)을 진행하였다. 그 결과, 본 연구에서 제시한 증강 프레젠테이션은 실제 3차원 공간에서 가상의 정보와 실제 발표자를 자연스럽게 통합시켜 표현함으로써 몰입적이고 관찰자의 주의를 사로잡는 프레젠테이션을 실현할 수 있는 가능성이 충분히 있음을 확인했다.

Keywords

References

  1. Geng, J. Three-dimensional display technologies. Advances in optics and photonics. 5(4). pp. 456-535. 2013. https://doi.org/10.1364/AOP.5.000456
  2. Yang, L., Dong, H., Alelaiwi, A. and El Saddik, A. See in 3D: state of the art of 3D display technologies. Multimedia Tools and Applications. 75(24), pp. 17121-17155. 2015.
  3. Noma, T., Badler, N. I. and Zhao, L. Design of a virtual human presenter. EEE Computer Graphics and Applications. 20(4). pp. 79-85. 2000. https://doi.org/10.1109/38.851755
  4. Tapp, S. R. Secrets of Power Presentations. The Journal of Personal Selling & Sales Management. 16(4). pp. 67-68. 1996.I
  5. Fourney, A., Terry, M. and Mann, R. Gesturing in the wild: understanding the effects and implications of gesture-based interaction for dynamic presentations. In Proceedings of the 24th BCS Interaction Specialist Group Conference. British Computer Society. pp. 230-240. 2010.
  6. Ma, K. L., Liao, I., Frazier, J., Hauser, H. and Kostis, H. N. Scientific storytelling using visualization. IEEE Computer Graphics and Applications. 32(1). pp. 12-19. 2012. https://doi.org/10.1109/MCG.2012.24
  7. Nouri, H. and Shahid, A. The effect of PowerPoint presentations on student learning and attitudes. Global Perspectives on Accounting Education. 2. pp. 53-73. 2005.
  8. Anderson, R., McDowell, L. and Simon, B. Use of classroom presenter in engineering courses. In Proceedings Frontiers in Education 35th Annual Conference. IEEE. pp. T2G-13. 2005.
  9. Baudel, T. and Beaudouin-Lafon, M. Charade: remote control of objects using free-hand gestures. Communications of the ACM. 36(7). pp. 28-35. 1993. https://doi.org/10.1145/159544.159562
  10. Kosara, R. and Mackinlay, J. Storytelling: The next step for visualization. Computer. 46(5). pp. 44-50. 2013. https://doi.org/10.1109/MC.2013.36
  11. Lee, B., Kazi, R. H. and Smith, G. SketchStory: Telling more engaging stories with data through freeform sketching. IEEE Transactions on Visualization and Computer Graphics. 19(12). pp. 2416-2425. 2013. https://doi.org/10.1109/TVCG.2013.191
  12. Van Welbergen, H., Nijholt, A., Reidsma, D. and Zwiers, J. Presenting in virtual worlds: Towards an architecture for a 3D presenter explaining 2D-presented information. In International Conference on Intelligent Technologies for Interactive Entertainment. Springer Berlin Heidelberg. pp. 203-212. 2005.
  13. Matulic, F., Engeln, L., Trager, C. and Dachselt, R. Embodied Interactions for Novel Immersive Presentational Experiences. In Proceedings of the CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM. pp. 1713-1720. 2016.
  14. Liston, K., Fischer, M. and Kunz, J. Designing and evaluating visualization techniques for construction planning. Computing in Civil and Building Engineering. 2. pp. 1293-1300. 2000.
  15. Rosling, H. The joy of stats. London. 2010.
  16. Rakkolainen, I., Hällerer, T., DiVerdi, S. and Olwal, A. Mid-air display experiments to create novel user interfaces. Multimedia tools and applications. 44(3). pp. 389-405. 2009. https://doi.org/10.1007/s11042-009-0280-1
  17. Stein, M. ARCADE: a system for augmenting gesture-based computer graphic presentations. In ACM SIGGRAPH Computer Animation Festival. ACM. pp. 77-77. 2012.
  18. Steinmeyer, J. The Science behind the Ghost: A Brief History of Pepper's Ghost. 1999.
  19. Ogi, T., Yamada, T., Yamamoto, K. and Hirose, M. Invisible interface for the immersive virtual world. In Immersive Projection Technology and Virtual Environments. Springer Vienna. pp. 237-246. 2001.
  20. Oliver B. Combining optical holograms with interactive computer graphics. Computer. 37(1). IEEE Computer Society. pp. 85-91. 2004. https://doi.org/10.1109/MC.2004.1260730
  21. Gingrich, O., Renaud, A. and Emets, E. Kima-a holographic telepresence environment based on cymatic principles. Leonardo. 46(4). pp. 332-343. 2013. https://doi.org/10.1162/LEON_a_00604
  22. Otmar H., David K., Shahram I., Malte W. and Andrew W. HoloDesk: direct 3d interactions with a situated see-through display. In Proceedings of 27 the SIGCHI Conference on Human Factors in Computing Systems. pp. 2421-2430. 2012.
  23. Hachet, M., Bossavit, B., Coh, A. and de la Rivière, J. B. Toucheo: multitouch and stereo combined in a seamless workspace. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM. pp. 587-592. 2011.
  24. 김민주, 원광연, 스테레오 증강현실 홀로그래피에서의 삼차원 공간감 비교, 한국HCI학회 논문지. 제8권. 제2 호. 한국HCI학회. pp. 21-27. 2013.
  25. Olwal, A., Lindfors, C., Gustafsson, J., Kjellberg, T. and Mattsson, L. ASTOR: An autostereoscopic optical see-through augmented reality system. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE. pp. 24-27. 2005.
  26. Prema, V., Roberts, G. and Wuensche, B. C. 3D visualisation techniques for multi-layer display technology. In IVCNZ. 6. pp. 27-29. 2006.
  27. Akeley, K., Watt, S. J., Girshick, A. R. and Banks, M. S. A stereo display prototype with multiple focal distances. In ACM transactions on graphic. 23(3). pp. 804-813. 2004. https://doi.org/10.1145/1015706.1015804
  28. 문화기술 심층 리포트-3D입체영상은 홀로그램으로 진화 중, 관련 기술동향과 활용사례. 한국콘텐츠진흥원. 2011.
  29. Zhang, Z. A flexible new technique for camera calibration. IEEE Transactions on pattern analysis and machine intelligence. 22(11). pp. 1330-1334. 2000. https://doi.org/10.1109/34.888718
  30. Lee, C., DiVerdi, S. and Hollerer, T. Depth-fused 3D imagery on an immaterial display. IEEE transactions on visualization and computer graphics. 15(1). pp. 20-33. 2009. https://doi.org/10.1109/TVCG.2008.83