The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Research Issues and Major Design Considerations on Video See-through HMDs

비디오 씨쓰루 HMD 연구 동향과 주요 설계 고려 요소

  • Lee, Joong Ho (Dept. of intelligent robotics, WiseU Youngsan Univ)
  • 이중호 (와이즈유 영산대학교 지능로봇공학과)
  • Received : 2019.01.16
  • Accepted : 2019.03.05
  • Published : 2019.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

The Video See-through HMD(VSHMD) captures real-world view through a camera set mounted in front of the HMD. The VSHMD outputs this visual information in real time through the display in the HMD, which technique can be used as mixed reality, augmented reality, and virtual reality device. Recently, there is growing interest in VSHMD due to the rapid development of camera and display technology. However, VSHMD is still not free from many technical huddles and human factor issues. This paper summarizes the VSHMD related researches so far, presents the major issues to be solved in advance, and suggests design considerations that should be beneficial to VSHMD development, focused on the human factors, that presents solutions to effectively overcome the limitations of VSHMD functionalities in current.

비디오 씨쓰루 HMD(VSHMD)는 HMD 전면에 장착된 카메라를 통해 실세계 영상을 획득하여 이를 HMD의 디스플레이를 통해 실시간으로 출력하는 장치로서 혼합현실, 증강현실, 가상현실 구현 도구로 활용된다. 최근 카메라 및 디스플레이 기술이 급속히 발전하면서 VSHMD의 성능이 빠르게 향상되고 있으나 아직까지 VSHMD가 갖는 여러 기술적, 인간 요소적 문제들이 해결되지 못하고 있다. 본 논문은 지금까지 수행된 선행 연구 결과들을 시야각(FOV), 디스플레이 해상도, 영상지연, 시점차 등의 주요 설계 요소별로 정리하였다. 그리고 성공적인 VSHMD 개발을 위해 극복해야 할 인간요소 관점의 주요 연구주제들을 조사하였다. 이를 근거로 VSHMD의 설계, 개발 및 VSHMD 응용 서비스를 개발할 때 중요하게 다뤄야 하는 기술적 이슈들을 제시하였다.

Keywords

GJMGCK_2019_v5n2_345_f0001.png 이미지

그림 1. OSHMD와 VSHMD 개념(출처: A survey of Augmented Reality [5]) 및 비교 Figure 1. Comparison of OSHMD and VSHMD

GJMGCK_2019_v5n2_345_f0002.png 이미지

그림 2. DFOV(Display Field of View)와 GFOV(Geometry Field of View)를 Image Scale Factor 관점으로 비교 (출처: Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments [10], Natural perspective projections for head-mounted displays [11]) Figure 1. Difference of DFOV and GFOV in terms of ISF

GJMGCK_2019_v5n2_345_f0003.png 이미지

그림 3. 60개의 픽셀을 1도(60분)의 화각으로 주시할 경우 사용자는 1 AMPP(Arcmin Per Pixel) 해상도로 본다. 이는 일반인이 실제 사물을 보는 시력에 상응한다. Figure 3. 60 pixels within 1 degree displays 1 arcmin per pixel, which corresponds normal person’s viewing.

GJMGCK_2019_v5n2_345_f0004.png 이미지

그림 4. HMD 착용시 시스템내 단계별 지연 시간. 출처: Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity[29]. Figure 4. Display system latency in each step of signal chain.

GJMGCK_2019_v5n2_345_f0005.png 이미지

그림 5. VSHMD의 시점차 (출처: Quantification of Adaptation to Virtual-Eye Location In See-Thru Head-Mounted Displays[35], A Preliminary Investigation of Human Adaptations for Various Virtual Eyes in Video See-Through HMDs[38]) Figure 5. Visual displacement in VSHMD.

References

  1. Hughes, C. E., Stapleton, C. B., Hughes, D. E., & Smith, E. M. Mixed reality in education, entertainment, and training. Ieee Computer Graphics and Applications. 25(6), pp.24-30. 2005. https://doi.org/10.1109/MCG.2005.139
  2. Hyung-Nam Moon, Hee-in Cho, Youngmi Han. Mixed Reality(MR) Technology Trends and Development Prospect, The Journal of the Convergence Culture Technology (JCCT). Vol. 3, No. 3, pp.21-25. 2017. https://doi.org/10.17703/JCCT.2017.3.3.21
  3. Rolland, J. P., Holloway, R. L., & Fuchs, H. A Comparison of Optical and Video See-through Head-Mounted Displays. Telemanipulator and Telepresence Technologies, 2351, pp.293-307. 1994. https://doi.org/10.1117/12.197322
  4. Rolland, J. P, Barlow, T., Biocca, F. A., & Kancherla, A. Quantification of Adaptation to Vritual-Eye Location In See-Thru Head-Mounted Displays. Proceeding of the Virtual Reality Annual International Symposium, pp.56-66. 1995.
  5. Ronald T. Azuma. A survey of Augmented Reality. Presence: Teleoperators and Virtual Envionments 6, 4, pp.355-385. 1997. https://doi.org/10.1162/pres.1997.6.4.355
  6. Jan Herling, Wolfgang Broll. PixMix: A real-time approach to high-quality Diminished Reality. Mixed and Augmented Reality (ISMAR), 2012.
  7. Seong Jae Lee, Se Hyun Oh. Development of Training Instruments on Visual functions using HMD type Display and Investigation of its Demand. IJACT Vol.6 No.3 201-210, 2018.
  8. Draper, M.H., Viirre, E.S., Furness, T. A., & Gawron, V. J. Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human Factors, 43, pp.129-146. 2001. https://doi.org/10.1518/001872001775992552
  9. Moss, J. D., Muth, E.R. Characteristics of Head- Mounted Displays and Their Effects on Simula tor Sickness. Human Factor, 53, pp.308-319. 2011. https://doi.org/10.1177/0018720811405196
  10. M.H. Draper, E.S. Viirre, T.A. Furess, V.J. Gaw ron. Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human Factors, 43, pp.131. 2001.
  11. Steinicke, F, Kuhl, S & Lappe, M. Natural Perspective Projections for Head-Mounted Displays. IEEE Trans Vis Com. Graph, 17(7), pp.888-99. 2011. https://doi.org/10.1109/TVCG.2010.248
  12. Yang, U., & Kim, G. J. Increasing the Effective Egocentric Field of View with Proprioceptive and Tactile Feedback. In Proc. Of IEEE Virtual Reality, pp.27-34. 2004.
  13. Yang, U., & Kim, G. J. Increasing the geometric field of view in head mounted displays through proprioceptive task and multimodal feedback for effective close range interaction, Behaviour & Information Technology, Volume 29-Issue 2. 2010.
  14. Lin, J. J., Duh, H. B., Parker, D. E., Abi-Rached, H., Furness, T. A. Effects of Field of View on Presence, Enjoyment, Memory, and Simulator Sickness in a Virtual Environment. In Proc. Of IEEE Virtual Reality, pp.164-171. 2002.
  15. Moss, J. D., Austin, J., Salley, J., Coats, J., Muth, E. R. The effects of display delay on simulator sickness. Displays, 32, pp.159-168. 2011. https://doi.org/10.1016/j.displa.2011.05.010
  16. Steinicke, F., Kuhl, S., Lappe, M., Klaus., H. Natural Perspective Projections for Head-Mounted Displays, Visualization and Computer Graphics, IEEE, 17, pp.888-899. 2011. https://doi.org/10.1109/TVCG.2010.248
  17. Hassan, S. E., Hicks, J. C, Lei H., Turano, K. A. What is the minimum field of view required for efficient naviagation? Vision Research, 47, pp.2115-2123. 2007. https://doi.org/10.1016/j.visres.2007.03.012
  18. Ni, T., Bowman, D. A., & Chen, J. Increased Display Size and Resolution Improve Task Performance in Information-Rich Virtual Enviroments. Proceeding of Graphics Interface, pp.139-146. 2006.
  19. Streepey, J. W., Kenyon, R. V., & Keshner, E. A. Field of View and base of support width influence postural responses to visual stimuli during quiet stance. Gait Posture, 25, pp.49-55. 2007. https://doi.org/10.1016/j.gaitpost.2005.12.013
  20. Duh, H. B., Lin, J. J, Kenyon, R. V., Parker, D. E., & Furness, T. A. Effects of Field of View on Balance in an Immersive Environment. In Proc. Of IEEE Virtual Reality, pp.235-240. 2001.
  21. P. R. Desai et al. A Review Paper on Oculus Rift-A Virtual Reality Headset, International Journal of Engineering Trends and Technology (IJETT). Volume 13 Number 4. 2014.
  22. Davson, H. Physiology of the Eye, Pergamon, New York. 1990.
  23. Keller, K., & Colucci, D. Perception in HMDs. What is it in Head Mounted Displays (HMDs) that really make them all so terrible?. Proc. SPIE, Helmet- and Head-Mounted Displays III, pp.3362.1998.
  24. Schiefele, J., Albert, O., Dorr, Kelz, M., Schmidt-Winkel, N. Evaluation of required HMD Resolution and Field of View for a Virtual Cockpit Simulation. Part of the SPIE Conference on Helmet- and Head-Mounted Displays IV, pp.143-154. 1999.
  25. Wright, S. L., Bailey, I. L., Tuan, K., & Wacker, R. T. Resolution and Legibility: A comparison of TFT LCDs and CRTs. Journal of the society for Information Display, 7(4), pp.253-256. 1999. https://doi.org/10.1889/1.1985290
  26. Huang, D., Patrick Rau, P., -L., & Liu, Y. Effects of font size, display resolution and task type on reading Chinese fonts from mobile devices. International Journal of Industrial Ergonomics, 39, pp.81-89. 2009. https://doi.org/10.1016/j.ergon.2008.09.004
  27. Jaa-Aro, K., & Kjelldahl, L. Effects of Image Resolution on Depth Perception in Stereo and Non-Stereo Images, Stockholm, Sweden. 1997.
  28. Yang-Wai Chow, Ronald Pose, Matthew Regan, James Phillips. The effects of Head-Mounted Display Attributes on Human Visual Perception of Region Warping Distortions. Proc. of Image and Vision Computing New Zealand, pp.500-505. 2005.
  29. Mania, K., Adelstein, B. D, Ellis, S. R., & Hill, M. I. Perceptual Sensitivity to Head Tracking Latency in Virtual Environments with Varying Degree of Scene Complexity. Proceedings of the 1st Sympositum on Applied perception in graphics and visualization, 2004, pp.39-47. 2004.
  30. Regan, M., Miller, G., Rubin, S., & Kogelnik, C. A real-time low-latency hardware light-field renderer. In Proc, of ACM SIGGRAPH' 99, pp.287-290. 1999.
  31. MacKenzie, I. S., &Ware, C. Lag as a determinant of human performance in interactive systems. Proceedings of the ACM Conference on Human Factors in Computing Sytems, pp.488-493. New York: ACM. 1993.
  32. Meehan, M., Razzaque, S., Whitton, M. C., & Brooks Jr, F. P. Effect of Latency on Presence in Stressful Virtual Environments. In Proc. Of IEEE Virtual Reality, pp.141. 2003.
  33. Moss, J. D., Muth, E. R., Tyrrell, R. A., & Stephens, B. R. Perceptual thresholds for display lag in a real visual environment are not affected by field of view or psychophysical technique, Displays, 31, pp.143-149. 2010. https://doi.org/10.1016/j.displa.2010.04.002
  34. Sei-Young Kim, Joong Ho Lee, Ji Hyung Park. The effects of visual displacement on simulator sickness in video see-through head-mounted displays. ISWC '14 Proceedings of the 2014 ACM International Symposium on Wearable Computers, Pages pp.79-82. 2014.
  35. Rolland, J. P, Barlow, T., Biocca, F. A., & Kancherla, A. Quantification of Adaptation to Vritual-Eye Location In See-Thru Head-Mounted Displays, Proceeding of the Virtual Reality Annual International Symposium, pp.56-66. 1995.
  36. Rolland, J. P., Holloway, R. L., & Fuchs, H. A Comparison of Optical and Video See-through Head-Mounted Displays. Telemanipulator and Telepresence Technologies, 2351, pp.293-307. 1994. https://doi.org/10.1117/12.197322
  37. Park, M., Serefoglou, S., Schmidt, L., Radermacher, K., Schlick, C., & Luczak, H. Hand-Eye Coordination Using a Video See-Through Augmented Reality System. The Ergonomics Open Journal, pp.46-53. 2008. https://doi.org/10.2174/1875934300801010046
  38. Lee, J. H., Kim, S. Y., Yoon, H. C., Huh, B. K., & Park, J. H. A Preliminary Investigation of Human Adaptations for Various Virtual Eyes in Video See-Through HMDs. Proceedings of the SIGCHI Conference on Human Factor in Computing Systems, pp.309-312. 2013.
  39. Nattapong P., Fusak C. Contrast Image Enhancement Using Multi-Histogram Equalization. International Journal of Advanced Culture Technology Vol.3 No.2 pp.161-170. 2015. https://doi.org/10.17703/IJACT.2015.3.2.161
  40. Joong Ho Lee, Sei-Young Kim, Hae Cheol Yoon, Ji Hyung Park. An Empirical Study of Out-of -Body Experience Induced by Horizontal Camera Shift on Video See-through HMD. PROCEEDINGS OF HCI KOREA, 2014.2, pp.97-100. 2014.