• ETRI Journal
• /
• v.45 no.6
• /
• pp.1046-1055
• /
• 2023

We introduce a display for virtual-reality (VR) fire training. Firefighters prefer to wear and operate a real breathing apparatus while experiencing full visual immersion in a VR fire space. Thus, we used a thin head-mounted display (HMD) with a light field and folded optical system, aiming to both minimize the volume for integration in front of the face into a breathing apparatus and maintain adequate visibility, including a wide viewing angle and resolution similar to that of commercial displays. We developed the optical system testing modules and prototypes of the integrated breathing apparatus. Through iterative testing, the thickness of the output optical module in front of the eyes was reduced from 50 mm to 60 mm to less than 20 mm while maintaining a viewing angle of 103°. In addition, the resolution and image quality degradation of the light field in the display was mitigated. Hence, we obtained a display with a structure consistent with the needs of firefighters in the field. In future work, we will conduct user evaluation regarding fire scene reproducibility by combining immersive VR fire training and real firefighting equipment.

• Journal of Broadcast Engineering
• /
• v.21 no.1
• /
• pp.43-50
• /
• 2016

In this paper, we present a distortion correction for wearable Augmented Reality (AR) on mobile phones. Head Mounted Display (HMD) using mobile phones, such as Samsung Gear VR or Google's cardboard, introduces lens distortion of the rendered image to user. Especially, in case of AR the distortion is more complicated due to the duplicated optical systems from mobile phone's camera and HMD's lens. Furthermore, such distortions generate mismatches of the visual cognition or perception of the user. In a natural way, we can assume that transparent wearable displays are the ultimate visual system which generates the least misperception. Therefore, the image from the mobile phone must be corrected to cancel this distortion to make transparent-like AR display with mobile phone based HMD. We developed a transparent-like display in the mobile wearable AR environment focusing on two issues: pincushion distortion and field-of view. We implemented our technique and evaluated their performance.

• Journal of Korea Game Society
• /
• v.17 no.6
• /
• pp.19-28
• /
• 2017

There exist a variety of VR(Virtual Reality) contents that have been developed by the use of the latest VR technologies. Unlike the rapid advances in the recent VR devices however, the development of VR based game contents that fully utilize such cutting-edge devices has been lackluster. Using more accessible form of smartphone-based HMDs(Head-Mounted Displays), we compare two popular VR presentation methods(a realistic 3D VR karaoke room and a 360 degree video karaoke room) and analyze their users' immersion and realistic perception. We expect that our study can be utilized as a supporting guideline for future smartphone-based VR content developments.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.8
• /
• pp.1067-1073
• /
• 2021

Participants in the virtual environment will have an immersive and memorable perceived experience through interacting with virtual objects. Recently, commercial virtual reality technologies have released simple and cost-effective smartphone-based head-mounted displays (HMD) and high-quality wide field-of-view (FOV) HMDs. However, due to the vergence-accommodation conflict structure of HMD and the learned cognition mechanism in real, side effects such as dizziness and nausea remain challenging to overcome. This study focuses on consistent size perception among various cognitive difference factors, which are essential for interaction with virtual objects. We verified whether the visual angle, which affects the size perception of an object in real, is also the main factor in the virtual environment. Our experiments derived the relation between the visual angle and the environmental components, shadow, and grid, which help perceive a virtual object. As a result of the regression analysis, we presented that in the small FOV HMD environment, the visual angle affects size perception, and the relation between the shadow and the grid is statistically significant.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.5
• /
• pp.93-100
• /
• 2022

Korea's ancestral culture has limited travel and contact due to Corona (COVID-19). In addition, Korean ancestral culture meets in person to commemorate the deceased. In this paper, we propose a non-face-to-face metaverse memorial platform service that can commemorate the deceased and perform ancestral rites in the cyber world (virtual reality) by applying the metaverse technology. The services proposed in the study consisted of a remembrance hall that displays the life story of the deceased, a ancestral hall that conducts ancestral rites for the deceased, and a deceased pavilion that checks the remains and wills of the deceased. In addition, the virtual reality device (HMD: Head Mounted Display) set the teleportation and content resolution to 4K to minimize dizziness. In particular, the priests applied interaction technology to provide an immersive service for ancestral rites between family members. The researched memorial hall metaverse service is a metaverse-based platform service that allows anyone to commemorate the deceased as a family unit in a non-face-to-face state rather than face-to-face.

• Korean Journal of Computational Design and Engineering
• /
• v.12 no.2
• /
• pp.87-94
• /
• 2007

The functional behavior of a consumer electronic product is nearly all expressed with human-machine interaction (HMI) tasks. Although physical prototyping and computer aided design (CAD) software can show the appearance of the product, they cannot properly reflect its functional behavior. In this paper, we propose an approach to virtual prototyping (VP) that incorporates HMI functional simulation into virtual reality techniques in order to enables users to capture not only the realistic look of a consumer electronic product but also its functional behavior. We adopt state transition methodology to capture the HMI functional behavior of the product into a state transition chart, which is later used to construct a finite state machine (FSM) for the functional simulation of the product. The FSM plays an important role to control the transition between states of the product. We have developed a VP system based on the proposed approach. The system receives input events such as mouse clicks on buttons and switches of the virtual prototype model, and it reacts to the events based on the FSM by activating associated activities. The system provides the realistic visualization of the product and the vivid simulation of its functional behavior using head-mounted displays (HMD) and stereo speakers. It can easily allow users to perform functional evaluation and usability testing. A case study about the virtual prototyping of an MP3 player is given to show the usefulness of the proposed approach.

• International journal of advanced smart convergence
• /
• v.7 no.2
• /
• pp.135-142
• /
• 2018

Virtual reality (VR) technology has been increasingly more frequently used day by day in industries, entertainment and performances due to the development of AR and MR technologies. Performance arts also actively utilize $360^{\circ}$ VR technology due to the free expression of stage settings and auditoriums. However, technologies for systems in which performers wear VR devices firsthand rather than being in the sandpoint of bystanders while audiences wear VR head mounted displays(HMDs) to see performance stages have been rarely studied yet. This study investigated the technical possibilities of possible methods of expression that will enable performers to appear on the stage wearing VR devices. Since VR can maximize the sense of immersion with its closed HMD structure unlike augmented reality (AR), VR was judged to be suitable for studies centered on the mental interactions in the inner side of humans. Among them, to implement shamanistic expression methods with the phantoms of the body and soul, a motion capture technology linked with VR display devices and real-time cameras was realized on the stage. In this process, the importance of body ownership experienced by the performers (participants), reactions when they lost it, and the mental phenomena of the desire to possess the subjects of gaze could be seen. In addition, high possibility of development of this technology hereafter could be expected because this technology includes the technical openness that enables the audience to appear on the stage firsthand to become performers.

• ETRI Journal
• /
• v.44 no.1
• /
• pp.62-72
• /
• 2022

In this study, we propose a multi-GPU-based 8KVR stitching system that operates in real time on both local and cloud machine environments. The proposed system first obtains multiple 4 K video inputs, decodes them, and generates a stitched 8KVR video stream in real time. The generated 8KVR video stream can be downloaded and rendered omnidirectionally in player apps on smartphones, tablets, and head-mounted displays. To speed up processing, we adopt group-of-pictures-based distributed decoding/encoding and buffering with the NV12 format, along with multi-GPU-based parallel processing. Furthermore, we develop several algorithms such as equirectangular projection-based color correction, real-time CG overlay, and object motion-based seam estimation and correction, to improve the stitching quality. From experiments in both local and cloud machine environments, we confirm the feasibility of the proposed 8KVR stitching system with stitching speed of up to 83.7 fps for six-channel and 62.7 fps for eight-channel inputs. In addition, in an 8KVR live streaming test on the 5G MEC/cloud, the proposed system achieves stable performances with 8 K@30 fps in both indoor and outdoor environments, even during motion.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2022.06a
• /
• pp.1241-1244
• /
• 2022

최근 K-Pop 을 위시한 예술공연 콘텐츠에 몰입형 미디어를 접목한 온택트 (Ontact) 미디어 스트리밍 서비스가 주목받고 있는 가운데, 본 논문은 일반적으로 사용되는 2D 디스플레이 또는 HMD (Head-Mounted Display) 기반 VR (Virtual Reality, VR) 서비스에서 탈피하여, 대형 가상현실 공연장을 위한 360 도 VR 비디오 스트리밍 시스템을 제안한다. 제안된 시스템은 Phase 1, 2, 3 의 연구개발 단계를 밟아 6DoF (Degrees of Freedom) 시점 자유도를 지원하는 360 도 VR 비디오 스트리밍 시스템을 개발하는 것을 최종목표로 하고 있으며, 현재는 Phase 1: 대형 가상현실 공연장을 위한 3DoF 360 도 VR 비디오 스트리밍 시스템 프로토타입의 개발까지 완료되었다. 구현된 스트리밍 시스템 프로토타입은 서브픽처 기반 Viewport-dependent 스트리밍 기술이 적용되어 있으며, 기존 방식과 비교하였을 때 약 80%의 비트율 감소, 약 543%의 영상 디코딩 속도 향상을 확인하였다. 또한, 단순 구현 및 성능평가에서 그치지 않고, 실제 미국 UCSB 에 위치한 대형 가상현실 공연장 AlloSphere 에서의 시범방송을 수행하여, 향후 Phase 2, 3 연구단계를 위한 연구적 기반을 마련하였다.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.129-136
• /
• 2020

Augmented reality (AR) technology assists construction workers by superimposing additional virtual information onto their real worksite environments. Ideally, this provides them with a better understanding of their tasks and hence boosts task performance. However, the additional information that AR places in users' field of view could limit their ability to understand what is going on in their surroundings and to predict how conditions may change in the near future. AR-assisted systems on construction sites could therefore expose their users to safety risks due to disturbance from the system. Hence, it is important to understand how AR-assisted systems can block users' understanding of their immediate environments, and in turn, how worksite safety in the construction industry could be improved through better design of such systems. This preliminary research conducted a laboratory experiment that simulated rebar inspection tasks and compared the situational awareness of AR users against that of subjects using traditional paper-based inspection methods, as measured by the Situation Awareness Rating Technique. Based on the results, we discuss the safety impact of head-mounted AR-assisted displays on situational awareness during construction tasks.