• 방송공학회논문지
• /
• 제27권6호
• /
• pp.848-859
• /
• 2022

본 논문은 일반적으로 사용되는 2D 디스플레이 또는 HMD (Head-Mounted Display) 기반 VR (Virtual Reality, VR) 서비스에서 탈피하여, 대형 가상현실 공연장을 위한 360도 비디오 스트리밍 시스템을 제안한다. 제안된 시스템은 Phase 1, 2, 3의 연구개발 단계를 밟아 6DoF (Degrees of Freedom) 시점 자유도를 지원하는 360도 비디오 스트리밍 시스템을 개발하는 것을 최종목표로 하고 있으며, 현재는 Phase 1: 대형 가상현실 공연장을 위한 3DoF 360도 비디오 스트리밍 시스템 프로토타입의 개발까지 완료되었다. 구현된 스트리밍 시스템 프로토타입은 서브픽처 기반 Viewport-dependent 스트리밍 기술이 적용되어 있으며, 기존 방식과 비교하였을 때 약 80%의 비트율 감소, 약 543%의 영상 디코딩 속도 향상을 확인하였다. 또한, 단순 구현 및 성능평가에서 그치지 않고, 실제 미국 UCSB (University of California, Santa Barbara)에 위치한 대형 가상현실 공연장 AlloSphere에서의 시범방송을 수행하여, 향후 Phase 2, 3 연구단계를 위한 연구적 기반을 마련하였다.

• 한국방송∙미디어공학회:학술대회논문집
• /
• 한국방송공학회 1999년도 KOBA 방송기술 워크샵
• /
• pp.87-93
• /
• 1999

In this paper, we introduce a novel virtual studio environment where a broadcaster in the virtual set interacts with tele-viewers as if they are sharing the same environment as participants. A tele-viewer participates physically in the virtual studio environment by a dummy-head equipped with video "eyes" and microphone "ears" physically located in the studio. The dummy head as a surrogate of the tole-viewer follows the tele-viewer's head movements and views and hears through the dummy head like a tele-operated robot. By introducing the tele-presence technology in the virtual studio setting, the broadcaster can not only interact with the virtual set elements like the regular virtual studio environment but also share the physical studio with the surrogates of the tele-viewers as participants. The tele-viewer may see the real broadcaster in the virtual set environment and other participants as avatars in place of their respective dummy heads. With an immersive display like HMD, the tele-viewer may look around the studio and interact with other avatars. The new interactive virtual studio with the immersive viewer environment may be applied to immersive tele-conferencing, tele-teaching, and interactive TV program productions.program productions.

• ETRI Journal
• /
• 제44권1호
• /
• pp.62-72
• /
• 2022

In this study, we propose a multi-GPU-based 8KVR stitching system that operates in real time on both local and cloud machine environments. The proposed system first obtains multiple 4 K video inputs, decodes them, and generates a stitched 8KVR video stream in real time. The generated 8KVR video stream can be downloaded and rendered omnidirectionally in player apps on smartphones, tablets, and head-mounted displays. To speed up processing, we adopt group-of-pictures-based distributed decoding/encoding and buffering with the NV12 format, along with multi-GPU-based parallel processing. Furthermore, we develop several algorithms such as equirectangular projection-based color correction, real-time CG overlay, and object motion-based seam estimation and correction, to improve the stitching quality. From experiments in both local and cloud machine environments, we confirm the feasibility of the proposed 8KVR stitching system with stitching speed of up to 83.7 fps for six-channel and 62.7 fps for eight-channel inputs. In addition, in an 8KVR live streaming test on the 5G MEC/cloud, the proposed system achieves stable performances with 8 K@30 fps in both indoor and outdoor environments, even during motion.

• 한국정보전자통신기술학회논문지
• /
• 제11권4호
• /
• pp.414-420
• /
• 2018

최근 디지털 컨버전스는 현실세계를 기반으로 만들어진 미디어 콘텐츠에 가상 콘텐츠를 투영시켜 사용자에게 새로운 경험을 제공 할 수 있도록 발전하고 있다. 이에 본 논문에서는 HMD AR 기술을 이용한 Light ID 및 HMD-AR 기반 인터렉티브 전시를 제안하였다. 이 접근법은 현재 사용되고 있는 전시물에 추가적인 인프라를 설치할 필요 없이 기존 사용되고 있는 조명 또는 디스플레이를 사용 할 수 있다. 또한 Light ID는 웹 콘텐츠로의 접근을 위해서만 사용되는 QR 태그와 달리 위치 인식을 위한 식별자 및 통신 매체로도 사용될 수 있는데, 이는 카메라를 기반으로 한 광 무선 통신 (OWC)의 장점을 활용하여 스마트 장치에서 미디어 콘텐츠에 대한 ID를 수신하고 AR형태로 실감 3D 콘텐츠를 시각화하여 제공한다. 본 논문에서는 안드로이드 스마트폰을 사용하여 제안한 설계 기법에 대해 전주 한옥 마을을 타겟으로 Light ID 기반 광무선통신 기술을 활용한 실감 3D View 제공 기술을 구현하고 테스트를 수행하였으며, 실험 결과 제안한 기법을 통해 전시물에 관한 실시간 몰입형 3D 뷰를 제공 할 수 있음을 확인하였다.

• Journal of Construction Engineering and Project Management
• /
• 제9권4호
• /
• pp.16-33
• /
• 2019

The increasing size and complexity of modern construction projects demands mature capabilities of onsite personnel with regard to recognizing unsafe situations. Construction safety training is paper or computer-based and suffers from a distinct gap between the classroom training environment and real-world construction sites; even trained personnel can find it difficult to recognize many of the potential safety hazards at their jobsites even after receiving construction safety training. Immersive technologies can overcome the current limitations in construction safety training by reducing the gap between the classroom and a real construction environment. This research developed and tested a new Augmented Reality (AR)-based assessment tool to evaluate the hazard recognition skills of students majoring in construction management as part of a construction safety course. The quantitative and qualitative results of this research confirmed that AR-based assessment can become a very effective assessment tool to evaluate safety knowledge and skills in a construction safety course, outperforming both paper and computer-based assessment methods. The students preferred AR-based assessment because it provides a realistic visual context for real world safety hazards.

• ETRI Journal
• /
• 제38권1호
• /
• pp.149-158
• /
• 2016

In the field of augmented reality technologies, commercial optical see-through-type wearable displays have difficulty providing immersive visual experiences, because users perceive different depths between virtual views on display surfaces and see-through views to the real world. Many cases of augmented reality applications have adopted eyeglasses-type displays (EGDs) for visualizing simple 2D information, or video see-through-type displays for minimizing virtual- and real-scene mismatch errors. In this paper, we introduce an innovative optical see-through-type wearable display hardware, called an EGD. In contrast to common head-mounted displays, which are intended for a wide field of view, our EGD provides more comfortable visual feedback at close range. Users of an EGD device can accurately manipulate close-range virtual objects and expand their view to distant real environments. To verify the feasibility of the EGD technology, subject-based experiments and analysis are performed. The analysis results and EGD-related application examples show that EGD is useful for visually expanding immersive 3D augmented environments consisting of multiple displays.

• International Journal of Internet, Broadcasting and Communication
• /
• 제13권1호
• /
• pp.161-167
• /
• 2021

This paper proposes a new personalized HRTF estimation method which is based on a deep neural network (DNN) model and improved elevation reproduction using a notch filter. In the previous study, a DNN model was proposed that estimates the magnitude of HRTF by using anthropometric measurements [1]. However, since this method uses zero-phase without estimating the phase, it causes the internalization (i.e., the inside-the-head localization) of sound when listening the spatial sound. We devise a method to estimate both the magnitude and phase of HRTF based on the DNN model. Personalized HRIR was estimated using the anthropometric measurements including detailed data of the head, torso, shoulders and ears as inputs for the DNN model. After that, the estimated HRIR was filtered with an appropriate notch filter to improve elevation reproduction. In order to evaluate the performance, both of the objective and subjective evaluations are conducted. For the objective evaluation, the root mean square error (RMSE) and the log spectral distance (LSD) between the reference HRTF and the estimated HRTF are measured. For subjective evaluation, the MUSHRA test and preference test are conducted. As a result, the proposed method can make listeners experience more immersive audio than the previous methods.

• 융합정보논문지
• /
• 제8권1호
• /
• pp.173-177
• /
• 2018

본 연구는 완전 몰입형 가상현실 게임을 통하여 완전 몰입형 가상현실 동작과 실제 동작에서의 근수축 개시시간을 비교 하여 보고자 한다. 정상성인 30명을 대상으로 가상현실 동작(펀치, 활쏘기)과 실제 동작(펀치, 활쏘기)에서의 근수축 개시시간을 비교하여 보았다. 본 연구 결과 가상현실 동작과 실제 동작에서의 근수축 개시시간에는 유의한 차이가 없었다(p>0.05). 본 연구를 통하여 물리치료와 완전 몰입형 가상현실을 융합하여 새로운 완전 몰입형 가상현실 콘텐츠를 개발 하여 물리치료에 적용 할 수 있을 것으로 생각되며, 다양한 치료 방법이 개발 될 것으로 보인다. 또한 추후 연구에서 뇌졸중 환자를 대상으로 완전 몰입형 가상현실을 적용하여 치료에 적용 할 수 있을지 알아볼 필요가 있다.

• International Journal of Internet, Broadcasting and Communication
• /
• 제15권2호
• /
• pp.196-201
• /
• 2023

In recent years, virtual reality (VR) technology has been widely used in many industrial fields, especially in the fields of medical treatment, games, film and television, to improve the interaction between medical teaching and practical treatment. On the gaming side, the production of virtual reality gaming screens and scenes became increasingly popular, greatly expanding the form of the visual experience. But VR is no longer confined to the health care, education and entertainment industries. During this time, the news media industry has also begun to integrate virtual reality into interviews and user interactions. This study aims to analyze the development of VR technology from the perspectives of immersive VR news experience, real reporting, and prospects, and analyze and think about the interactive participation of media users, the transformation of traditional media, and the upgrading of practitioners' roles.

• International Journal of Internet, Broadcasting and Communication
• /
• 제15권4호
• /
• pp.172-177
• /
• 2023

This study explores the feasibility and potential of using virtual reality (VR) technology to enhance the museum viewing experience through digital media. In an increasingly digital world, museums face the challenge of adapting to changing visitor expectations. This study explores the integration of virtual reality and digital media as a means to engage, educate, and attract museum visitors in a novel, immersive way. By analyzing its advantages, challenges, and practical implications, this study aims to elucidate the feasibility of this transformative approach.