• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.7
• /
• pp.2531-2546
• /
• 2021

For several years, virtual reality (VR) and augmented reality (AR) technologies have been improving. However, some hurdles remain that slow down the distribution of VR and AR devices, such as head-mounted display (HMD), and related consumer content. One issue is VR motion sickness, which has been experienced by users using 360 degree VR content via HMD. This paper discusses the related international standardization work that classifies the factors causing VR sickness, and proposes the process for VR sickness level evaluation. Among the factors causing VR sickness, many research institutes regard minimizing MTP (Motion-to-Photon) latency as the key enabler to mitigate VR sickness. Thus, this paper introduces research trends of MTP latency measurement and MTP latency mitigation. This paper categorizes the research on MTP latency measurement into 2 categories of hardware-based approach and software code-level approach. The 2 approaches have different pros and cons depending on use-case, purpose, and architecture of each multimedia system. The pros and cons are addressed in this paper. Additionally, the research on mitigating MTP latency with diverse strategies such as proactive computing, caching, and edge server technology is explained, and compared to conventional technologies, shows improved performance.

• Journal of Broadcast Engineering
• /
• v.25 no.1
• /
• pp.113-116
• /
• 2020

This paper proposes a Quality of Experience (QoE) evaluation experiment to measure the effects of 360-degree video and sensory effects on the subject's degree of immersion, satisfaction, and sense of presence. The test subject responds to a questionnaire about the degree of immersion, satisfaction, and sense of presence after experiencing a 360-degree video accompanied by sensory effects while wearing a head-mounted display (HMD) with a scent diffusion device. As a result of the response analysis, it was confirmed that the proposed experimental method is suitable for measuring the subject's degree of immersion, satisfaction, and sense of presence about 360-degree video and sensory effects. On the other hand, inserting a gray screen for comparison experiments while watching a 360-degree video was found to cause a significant decrease in immersion and realism.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.06a
• /
• pp.96-99
• /
• 2018

최근 초고화질 영상뿐만 아니라 360 비디오 콘텐츠의 보급이 확산되고 있다. 이미 대중적으로 보급된 스마트폰을 통해 누구나 쉽게 이 360 비디오 콘텐츠를 접할 수 있는데, 스마트폰의 성능은 제한적일 수 밖에 없다. 따라서 본 논문은 모바일 VR 에서 360 비디오 병렬처리를 수행할 때 보다 적합한 최적화 방법 2 가지를 소개한다. 이를 위해 전력 소모를 줄이는 장점으로 인해 모바일 디바이스에 많이 사용되는 비대칭 멀티코어의 특징을 활용한다. 두 방법 모두 공통적으로 각 코어의 성능비와 할당되는 작업량을 비례하게 하여 디코딩 작업의 시간을 줄이는 방법들이다. 첫 번째 방법은 영상을 타일로 분할할 때 각 코어의 성능비와 비례하게 분할하는 방법이다. 해당 기법을 적용하기 위해서, 비디오 크기별 연산 복잡도 분석 모델을 활용하여 사용한다. 제안하는 기법을 사용한 실험 결과, 평균적으로 약 25%의 디코딩 시간 개선을 보였다. 두 번째 방법은 타일로 분할된 영상의 각 복잡도 정도를 PU 의 양으로 추정하여, 각 코어의 성능비와 비례하게 코어에 할당하는 방법이다. 해당 기법을 사용하기 위해서, PU 의 양과 연산 복잡도 정도의 상관관계를 회귀분석하여 이를 이용한다. 제안하는 기법을 사용한 실험 결과, 약 9~16%의 디코딩 시간 개선을 보였다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.22 no.11
• /
• pp.1489-1494
• /
• 2018

Recently, culture technology (CT), which combines cultural contents and IT technology, is being watched as a new growth engine, and IT technology is actively utilized in preserving, inheriting and utilizing cultural heritage. For this, new areas of convergence of IT technology and cultural heritage are attracting attention. In particular, virtual reality is a representative area of IT convergence in the era of the fourth industrial revolution. Although some studies have been conducted to utilize virtual reality technology to preserve and inform cultural heritage, it is mainly limited to tangible cultural properties. In this study, we propose a methodology to develop contents of intangible cultural heritage using virtual reality technology in intangible cultural properties. To do this, we classify the types of intangible cultural properties to apply the technology to each type of intangible cultural property. Next, virtual reality, augmented reality, and $360^{\circ}VR$ video technology are applied to the intangible cultural properties classified.

• Electronics and Telecommunications Trends
• /
• v.32 no.5
• /
• pp.39-48
• /
• 2017

Since the world's first 3D commercial film with red-blue glasses was introduced in 1922, remarkable progress has been made in the field of 3D video. 3D video content gained enormous popularity with the movie "Avatar," which greatly increased the sale of 3D TVs. This momentum has weakened owing to lack of 3D content. However, the recent trend of virtual reality (VR) and augmented reality (AR) made 360 VR video and 3D games using a head mounted display wide spread. All these experiences mentioned above require wearing glasses to enjoy 3D content. Super multi-view content technology, on the other hand, enables viewers to enjoy 3D content without glasses on a super multi-view display. In this article, we introduce the technologies used to make super multi-view content, interact with it, and author content, which are developed by ETRI.

• Journal of Multimedia Information System
• /
• v.6 no.4
• /
• pp.309-316
• /
• 2019

Virtual Reality is broadly recognized as an "empathy machine". This reputation is due to the feeling of 'presence' that it provides to users, which is the sensation of being bodily present in a space, even when that space is virtual. The possibility of complete immersion attracts many creators looking to induce empathy and awareness about the most diverse subjects. One of the first types of VR non-fiction productions to be released was in the morally sensitive humanitarian documentary genre. This research aims to explore how VR productions differ from non-VR productions with a focus on humanitarian communication. Rather than targeting mechanical aspects of VR technology, this article compares the visual and narrative storytelling characteristics in VR and non-VR media. First, humanitarian communication and its nuances are explained. Then, 360° video filming characteristics are analyzed, followed by a comparison table contrasting VR and non-VR non-fiction. After evaluating VR non-fiction empirical studies, a discussion is initiated over the betterment of VR non-fiction storytelling in a way that could help it generate more empathy, since many productions seem to purely rely on the technology as a production novelty, and end up lacking emotional depth and audience engagement through story.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.3
• /
• pp.67-77
• /
• 2022

The sense of touch by natural wind is one of the most common feels that every person experiences in daily life. However, it has been rarely studied how natural wind can be reproduced in a VR environment and whether the multisensory contents equipped with artificial winds do improve human emotion or not. To address these issues, we first propose a wind reproduction VR system guided by video and wind capture data and also study the effect of the system on positive affect. We collected wind direction and speed data together with a 360-degree video on a yacht. These pieces of data were used to produce a multisensory VR environment by our wind reproduction VR system. 19 college students participated in the experiments, where the Korean version of Positive and Negative Affect Schedule (K-PANAS) was introduced to measure their emotions. Through the K-PANAS, we found that 'inspired' and 'active' emotions increase significantly after experiencing the yacht VR contents with artificial wind. Our experimental results also show that another emotion, 'interested', is most notably affected depending on the presence of the wind. The presented system can be effectively used in various VR applications such as interactive media and experiential contents.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.51-54
• /
• 2020

본 논문에서는 360 도 VR 영상을 전송하는 기법의 일종인 타일 기반 전송을 MMT(MPEG Media Transport) 프로토콜 기반으로 구현하기 위하여 영상의 공간 분할 정보를 전달하는 방법을 소개한다. 360 도 VR 영상 전송은 대용량 미디어 전송인 동시에 사용자의 움직임에 따라 신속하게 적응적 영상을 전달해야 한다. 타일 기반 전송은 HEVC(High Efficiency Video Coding)의 MCTS(Motion Constrained Tile Sets) 기법을 이용하여 뷰포트에 해당하는 타일들을 고화질로 전달함으로써 이러한 요구사항을 해결한다. 반면, MMT 프로토콜은 초저지연 고화질 영상 전송에 유리한 기술로써 사용자의 시점 변화에 따라 기민하게 영상의 품질을 변환시킬 수 있다. 따라서 HEVC 의 SEI(Supplemental Enhancement Information) 메시지에 포함되는 타일들의 공간 분할 정보를 MMT 프로토콜에 적용하는 방식에 따라 적응적 타일 기반 전송 기법의 효율을 높일 수 있다.

• Journal of Korea Game Society
• /
• v.20 no.6
• /
• pp.43-52
• /
• 2020

This paper presents a fast pattern tracking method using location prediction in cubemap video for 360-degree VR. A spherical cubemap frame has six face textures and searching a pattern is much slower than a flat image. To overcome the limitation, we propose a method of predicting the location of target pattern using Kalman filter and reducing the search area by considering only textures of predicted location. The experimental results showed that the proposed system is much faster than the previous method of searching all six faces and also gives accurate pattern tracking performance.

• Journal of Broadcast Engineering
• /
• v.25 no.2
• /
• pp.185-191
• /
• 2020

MPEG-I is actively working on standardization on the immersive video coding which provides up to 6 degree of freedom (6DoF) in terms of viewpoint. In a virtual space of 3DoF+, which is defined as an extension of 360 with motion parallax, looking at the scene from another viewpoint (another position in space) requires rendering an additional viewpoint using multiple videos included in the 3DoF+ video. In the MPEG-I Visual workgroup, efficient coding methods for 3DoF+ video are being studied, and they released Test Model for Immersive Video (TMIV) recently. This paper presents a patch packing method which packs the patches into atlases efficiently for improving coding efficiency of 3DoF+ video in TMIV. The proposed method improves the reconstructed view quality with reduced coding artifacts by introducing guardbands between patches in the atlas.