• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.11a
• /
• pp.252-255
• /
• 2019

본 논문에서 Equirectangular projection(ERP) 영상을 행동 인식 모델에 입력하기전 제안하는 전처리를 통하여 성능을 향상시키는 것을 보인다. ERP 영상의 특성상 행동 인식을 하는데 불필요한 영역이 일반적인 2D 카메라로 촬영한 영상보다 많다. 또한 행동 인식은 사람이 Object of Interest(OOI)이다. 따라서 객체 인식모델로 인간 객체를 인식한 후 Region of Interest(ROI)를 추출하여 불필요한 영역을 없애고, 왜곡 또한 줄어든다. 본 논문에서 제안하는 기법으로 전처리 후 CNN-LSTM 모델로 성능을 테스트했다. 제안하는 방법으로 전처리를 한 데이터와 하지 않은 데이터로 행동 인식을 한 정확도로 비교하였으며 제안하는 기법으로 전처리 한 데이터로 행동 인식을 한 경우 데이터의 특성에 따라 다르지만, 최대 61%까지 성능향상을 보였다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.7
• /
• pp.2531-2546
• /
• 2021

For several years, virtual reality (VR) and augmented reality (AR) technologies have been improving. However, some hurdles remain that slow down the distribution of VR and AR devices, such as head-mounted display (HMD), and related consumer content. One issue is VR motion sickness, which has been experienced by users using 360 degree VR content via HMD. This paper discusses the related international standardization work that classifies the factors causing VR sickness, and proposes the process for VR sickness level evaluation. Among the factors causing VR sickness, many research institutes regard minimizing MTP (Motion-to-Photon) latency as the key enabler to mitigate VR sickness. Thus, this paper introduces research trends of MTP latency measurement and MTP latency mitigation. This paper categorizes the research on MTP latency measurement into 2 categories of hardware-based approach and software code-level approach. The 2 approaches have different pros and cons depending on use-case, purpose, and architecture of each multimedia system. The pros and cons are addressed in this paper. Additionally, the research on mitigating MTP latency with diverse strategies such as proactive computing, caching, and edge server technology is explained, and compared to conventional technologies, shows improved performance.

• Journal of Broadcast Engineering
• /
• v.21 no.5
• /
• pp.714-725
• /
• 2016

With the recent emergence of VR contents, a lot of attention has been drawn on actual image based VR 360° video production using photography system. It was very complicated and difficult to make conventional VR contents. Therefore, such making was performed only in a research level. These days, as cameras have been made smaller, VR live-action has become more common in contents makers. In the circumstance, this study tries to compare a variety of contents making equipment based on action-cam that is mainly used for producing VR contents, and suggest their problems. To solve the problems, this study uses a cinema grade camera to do VR filming. As a result, it is revealed that, in order to make VR contents with quality, it is necessary to use a cinema grade camera, rather than an action cam, and to conduct technical research for standard lens based contents.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.7 no.8
• /
• pp.1792-1801
• /
• 2003

In these days, image mosaic is getting interest in the field of advertisement, tourism, game, medical imaging, and so on with the development of internet technology and the performance of personal computers. The main problem of mage mosaic is searching corresponding points correctly in the overlapped area between images. However, previous methods requires a lot of CPU times and data processing for finding corresponding points. And they need repeated recording with a revolution of 360 degree around objects or background. This paper presents a new image mosaic method which generates a panorama image from a video sequence recorded by a general video camera. Our method finds the corresponding points between two successive images by using a new direction oriented 3­step block matching methods. Experimental results show that the suggested method is more efficient than the methods based on existing block matching algorithm, such as full search and K­step search algorithm.

• Information Systems Review
• /
• v.22 no.2
• /
• pp.25-41
• /
• 2020

Along with the expectation about 5G network commercialization, interests in realistic and immersive media industries such as virtual reality (VR) are increasing. However, most of studies on VR still focus on video technologies instead of factors for popularity and consumption. Thus, the main objective of this research is to identify meaningful factors, which affect the view counts of VR videos and to provide business implications of the content strategies for VR video creators and service providers. Using a regression analysis with 700 VR videos, this study tries to find major factors that affect the view counts of VR videos. As a result, user assessment factors such as number of likes and sicknesses have a strong influence on the view counts. In addition, the result shows that both general information factors (video length and age) and content characteristic factors (series, one source multi use (OSMU), and category) are all influential factors. The findings suggest that it is necessary to support recommendation and curation based on user assessments for increasing popularity and diffusion of VR video streaming.

• Journal of Broadcast Engineering
• /
• v.26 no.5
• /
• pp.508-518
• /
• 2021

Recently as a result of covid 19, it has emphasis on the importance of non-contact. VR content has been attracting attention as an alternative to visual arts, media art, new media exhibitions and performances with limited offline activities. Although interest in 360 VR video contents such as VR contents for exhibitions and performances is increasing, research on immersion and satisfaction is focused on games and animation VR contents. In this paper, it verified the effect of the difference in the position and height of the VR camera in exhibitions and performances on the user's presence and satisfaction. For this experiment, the presence and satisfaction were measured after experiencing the VR contents of the convergence exhibition and performance filmed at different locations and heights. As a result of the experiment, the difference of VR camera's position had a significant effect on presence and satisfaction, the difference of VR camera's height had a significant effect only Realistic immersion of the presence.

• Physical Therapy Rehabilitation Science
• /
• v.13 no.2
• /
• pp.187-195
• /
• 2024

Objective: Physical activity can promote physical and mental well-being. University students are more sedentary recently due to the increased use of computers and other technology. The aim of this study was to investigate differences between immersive 360-degree virtual cycling (IVC) and virtual cycling with head-mounted display (VCHMD) on aerobic capacity and usability in young adults. Design: A crossover study. Methods: Twenty-five university students (13 male, 12 female) participated in this study and completed 2 separate 30 min cycling sessions, such as IVC and VCHMD. In the IVC, participants rode on a stationary cycle while watching curved TV where recorded video was played. To enhance the sense of realism, auditory stimulation was given to the headset, and the gyroscope sensor was used to track the screen as the head moved. In the VCHMD, participants rode on the stationary cycle with head-mounted display, and other conditions were the same as IVC. Participants were assessed the aerobic capacity which included gas analyzer and portable near-infrared spectroscopy, and usability which included simulator sickness questionnaire and system usability scale. Results: Aerobic capacity was significantly difference in the IVC compared with the VCHMD except for the total hemoglobin of right and left rectus femoris and muslce oxygen saturation of left rectus femoris (p<0.05). Cybersickness was less in the IVC than VCHMD and usability was high in the IVC than VCHMD (p<0.05). Conclusions: The findings suggested that IVC might be beneficial exericse to improve aerobic capacity and has lower cybersickness and higher usability than VCHMD.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.2B
• /
• pp.352-360
• /
• 2010

Supporting user perceptual QoE-guaranteed IP-based multimedia service such as IPTV and Mobile IPTV, we represent an efficient QoE-aware transport stream assessment schemes to apply realtime mobile IPTV's contents distorted by various network errors such as bandwidth, delay, jitter, and packet loss. This paper proposes in detail an efficient matching and QoE-aware measurement methods. The brightness of the digitized contents per each frames of transport streams is used and applied to reduced-reference method. The hybrid video quality metric is designed by QoE-indicators such as blur, block, edge busyness, and color error. We compare original with processed source to evaluate them in a high precision degree of accuracy.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.1
• /
• pp.291-304
• /
• 2019

This paper proposes a dynamic-tiling-based bandwidth-efficient (DTBE) virtual reality (VR) streaming scheme. We consider 360-degree VR contents with multiple view points such as the front, back, upper, and bottom sides. At a given time, the focus of a client is always bound to a certain view among multiple view points. By utilizing this perspective, under our proposed scheme, tiles with high encoding rates are selectively assigned to the focused view where multiple view points consist of multiple tiles with different encoding rates. The other tiles with low encoding rates are assigned to the remaining view points. Furthermore, for reducing view adaptation delay, we design a novel rapid view adaptation mechanism that selectively delivers an I-frame during view point updates by using frame indexing. We implement the proposed scheme on a commercial VR test bed where we adopt the MPEG media transport (MMT) standard with high-efficiency video coding (HEVC) tile modes. The measurement-based experiments show that the proposed scheme achieves an average data usage reduction of almost 65.2% as well as average view adaptation delay reduction of almost 57.7%.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.3
• /
• pp.67-77
• /
• 2022

The sense of touch by natural wind is one of the most common feels that every person experiences in daily life. However, it has been rarely studied how natural wind can be reproduced in a VR environment and whether the multisensory contents equipped with artificial winds do improve human emotion or not. To address these issues, we first propose a wind reproduction VR system guided by video and wind capture data and also study the effect of the system on positive affect. We collected wind direction and speed data together with a 360-degree video on a yacht. These pieces of data were used to produce a multisensory VR environment by our wind reproduction VR system. 19 college students participated in the experiments, where the Korean version of Positive and Negative Affect Schedule (K-PANAS) was introduced to measure their emotions. Through the K-PANAS, we found that 'inspired' and 'active' emotions increase significantly after experiencing the yacht VR contents with artificial wind. Our experimental results also show that another emotion, 'interested', is most notably affected depending on the presence of the wind. The presented system can be effectively used in various VR applications such as interactive media and experiential contents.