• Journal of Broadcast Engineering
• /
• v.25 no.2
• /
• pp.265-274
• /
• 2020

Free-viewpoint video service is a technology that allows users to watch at any angle, location and distance through interaction. In this paper, the free-viewpoint video services are defined in four viewing modes: Inward view, outward view, 3D object view and first person view. And we developed and implemented a new integrated program that plays all the suggested views. In the contents of girl band performances and basketball games, multi-view cameras suitable for each viewing mode are installed to acquire media, and data stored on the server is streamed over the network, making it available for viewing. Users can freely choose four viewing modes, space location, angle and so on, and the media data such as images and sounds are provided to them by rendering appropriately for the selected the viewpoint. Our system is expected to be a scalable free-viewpoint video service player as well as provide users with immersion and presence by combining various viewing modes.

• Journal of Broadcast Engineering
• /
• v.27 no.4
• /
• pp.548-560
• /
• 2022

Video based Point Cloud Compression (V-PCC) is one of the compression methods for compressing point clouds, and shows high efficiency in dynamic point cloud compression with movement due to the feature of compressing point cloud data using an existing video codec. Accordingly, V-PCC is drawing attention as a core technology for immersive content services such as AR/VR. In order to effectively service these V-PCC contents through a media streaming platform, it is necessary to encapsulate them in the existing media file format, ISO based Media File Format (ISOBMFF). However, in order to service through an adaptive streaming platform such as Dynamic Adaptive Streaming over HTTP (DASH), it is necessary to encode V-PCC contents of various qualities and store them in the server. Due to the size of the 2D media, it causes a great burden on the encoder and the server compared to the existing 2D media. As a method to solve such a problem, it may be considered to configure a streaming platform based on content obtained through V-PCC content encoding based on SHVC. Therefore, this paper encapsulates the SHVC-based V-PCC bitstream into ISOBMFF suitable for DASH service and proposes a configuration method to service it. In addition, in this paper, we propose ISOBMFF encapsulation and DASH configuration method to effectively service SHVC-based V-PCC contents, and confirm them through verification experiments.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.23 no.5
• /
• pp.169-175
• /
• 2023

This paper analyzes museum-related big data using museums and gamification using social media big data, identifies and compares the perceptions of visitors mentioned in social media, and presents ways to use gamification. Based on the collected data, this paper aims to provide data by comparing and analyzing the perception of visitors to the museum and visitors to the museum using gamification. This paper investigates the perception of visitors through social media analysis using TEXTOM, a social media analysis tool, to identify differences in perception. As a result of the analysis, it was found that compared to museums that were previously viewed in the form of exhibitions, they felt fun and interest in visiting museums using geikipication. In addition, based on the analysis results of keywords and related keywords, the perception, motivation, and type of viewing of the museum of the National Museum of Korea and the Independence Hall of Korea were confirmed. In addition, it can be seen that the sense of achievement of visitors who visited the museum using gamification is higher than that of the existing museum. It is believed that by developing and activating game-related content in future museum visits, many visitors will be able to increase their interest in the museum and feel fun and interested. The results of the study are believed to be meaningful as basic data to grasp the overall perception of visitors to the museum, and based on this, it is expected that visitors will be able to see and experience the museum in various ways.

• Journal of Broadcast Engineering
• /
• v.12 no.4
• /
• pp.333-341
• /
• 2007

Multi-view video has recently gained much attraction from academic and commercial fields because it can deliver the immersive viewing of natural scenes. This paper presents multi-view video processing being composed of intermediate view reconstruction (IVR), graphics composition, and multi-view video viewer. First we generate virtual views between multi-view cameras using depth and texture images of the input videos. Then we mix graphic objects to the generated view images. The multi-view video viewer is developed to examine the reconstructed images and composite images. As well, it can provide users with some special effects of multi-view video. We present experimental results that validate our proposed method and show that graphic objects could become the inalienable part of the multi-view video.

• Journal of Broadcast Engineering
• /
• v.22 no.6
• /
• pp.808-816
• /
• 2017

360 VR video systems has become important to provide immersive effect for viewers. The system consists of stitching, projection, compression, inverse projection, viewport extraction. In this paper, an efficient luminance compensation technique for 360 VR video sequences, where feature extraction and histogram equalization algorithms are utilized. The proposed luminance compensation algorithm enhance the performance of stitching in 360 VR system. The simulation results showed that the proposed technique is useful to increase the quality of the displayed image.

• Journal of the Korean Society of Industry Convergence
• /
• v.23 no.3
• /
• pp.453-461
• /
• 2020

In this study, we conducted technology monitoring to search for the current technology level and new technologies targeting the core technologies selected as "convergence technologies based on advanced ICT". This technology group, selected by the National Research Foundation(NRF) as one of the future-emerging technologies in 2018, consists of 'next-generation millimeter wave wireless communication technology', 'data-centric computing technology', and 'immersive media interface' that can be seen as important technologies in the fourth industrial revolution. It is possible to provide strategic research direction to the R&D-related stakeholders of countries or enterprises by providing information on newly emerged technologies through quantitative analysis based on patent data on these technologies. Therefore, in this study, we proposed a new technology for the convergence technologies based on advaned ICT group through patent data based on the newly emerged IPC code, and also suggested that it can suggest a strategic direction in planning R&D on related technologies.

• Journal of Computational Design and Engineering
• /
• v.2 no.1
• /
• pp.38-46
• /
• 2015

Augmented reality based on projection, called "Spatial Augmented Reality (SAR)", is a new technology that can produce immersive contents by overlapping virtuality and real-world environment. It has been paid attention as the next generation digital contents in media art and human-computer interaction (HCI). In this paper, we present a new methodology to evaluate the product appearance design more intuitively by means of SAR technique. The proposed method first projects the high-quality rendered image considering the optical property of materials onto the mock-up of a product. We also conduct a projector-camera calibration to compensate a color distortion according to a projector, a projection surface and environment lighting. The design evaluation methodology we propose offers more flexible and intuitive evaluation environment to a designer and user (evaluator) than previous methods that are performed via a digital display. At the end of this research, we have conducted a case study for designing and evaluating appearance design of an automobile.

• Journal of Korea Game Society
• /
• v.13 no.5
• /
• pp.63-72
• /
• 2013

To enhance the effect of science educational contents, we developed a motion based training content: 3D space exploration. In this content, we used the 3D depth camera for user's motion recognition. Learners have to conduct the space station maintenance mission using the motion based natural and intuitive interface. The result this study is expected to propose the immersive training simulation for young science learners.

• Journal of the Korean Society of Visualization
• /
• v.15 no.1
• /
• pp.32-40
• /
• 2017

Interaction between fluid and a rigid object is frequently observed in everyday life. However, it is difficult to simulate their interaction as the medium and the object have different representations. One of the challenging issues arises especially in handling deformation of the object visually as well as rendering haptic feedback. In this paper, we propose a real-time simulation technique for multimodal interaction between particle-based fluids and soluble solids. We have developed the dissolution behavior model of solids, which is discretized based on the idea of smoothed particle hydrodynamics, and the changes in physical properties accompanying dissolution is immediately reflected to the object. The user is allowed to intervene in the simulation environment anytime by manipulating the solid object, where both visual and haptic feedback are delivered to the user on the fly. For immersive visualization, we also adopt the screen space fluid rendering technique which can balance realism and performance.

• Journal of the Korea Society of Computer and Information
• /
• v.20 no.11
• /
• pp.55-62
• /
• 2015

In this paper we propose a method to analyze user's motion as a game command, and implement a sports serious game applied the motion analysis method as a command interpreter. Recently, various contents platforms appear in industrial market, the computer game contents plays an important role in these emerging platforms as a killer contents. The computer game has enough values as an independent major cultural product, moreover it has the potential to be applied in various other fields such as education, healthcare, training, and so on. It could motivate users to do something continuously, and it could also support an immersive environment in a certain special game contents such as VR game. The Serious game 'ChoDeungGangHo', implemented in this paper, is the sensory healthcare serious game based on 3D run game and fitness game. It is designed for user to train the various exercise element by just playing the game, and it also supports the user management system and the linkage of social media. We proposes the sensory serious game 'ChoDeungGangHo' as a model of commercial serious game.