• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.33-36
• /
• 2021

In this paper, we propose a new method for improving compression efficiency of immersive video using reinforcement learning. Immersive video means a video that a user can directly experience, such as 3DOF+ videos and Point Cloud videos. It has a vast amount of information due to their characteristics. Therefore, lots of compression methods for immersive video are being studied, and generally, a method, which projects an 3D image into 2D image, is used. However, in this process, a region where information does not exist is created, and it can decrease the compression efficiency. To solve this problem, we propose the reinforcement learning-based filling method with considering the characteristics of images. Experimental results show that the performance is better than the conventional padding method.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2020.11a
• /
• pp.70-71
• /
• 2020

In the era of autonomous ships, artificial intelligence technology will be able to provide a more advanced immersive experience by combining AR and VR. Immersion technology can provide a real-like experience and sensibility by dazzling the five senses of the user. In autonomous operation through VR or AR, it is necessary to provide a natural environment in which seafarers can immerse themselves in navigation and interact with virtual ships. In this study, in preparation for the era of autonomous ships, what are the key characteristics that seafarer can realize immersive user experience during autonomous navigation through VR or AR.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.3
• /
• pp.242-252
• /
• 2024

This study introduces a prototype for a virtual zoo initiative, aimed at optimizing resource utilization and minimizing animal displacement from their natural habitats. The prototype features a thoughtfully developed three-dimensional representation of an emperor penguin, with animations designed to emulate real-life behaviors. An investigation into file format distinctions for scientific research, encompassing Wavefront(OBJ), Collada(DAE), and Filmbox(FBX) formats, was conducted. The research utilized the Hololens 2 device for visualization, Unity for environment development, Blender for modeling, and C# for programming, with deployment facilitated through Visual Studio 2019 and the Mixed Reality Toolkit. Empirical examination revealed the OBJ format's suitability for simple geometric shapes, while DAE and FBX formats were preferred for intricate models and animations. DAE files offer detailed preservation of object structure and animations albeit with larger file sizes, whereas FBX files provide compactness but may face scalability constraints due to extensive data integration. This investigation underscores the potential of virtual zoos for conservation and education, advocating for further exploration and context-specific implementation.

• The Journal of the Korea Contents Association
• /
• v.10 no.8
• /
• pp.1-10
• /
• 2010

For virtual education, the multimodal learning environment with haptic feedback, termed 'immersive textbook', is necessary to enhance the learning effectiveness. However, the learning contents for immersive textbook are not widely available due to the constraints in creation and playback environments. To address this problem, we propose a framework for producing and displaying the multimodal contents for immersive textbook. Our framework provides an XML-based meta-language to produce the multimodal learning contents in the form of intuitive script. Thus it can help the user, without any prior knowledge of multimodal interactions, produce his or her own learning contents. The contents are then interpreted by script engine and delivered to the user by visual and haptic rendering loops. Also we implemented a prototype based on the aforementioned proposals and performed user evaluation to verify the validity of our framework.

• Journal of Convergence for Information Technology
• /
• v.8 no.1
• /
• pp.173-177
• /
• 2018

This study compared the muscle on-set time of fully immersive virtual reality motions with that of actual motions to if there difference. The subjects were 30 healthy adults subjects and compared the virtual reality moction group(punch, archery) and actual motion group(punch, archery) muscle on-set time. In this study, there was no significant difference between the virtual reality motion group and actual motion group muscle on-set time(p>0.05). Fully immersive virtual reality is deemed to be applicable for use in physical therapy. In future studies, it is necessary to investigate whether a fully immersive virtual reality can be applied to patients.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.43 no.4 s.310
• /
• pp.103-112
• /
• 2006

In this paper, we propose a PC based immersive virtual environment system with expandability and compatibility in contrary to existing immersive virtual environment(IVE) systems which have been implemented by supercomputer or special computing system. The application based on commercial personal compute may have two major advantage: one is variety of resources, the other is user-friendly interface. This system intends to offer easy contact to IVE system, realistic images, and convenience. Also, the system can handle various virtual reality at real-time and make it easier to interface existing complicated haptic device. Geometric techniques are adopted to calculate and visualize the physical phenomenon to speed up the computing time. The proposed implementation method of PC based immersive virtual environment system is implemented to the example in which user move around inside of and interact with virtual office environment wearing data glove, behavior recognition devices, and HMD.

• Journal of IKEEE
• /
• v.24 no.2
• /
• pp.419-425
• /
• 2020

The market size of immersive 360-degree video contents, which are noted as one of the main technology of the fourth industry, increases every year. However, since most of the images are distributed through illegal distribution networks such as Torrent after the DRM gets lifted, the damage caused by illegal copying is also increasing. Although filtering technology is used as a technology to respond to these issues in 2D videos, most of those filtering technology has issues in that it has to overcome the technical limitation such as huge feature-point data volume and the related processing capacity due to ultra high resolution such as 4K UHD or higher in order to apply the existing technology to immersive 360° videos. To solve these problems, this paper proposes a feature-point recognition ratio improvement method for immersive 360-degree videos using deep learning technology.

• Journal of IKEEE
• /
• v.24 no.3
• /
• pp.743-753
• /
• 2020

In this paper, we propose a set of robustness indicators for immersive 360-degree video. With the full-fledged service of mobile carriers' 5G networks, it is possible to use large-capacity, immersive 360-degree videos at high speed anytime, anywhere. Since it can be illegally distributed in web-hard and torrents through DRM dismantling and various video modifications, however, evaluation indicators that can objectively evaluate the filtering performance for copyright protection are required. In this paper, a robustness indicators is proposed that applies the existing 2D Video robustness indicators and considers the projection method and reproduction method, which are the characteristics of Immersive 360-degree Video. The performance evaluation experiment has been carried out for a sample filtering system and it is verified that an excellent recognition rate of 95% or more has been achieved in about 3 second execution time.

• Journal of the Korea Computer Graphics Society
• /
• v.25 no.2
• /
• pp.1-9
• /
• 2019

This study compares hand-based interfaces to improve a user's virtual reality (VR) presence by enhancing user immersion in VR interactions. To provide an immersive experience, in which users can more directly control the virtual environment and objects within that environment using their hands and, to simultaneously minimize the device burden on users using immersive VR systems, we designed two experimental interfaces (hand motion recognition sensor- and controller-based interactions). Hand motion recognition sensor-based interaction reflects accurate hand movements, direct gestures, and motion representations in the virtual environment, and it does not require using a device in addition to the VR head mounted display (HMD). Controller-based interaction designs a generalized interface that maps the gesture to the controller's key for easy access to the controller provided with the VR HMD. The comparative experiments in this study confirm the convenience and intuitiveness of VR interactions using the user's hand.

• Journal of Internet of Things and Convergence
• /
• v.8 no.2
• /
• pp.49-54
• /
• 2022

Immersive contents is content that provides a realistic experience by maximizing the user's five senses, and includes virtual reality, augmented reality, and mixed reality. In order to provide a sense of reality to users in immersive content, it is necessary to provide realistic visual images, hearing, and touch. However, due to the rapid change in the environment for developing immersive content, experts in training human resources are having difficulties in designing the curriculum. In this study, we propose a series of educational courses that use drones to acquire and process real-world measurement data and apply the derived data to VR, AR, and MR to help experts in training immersive content develop talent. The design of training process composes through demand survey and analysis of companies, students, and local communities. This study can be a useful resource for education experts who want to train immersive contents manpower.