• Journal of the Korea Computer Graphics Society
• /
• v.22 no.3
• /
• pp.11-20
• /
• 2016

This paper introduces an effective method for generating 3D stereoscopic images that gives immersive 3D experiences to viewers using mobile-based binocular HMDs. Most of previous AR systems with monocular cameras have a common limitation that the same real-world images are provided to the viewer's eyes without parallax. In this paper, based on the assumption that viewers focus on the marker in the scenario of marker based AR, we recovery the binocular disparity about a camera image and a virtual object using the pose information of the marker. The basic idea is to generate the binocular disparity for real-world images and a virtual object, where the images are placed on the 2D plane in 3D defined by the pose information of the marker. For non-marker areas in the images, we apply blur effects to reduce the visual discomfort by decreasing their sharpness. Our user studies show that the proposed method for 3D stereoscopic image provides high depth feeling to viewers compared to the previous binocular AR systems. The results show that our system provides high depth feelings, high sense of reality, and visual comfort, compared to the previous binocular AR systems.

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.627-636
• /
• 2011

The purpose of this study is to develop the multi-modal interaction system. This system provides realistic and an immersive experience through multi-modal interaction. The system recognizes user behavior, intention, and attention, which overcomes the limitations of uni-modal interaction. The multi-modal interaction system is based upon gesture interaction methods, intuitive gesture interaction and attention evaluation technology. The gesture interaction methods were based on the sensors that were selected to analyze the accuracy of the 3-D gesture recognition technology using meta-analysis. The elements of intuitive gesture interaction were reflected through the results of experiments. The attention evaluation technology was developed by the physiological signal analysis. This system is divided into 3 modules; a motion cognitive system, an eye gaze detecting system, and a bio-reaction sensing system. The first module is the motion cognitive system which uses the accelerator sensor and flexible sensors to recognize hand and finger movements of the user. The second module is an eye gaze detecting system that detects pupil movements and reactions. The final module consists of a bio-reaction sensing system or attention evaluating system which tracks cardiovascular and skin temperature reactions. This study will be used for the development of realistic digital entertainment technology.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.42 no.2
• /
• pp.432-443
• /
• 2017

The primary goal of the MPEG-H 3D Audio standard is to provide immersive audio environments for high-resolution broadcasting services such as UHDTV. This standard incorporates a wide range of technologies such as encoding/decoding technology for multi-channel/object/scene-based signal, rendering technology for providing 3D audio in various playback environments, and post-processing technology. The reference software decoder of this standard is a structure combining several modules and can operate in various modes. Each module is composed of independent executable files and executed sequentially, real time decoding is impossible. In this paper, we make DLL library of the core decoder, format converter, object renderer, and binaural renderer of the standard and integrate them to enable frame-based decoding. In addition, by measuring the computation complexity of each mode of the MPEG-H 3D-Audio decoder, this paper also provides a reference for selecting the appropriate decoding mode for various hardware platforms. As a result of the computational complexity measurement, the low complexity profiles included in Korean broadcasting standard has a computation complexity of 2.8 times to 12.4 times that of the QMF synthesis operation in case of rendering as a channel signals, and it has a computation complexity of 4.1 times to 15.3 times of the QMF synthesis operation in case of rendering as a binaural signals.

• Journal of Broadcast Engineering
• /
• v.15 no.2
• /
• pp.163-172
• /
• 2010

The free viewpoint video delivers an active contents where users can see the images rendered from the viewpoints chosen by them. Its applications are found in broad areas, especially museum tour, entertainment and so forth. As a new free-viewpoint application, this paper presents a stereoscopic free-viewpoint TIP (Tour Into Picture) where users can navigate the inside of a single image controlling a virtual camera and utilizing depth data. Unlike conventional TIP methods providing 2D image or video, our proposed method can provide users with 3D stereoscopic and free-viewpoint contents. Navigating a picture with stereoscopic viewing can deliver more realistic and immersive perception. The method uses semi-automatic processing to make foreground mask, background image, and depth map. The second step is to navigate the single picture and to obtain rendered images by perspective projection. For the free-viewpoint viewing, a virtual camera whose operations include translation, rotation, look-around, and zooming is operated. In experiments, the proposed method was tested eth 'Danopungjun' that is one of famous paintings made in Chosun Dynasty. The free-viewpoint software is developed based on MFC Visual C++ and OpenGL libraries.

• Journal of Digital Convergence
• /
• v.16 no.1
• /
• pp.135-146
• /
• 2018

This study aims to investigate the consumers' preference and willingness to pay for UWV panoramic video, which is a new realistic video technology, and propose the issues to be considered for developing and commercializing this technology in accordance with the needs of consumers. For this purpose, experimental study was conducted by constructing two environments; watching TV at home and watching panoramic video on the big screen. As a result, consumers in both experimental environments were more likely to prefer UWV than UHD, which is the existing video ratio. Consumers also showed intend to use UWV and are willing to pay for it. As a result of exploring the consumers' maximum amount of money to pay for the UWV and the reasons for it, the perception of immersion, liveliness, and actual experience of UWV were important factors for consumer acceptance of new realistic video technology.

• Journal of the Korea Society of Computer and Information
• /
• v.18 no.1
• /
• pp.31-42
• /
• 2013

This research sheds light on the non-intrusive traits of mobile devices (Electronic Guidebook, Rememberer, I-Guides and eXspot) deployed in Exploratorium for enhancing visitor experience via case studies. In an interactive exhibition environment, non-intrusiveness was the key to supporting the immersive experience and meaning-making for visitors. The usability of hand-held devices directly impacted on the non-intrusiveness, thereby reshaping the form-factors of mobile devices. The change in from-factor has also minimized the functions of devices as the remember of museum experience. Furthermore, the role of mobile devices, which turned from a supposed multi-media guide to a mere rememberer, made them virtually impossible for realizing the "seamless visiting model" originally planned. An array of projects carried out in Exploration have achieved some degree of success such as increasing viewing time as well as reinforcing post-visit activities. However, taken from musicological perspective, increase in viewing time is by all means insufficient to be taken as proof since it is assumed to be achieved by photo-taking (i.e. MyExploratorium) rather than by interacting between visitors and exhibits. This issue --increased viewing time -- needs to be analyzed in depth. All in all, mobile devices used in Exploratorium can be defined as a learning tool/educational supporting medium based on personalization for (visitors') optimizing extended museum experience.

• International Journal of Advanced Culture Technology
• /
• v.9 no.4
• /
• pp.18-28
• /
• 2021

This study surveyed how retirees' evaluation of starting food service business affects the effectiveness their new business and quality of life, based on personal factors such as entrepreneurship and business-starting capability and environmental factors by using questionnaires. Bootstrapping was carried out in order to find out factors affecting rapidly changing new business environments and retirees' initial intent to start a business so as to verify basic hypothesis about relation between retirees' evaluation of starting food service business (social, economic, and psychological effects) and the effectiveness of their new business and quality of life and confirm whether the effectiveness of the new business acts as a medium between the evaluation of starting food service business and quality of life. In addition, PLS-MGA was performed in order to verify whether the correlations among test factors can be varied according to the kind of job the target retirees had. Having examined the basic thesis, it was found that social and economic factors had significant positive effect on the effectiveness of the new business, and social and psychological factors had significant positive effect on the quality of life. Having analyzed whether the effectiveness of new business acted as a media between evaluation of starting food service business and quality of life, there was no significant effect as a medium. Having studied whether the kind of job of the retirees controlled or affected the relations among evaluation of starting food service business, effectiveness of new business and quality of life, the results were as follows: in the office job retiree group, the greater economic factor led to increase of effectiveness of new business, while social and psychological factors influenced the quality of life; In the physical labor group, the higher social factor resulted in higher effectiveness of new business, which showed significant positive effect on the quality of life. Having researched about which element is considered to be most important in starting food service business, the most important element was found to be dish/menu, followed by staff management, accounting management, business management, and service education. Having analyzed relation between accomplishment and important consideration for starting food service business, "managers with entrepreneurship," "appropriate distribution of time to prepare for starting business," and "operation of practical field education programs" showed higher importance compared to the degree of satisfaction, so it is needed to more concentrate on the above matters. This study intends to raise retirees' awareness of starting business and help them live better life based on the analysis results, and further suggest detailed mechanism and specific operations of factors affecting retirees' decision making on starting business, such that they can use the information as basic materials to make better choices that can lead to successful business.

• Journal of Broadcast Engineering
• /
• v.26 no.5
• /
• pp.500-507
• /
• 2021

The virtual reality industry has an opportunity to take another leap forward with the surge in demand for non-face-to-face content and interest in the metaverse after Covid-19. Therefore, in order to popularize virtual reality content along with this trend, high-quality content production and storytelling research suitable for the characteristics of virtual reality should be continuously conducted. In order for content to which virtual reality characteristics are applied to be effectively produced through user feedback, a quantitative index that can evaluate the content is needed. In this study, the process of viewing virtual reality contents was analyzed and head movement was set as a quantitative indicator. Afterwards, the experimenter watched five animations and analyzed the correlation between recorded head movement information and immersion. As a result of the analysis, high immersion was shown when the head movement speed was relatively slow, and it was found that the head movement speed can be used significantly as an index indicating the degree of content immersion. The result derived in this way can be used as a quantitative indicator that can verify the validity of the storytelling method applied after the prototype is produced when the creator creates virtual reality content. This method can improve the quality of content by quickly identifying the problems of the proposed storytelling method and suggesting a better method. This study aims to contribute to the production of high-quality virtual reality content and the popularization of virtual reality content as a basic research to analyze immersion based on the quantitative indicator of head movement speed.

• Journal of Broadcast Engineering
• /
• v.26 no.6
• /
• pp.714-724
• /
• 2021

The point cloud content is immersive content recorded by acquiring points and colors corresponding to the real environment and objects having three-dimensional location information. When a point cloud content consisting of three-dimensional points having position and color information is enlarged and rendered, the gap between the points widens and an empty hole occurs. In this paper, we propose a method for improving the quality of point cloud contents through inverse transformation-based interpolation using depth information for holes by finding holes that occur due to the gap between points when expanding the point cloud. The points on the back are rendered between the holes created by the gap between the points, acting as a hindrance to applying the interpolation method. To solve this, remove the points corresponding to the back side of the point cloud. Next, a depth map at the point in time when an empty hole is generated is extracted. Finally, inverse transform is performed to extract pixels from the original data. As a result of rendering content by the proposed method, the rendering quality improved by 1.2 dB in terms of average PSNR compared to the conventional method of increasing the size to fill the blank area.