• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.12
• /
• pp.1964-1967
• /
• 2021

Recently, to improve the effectiveness of education to learn from textbooks, immersive 3D environments such as virtual reality(VR) has been widely used for education. In this paper, in order to intuitively present education about content scenarios on changes in the human body according to food intake, we consist an immersive virtual reality environment to express the same life-size organs. The participants in our educational system showed higher results in all items compared to the existing textbook-based education such as immersion, understanding, and quality of education program. Also it was found the importance of interactivity to increase the effectiveness of immersive class.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.1
• /
• pp.1-10
• /
• 2024

In immersive virtual environments including mixed reality (MR) and virtual reality (VR), avatars or agents, which are virtual humans, are being studied and applied in various ways as factors that increase users' social presence. Recently, studies are being conducted to apply generative AI as an agent to improve user learning effects or suggest a collaborative environment in an immersive virtual environment. This study proposes a novel method for interface application of a virtual assistant agent (VAA) using OpenAI's ChatGPT in an immersive virtual environment including VR and MR. The proposed method consists of an information agent that responds to user queries and a control agent that controls virtual objects and environments according to user needs. We set up a development environment that integrates the Unity 3D engine, OpenAI, and packages and development tools for user participation in MR and VR. Additionally, we set up a workflow that leads from voice input to the creation of a question query to an answer query, or a control request query to a control script. Based on this, MR and VR experience environments were produced, and experiments to confirm the performance of VAA were divided into response time of information agent and accuracy of control agent. It was confirmed that the interface application of the proposed VAA can increase efficiency in simple and repetitive tasks along with user-friendly features. We present a novel direction for the interface application of an immersive virtual environment through the proposed VAA and clarify the discovered problems and limitations so far.

• Journal of the Korea Society of Computer and Information
• /
• v.23 no.7
• /
• pp.49-56
• /
• 2018

Virtual object weight perception is an important topic, as it heightens the believability of object manipulation in immersive virtual environments. Although weight perception can be achieved using haptic interfaces, their technical complexity makes them difficult to apply in immersive virtual environments. In this study, we present a visual pseudo-haptic feedback system that simulates and depicts the weights of virtual objects, the effect of which is weight perception. The proposed method recognizes grasping and manipulating hand motions using computer vision-based tracking methods, visualizing a Force Arrow to indicate the current lifting forces and its difference from the standard lifting force. With the proposed Force Arrow method, a user can more accurately perceive the logical and unidirectional weight and therefore control the force used to lift a virtual object. In this paper, we investigate the potential of the proposed method in discriminating between different weights of virtual objects.

• Educational Technology International
• /
• v.21 no.2
• /
• pp.155-191
• /
• 2020

The aim of this study was to examine the trends (e.g., the distribution of the studies by year, country, research methods, and participants' education level) and fundamental findings [e.g., interaction in Virtual Reality (VR) environments, educational content through VR and Augmented Reality (AR) technologies, learning environment in AR, etc.] regarding immersive learning technologies such as VR and AR in English Language Teaching (ELT) between 2010 and 2019. Employing a systematic review research methodology, data was gathered from 59 academic articles published in the following databases: EBSCOhost, ERIC, Web of Science, and Taylor & Francis. The studies were analyzed using a content analysis approach, and findings demonstrated that immersive learning technologies in ELT came to prominence in 2017. Mixed methods research was the most widely employed research method. The most studied language skill was vocabulary for AR and speaking for VR. The results also revealed advantages and challenges with regards to the use of immersive learning technologies in ELT. Further analysis illustrated the findings related to characteristics of immersive learning technologies in ELT. Based on this review, research and design implications for researchers and practitioners are presented.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.1
• /
• pp.20-30
• /
• 2016

Recently immersive virtual reality (VR) becomes popular due to the advanced development of I/O interfaces and related SWs for effectively constructing VR environments. In particular, natural and intuitive manipulation of 3D virtual objects is still considered as one of the most important user interaction issues. This paper presents a comparative study on the manipulation and interaction of 3D virtual objects using different interfaces and interactions in three VR environments. The comparative study includes both quantitative and qualitative aspects. Three different experimental setups are 1) typical desktop-based VR using mouse and keyboard, 2) hand gesture-supported desktop VR using a Leap Motion sensor, and 3) immersive VR by wearing an HMD with hand gesture interaction using a Leap Motion sensor. In the desktop VR with hand gestures, the Leap Motion sensor is put on the desk. On the other hand, in the immersive VR, the sensor is mounted on the HMD so that the user can manipulate virtual objects in the front of the HMD. For the quantitative analysis, a task completion time and success rate were measured. Experimental tasks require complex 3D transformation such as simultaneous 3D translation and 3D rotation. For the qualitative analysis, various factors relating to user experience such as ease of use, natural interaction, and stressfulness were evaluated. The qualitative and quantitative analyses show that the immersive VR with the natural hand gesture provides more intuitive and natural interactions, supports fast and effective performance on task completion, but causes stressful condition.

• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.723-733
• /
• 2020

In this paper, MPEG-I Immersive Audio Standardization and related trends are presented. MPEG-I Immersive Audio, which is under the development of standard documents at the exploration stage, can make a user interact with a virtual scene in 6 DoF manner and perceive sounds realistic and matching the user's spatial audio experience in the real world, in VR/AR environments that are expected as killer applications in hyper-connected environments such as 5G/6G. In order to do this, MPEG Audio Working Group has discussed the system architecture and related requirements for the spatial audio experience in VR/AR, audio evaluation platform (AEP) and encoder input format (EIF) for assessing the performance of submitted proponent technologies, and evaluation procedures.

• The Journal of Korea Robotics Society
• /
• v.3 no.2
• /
• pp.137-145
• /
• 2008

We present the initial results of on-going research for building a novel Mobile Haptic Interface (MHI) that can provide an unlimited haptic workspace in large immersive virtual environments. When a user explores a large virtual environment, the MHI can sense the position and orientation of the user, place itself to an appropriate configuration, and deliver force feedback, thereby enabling a virtually limitless workspace. Our MHI (PoMHI v0.5) features with omnidirectional mobility, a collision-free motion planning algorithm, and force feedback for general environment models. We also provide experimental results that show the fidelity of our mobile haptic interface.

• ETRI Journal
• /
• v.38 no.1
• /
• pp.149-158
• /
• 2016

In the field of augmented reality technologies, commercial optical see-through-type wearable displays have difficulty providing immersive visual experiences, because users perceive different depths between virtual views on display surfaces and see-through views to the real world. Many cases of augmented reality applications have adopted eyeglasses-type displays (EGDs) for visualizing simple 2D information, or video see-through-type displays for minimizing virtual- and real-scene mismatch errors. In this paper, we introduce an innovative optical see-through-type wearable display hardware, called an EGD. In contrast to common head-mounted displays, which are intended for a wide field of view, our EGD provides more comfortable visual feedback at close range. Users of an EGD device can accurately manipulate close-range virtual objects and expand their view to distant real environments. To verify the feasibility of the EGD technology, subject-based experiments and analysis are performed. The analysis results and EGD-related application examples show that EGD is useful for visually expanding immersive 3D augmented environments consisting of multiple displays.

• Smart Media Journal
• /
• v.11 no.9
• /
• pp.75-80
• /
• 2022

Recently, research and development on immersive virtual reality(VR) technology to provide a realistic experience is being widely conducted. To provide realistic experience in immersive virtual reality for VR participants, virtual environments should consist of high-realistic environments using 3D reconstruction. In this paper, to acquire 3D information in real space using multiple cameras in the reconstruction process, we propose a novel method of optimal camera placement for accurate reconstruction to minimize distortion of 3D information. Through our approach in this paper, real 3D information can obtain with minimized errors during environment reconstruction, and it is possible to provide a more immersive experience with the created virtual environment.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.3
• /
• pp.11-20
• /
• 2018

This study proposes collaboration based multi-user interaction to provide improved presence and satisfying experience to multiple HMD users in immersive virtual reality. The core of the proposed multi-user interaction is to present the direction in which HMD users in virtual reality environment can interact through communication and collaboration with each other based on their separate roles and behaviors. Each user in the virtual collaborative environment uses a hand to interact with a virtual environment or virtual objects. Based on the basic structure, this study designs methods (synchronization and communication) that can be achieved a common goal together through communication and collaboration. Then, this study creates a virtual reality application of arcade genre that considers communication and collaboration in order to verify whether the proposed multi-user interaction provides improved presence and satisfaction experience. And, the survey experiments are conducted for participants. Through these processes, it is confirmed that the interaction in the proposed immersive virtual collaborative environments provide the presence and experience that is satisfactory to all users.