• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.99-104
• /
• 2009

최근 멀티미디어 기술과 가상/증강현실 기술의 발전으로 사용자에게 몰입감 있는 콘텐츠를 제공하는 여러 시스템들이 제안되고 있다. 또한 기존의 시각과 음향효과만으로 이루어진 시스템의 한계를 넘어서 실제와 같은 느낌을 전달할 수 있는 햅틱기술을 적용하여 보다 몰입감있는 체험형 실감책들이 고안되고 있다. 본 논문은 과학교과서를 중심으로 과학적 이론을 보다 효과적으로 가르치고 배우기 위해 필요한 다양한 촉감(Haptic)을 분류하고, 이를 실감책에 적용하여 책이 담고 있는 주요 내용 또는 삽화와 관련된 다양한 멀티미디어 콘텐츠를 가상/증강환경에서 시청각정보와 함께 촉각콘텐츠를 독자에게 제공함으로써 보고, 듣고 만질 수 있는 적극적인 촉감 상호작용이 가능한 실감책 ('Sil-Gam' Book) 시스템의 기본 프레임워크를 제시한다. 제시된 실감책은 크게 세 부분으로 구성된다. 첫째, 실감책을 읽고 있는 사용자의 손가락의 위치, 시선과 같은 사용자의 움직임을 추적하고 책의 크기, 페이지 등을 인식하는 센서가 부착된 센싱 부; 둘째, 장비에 따라 적용 가능한 촉감 속성, 물체의 움직임에 따라 적용할 수 있는 촉감 속성등 다양한 촉감콘텐츠의 속성을 저작하고 편집하는 소프트웨어 부; 마지막으로 사용자에게 저작된 실감 콘텐츠를 사용자가 쉽고 직관적으로 체험하게 하기 위한 디스플레이부로 구성된다. 여기서 디스플레이 부는 세부적으로 시청각 콘텐츠를 전달하는 시청각 디스플레이 부와 역촉감 콘텐츠를 전달하는 역촉감 디스플레이부로 구성된다. 본 논문에서는 또한 실감책 촉감 저작도구를 사용하여 제시할 수 있는 다양한 촉감을 중고등학교 교육과정에서 배우는 과학 이론에 적용하여 과학 실험시 경험할 수 있는 다양한 역/촉감을 전달하는 몇 가지 시나리오를 예시하였다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2019.05a
• /
• pp.479-481
• /
• 2019

In recent years, training systems in various industrial fields have been made using virtual reality (VR) technology and widely used in education. Virtual reality based training system is safe, there is no waste of material, and there are many advantages to be able to practice anytime and anywhere. For example, virtual reality welding training simulation system is widely used for field worker because it can perform actual joining of steel plate in immersive environment. At this time, realistic representation of the steel plate joint is important to maximize the effectiveness of the training, but existing techniques have limited the natural expression of the effect. In this study, we propose a method of visualizing joint effect based on shader in order to construct welding training system. The results of this study can be applied to the welding training system to improve the weld training effect to provide the user with high-quality visualization.

• Journal of Convergence for Information Technology
• /
• v.12 no.4
• /
• pp.143-157
• /
• 2022

The aim of this study is to design Spudsville, an immersive game environment in Minecraft that can effectively help learners acquire the English language. To create a successful learning experience using Minecraft, the researchers adopted the Agile Model and the Design Thinking approach. The researchers first conducted an analysis through an extensive literature review in order to assess the learners' needs. Afterwards, they designed and developed a Minecraft world based on the data collected during the analysis phase. The researchers learned that implementing constructivist and behaviorist approaches has benefits, even though applying a cognitivist-learning model to Spudsville could have provided the researchers with more insight on how learner processes information. Making these adjustments could improve Spudsville's effectiveness and could potentially help the ways in which gamified learning aids with language acquisition.

• Journal of the HCI Society of Korea
• /
• v.5 no.2
• /
• pp.15-24
• /
• 2010

A Digilog Book is an augmented reality (AR) based next generation publication supporting both sentimental analog emotions and digitized multi-sensory feedbacks by combining a conventional printed book and digital contents. As a Digilog Book authoring software, ARtalet provides an intuitive authoring environment through 3D user interface in AR environment. In this paper, we suggest ARtalet authoring environment based trajectory editing method to generate and manipulate a movement path of an augmented 3D object on the Digilog Book. Specifically, the translation points of the 3D manipulation prop is examined to determine that the point is a proper control point of a trajectory. Then the interpolation using splines is conducted to reconstruct the trajectory with smoothed form. The dynamic score based selection method is also exploited to effectively select small and dense control points of the trajectory. In an experimental evaluation our method took the same time and generated a similar amount of errors as the usual approach, but reduced the number of control points needed by over 90%. The reduced number of control points can properly reconstruct a movement path and drastically decrease the number of control point selections required for movement path modification. For control manipulation, the task completion time was reduced and there was less hand movement needed than with conventional method. Our method can be applicable to drawing or curve editing method in immersive In-Situ AR based education, game, design, animation, simulation application domains.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2016.05a
• /
• pp.181-185
• /
• 2016

In this paper we propose a VR-based Sailor Training Platform Authoring Tool which efficiently trains sailors in immersive ways. Proposed authoring tool consists of virtual environment reconstruction that imports real ship indoor environment into virtual environment and script editing which is able to implement various scenarios in emergency based on just drag-and-drop interface. The aim of importing real ship environment and supporting various VR devices is to enhance immersiveness and training so that trainees can deal with serious emergency events. Also the usefulness of the interface enables to reduce the cost of making training materials. Throughout scenario editing interface, the proposed authoring tool supports the editing of multi-user scenario and setting individual task for the evaluation.

• Journal of Korea Game Society
• /
• v.5 no.3
• /
• pp.3-10
• /
• 2005

We present the computer table tennis game using player's swing motion. We need to transform a real world coordinate into a virtual world coordinate in order to hit the virtual ball. We can not get a correct 3-dimension position of racket in environment that using one camera or simple image processing. Therefore we use Augmented Reality (AR) concept to develop the game. This paper shows the AR table tennis game using gesture and method to develop the 3D interaction game that only using one camera without any motion detection device or stereo cameras. Also, we use a scan line method to recognize gesture for speedy processing. The game is developed using ARtoolkit and DirectX that is popular tool of SDK for game development.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.2 s.314
• /
• pp.37-46
• /
• 2007

In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.

• The Journal of the Korea Contents Association
• /
• v.17 no.3
• /
• pp.222-230
• /
• 2017

The Ministry of Public Safety and Security plans to expand fire safety education infrastructure to provide customized fire safety education, spread fire safety culture and develop a tailored fire safety education system as a part of the 2016 Citizens' Safety Improvement Policy. This study has also been designed to improve safety problems in the Republic of Korea. Even though safety education has been given, citizens aren't still able to experience a close-to-real situation. In addition, their understanding and satisfaction with the curriculum are very low. Therefore, this study offers VR fire-extinguishing experience education contents as an effective alternative. With a goal of having the participants experience fire extinguishing and evacuation drill in a virtual space, this program has the following advantages: i) safe fire-extinguishing experience; ii) UI to create fun ; iii) useful in fire-extinguishing education; iv) budget saving. we configure the VR fire experience system structure and hardware by applying UX design methodology. We also develop for VR-specific motion recognition plug-in and controller that can be feeling in HMD environment.

• Journal of the Korea Computer Graphics Society
• /
• v.26 no.4
• /
• pp.9-15
• /
• 2020

Having a virtual talking face along with a virtual body increases immersion in VR applications. As virtual reality (VR) techniques develop, various applications are increasing including multi-user social networking and education applications that involve talking avatars. Due to a lack of sensory information for full face and body motion capture in consumer-grade VR, most VR applications do not show a synced talking face and body. We propose a novel method, targeted for VR applications, for talking face synced with audio with an upper-body inverse kinematics. Our system presents a mirrored avatar of a user himself in single-user applications. We implement the mirroring in a single user environment and by visualizing a synced conversational partner in multi-user environment. We found that a realistic talking face avatar is more influential than an un-synced talking avatar or an invisible avatar.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.61-69
• /
• 2024

Mixed reality(MR) technology combines the advantages of virtual reality(VR) and augmented reality(AR) technology, allowing MR users to interact with virtual objects against the background of the real world. In addition, since virtual objects interact with the real world, users can experience a higher immersion. This study proposes electric circuit practical training content using Meta Quest Pro to produce immersive MR content based on reality. To this end, first, the development process for producing MR content by linking Meta Quest Pro equipment with the Unity 3D engine is organized. Then, based on the traditional electric circuit practical training method used in elementary school science classes, virtual electric circuit practical training content with the same training method and operation process is produced based on MR. Finally, survey experiments are conducted to analyze the presence and experience of the MR-based educational environment provided using the produced content. Through this, the usability of the proposed practical training content is evaluated and future research directions are suggested.