• Journal of the Korea Computer Graphics Society
• /
• v.28 no.3
• /
• pp.23-29
• /
• 2022

Virtual humans are implemented with dedicated modeling tools like Unity 3D Engine in virtual space (virtual reality, mixed reality, metaverse, etc.). Various human modeling tools have been introduced to implement virtual human-like appearance, voice, expression, and behavior similar to real people, and virtual humans implemented via these tools can communicate with users to some extent. However, most of the virtual humans so far have stayed unimodal using only text or speech. As AI technologies advance, the outdated machine-centered dialogue system is now changing to a human-centered, natural multi-modal system. By using several pre-trained networks, we implemented an emotion-based multi-modal dialogue system, which generates human-like utterances and displays appropriate facial expressions in real-time.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.11a
• /
• pp.168-169
• /
• 2017

기존의 정형적인 디스플레이 형태뿐만 아니라 비정형적인 구조의 디스플레이의 관심이 증가하고 있다. 미래에는 기존의 직사각형의 디스플레이와 더불어 비정형적인 디스플레이의 기술이 발전할 전망으로 보인다. 이러한 비정형 사이니지 기술이 발전함에 따라 비정형 영상 표출에 대한 연구가 시행될 필요성이 있다. 하지만 큐브 디스플레이와 같은 비정형 디스플레이에 바로 영상을 표출하기에는 실질적으로 구현이 어려운 점이 있다. 따라서 현실적인 하드웨어 구현이 아닌 비정형 영상 시뮬레이션을 실행할 수 있는 환경을 구축함으로써 이러한 한계를 극복하고자 한다. 본 논문은 립모션(Leap Motion)과 유니티(Unity3D)를 연동하여 제스처 인식 기반의 비정형 디스플레이 표출 시뮬레이션을 시행하였다. 사용자의 명령에 따라 큐브모형이 제어가 되어 비정형 디스플레이로 인식하고 영상을 표출한다. 이는 실제 공간에서 사용할 수 있는 조립형 큐브 디스플레이에 영상을 직접 표출하기 전 시뮬레이션으로 활용 할 수 있을 것으로 기대된다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2012.10a
• /
• pp.458-459
• /
• 2012

Thanks to the recent advances in smartphones, various high quality contents are being developed. Three dimensional games that were very hard to produce in old picture phones are now used universally in smartphones, satisfying its users. This thesis utilizes a game engine that is more suitable for smartphones in that it can develop high quality game in a timely efficient manner in comparison to low quality development tools. It explains the methods of game planning and development using techniques such as high quality shading processes, optimization functions, etc.

• Journal of Convergence for Information Technology
• /
• v.7 no.6
• /
• pp.187-192
• /
• 2017

The Android operating system currently has a proven method of Unity optimization. However, the Tizen operating system does not know how effective the existing Unity optimization method can be applied to the Tizen operating system and how effective it is. In this paper, we analyze the efficiency of applying Unity optimizing techniques of Android operating system to Tizen operating system. To get this purpose, this study investigates whether the existing Unity optimization method can be applied to Tizen operating system and evaluates the efficiency of the method through Unity Profiler. This research will allow us to further evaluate the Unity optimizations for the existing Android operating system in the future.

• The Journal of Korea Robotics Society
• /
• v.14 no.2
• /
• pp.122-130
• /
• 2019

Collecting a rich but meaningful training data plays a key role in machine learning and deep learning researches for a self-driving vehicle. This paper introduces a detailed overview of existing open-source simulators which could be used for training self-driving vehicles. After reviewing the simulators, we propose a new effective approach to make a synthetic autonomous vehicle simulation platform suitable for learning and training artificial intelligence algorithms. Specially, we develop a synthetic simulator with various realistic situations and weather conditions which make the autonomous shuttle to learn more realistic situations and handle some unexpected events. The virtual environment is the mimics of the activity of a genuine shuttle vehicle on a physical world. Instead of doing the whole experiment of training in the real physical world, scenarios in 3D virtual worlds are made to calculate the parameters and training the model. From the simulator, the user can obtain data for the various situation and utilize it for the training purpose. Flexible options are available to choose sensors, monitor the output and implement any autonomous driving algorithm. Finally, we verify the effectiveness of the developed simulator by implementing an end-to-end CNN algorithm for training a self-driving shuttle.

• Journal of Korea Game Society
• /
• v.15 no.5
• /
• pp.131-142
• /
• 2015

A self-driving car is an autonomous vehicle capable of fulfilling the main transportation capabilities of a traditional car. It must be capable of sensing its environment and navigating without human input. In this paper, we design the agent that can simulate these self-driving cars and develop a prototype for it. To do this, we analyze the requirements for the self-driving car, and then the agent is designed to be suitable for traditional multi-agent system. The key point of the design is that agents move along the steering forces only. The prototype of the designed agent was implemented by using Unity 3D. From simulation results using the prototype, movements of the agents were very realistic. However, in the case of increasing the number of the agent the performance was seriously degraded, and so the alternatives of the problem were suggested.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.9-17
• /
• 2017

This study proposes a third-person virtual reality content production pipeline to provide users with a new experience and presence in a new virtual reality environment. For this purpose, we first create third-person virtual reality content, which includes a story, fun factors, and game characteristic. It consists of a tutorial scene in which a user can pre-learn the proposed interface suitable for a third person different from existing virtual reality content and a content scene that achieves its purpose by using game factors based on the background story. Next, we design an interface suitable for the third-person virtual reality content. This study proposes an interface in which users can interact with a virtual environment or object by using their hand. The proposed interface consists of three steps: character movement, virtual object selection with multiple selection, and 3D menu control using virtual space. Finally, through the survey experiment, third-person virtual reality content produced based on the proposed interface was confirmed to be easily controlled while ensuring high satisfaction.

• Journal of the Korea Computer Graphics Society
• /
• v.22 no.3
• /
• pp.43-52
• /
• 2016

This paper is to study techniques of a virtual reality to maximize the depth of the users' immersion based on differentiated interactive contents using korean traditional fairy tale. In order to increase more interests in korean traditional fairy tale, we produce a interactive 3D contents and propose a new approach to a system designing applying a virtual realities such as HMD, Leap motion. First, using Korean traditional fairy tale, we generate interactive contents consisting of scenes intensifying user's tensions while interaction of game process. Based on the interactive contents generated, we design scene generation using Oculus HMD, the gaze based input processes and a hand interface using Leap motion, in order to provide a multi dimensional scene transmission and an input process method to intensify the sense of the reality. We will verify through diverse tests whether the proposed virtual reality contents based on a technique of an input process will actually intensify the immersion in the virtual reality or not while minimizing the motion sickness of the users.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.71-79
• /
• 2024

This study organizes an immersive content production pipeline using Meta Quest Pro as an asymmetric virtual environment where mixed reality(MR) and virtual reality(VR) users participate and interact together. Based on this, we compare and analyze the differences in presence and experience provided by the user's experience environment. The proposed production process is to build an integrated development environment using Meta XR All-in-One SDK based on the Unity 3D engine. This includes a real space analysis method using the Room Model function for organic and accurate interaction between MR users in the real world and VR users based on virtual scenes at fixed coordinates. Based on this, this study produces immersive table tennis content where MR and VR users participate together. Finally, we conduct survey experiments to compare and analyze the effects of differences in platform and participation methods on presence and experience using the produced content. As a result, this study confirmed that all users can feel a satisfactory presence and experience within an experience environment where real and virtual correspond.