• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.01a
• /
• pp.271-272
• /
• 2023

본 논문에서는 게임 개발 플랫폼인 언리얼 엔진 4를 사용하여 동작 인식 기반 복싱 게임 콘텐츠를 개발하였다. Google 사의 미디어파이프(MediaPipe) 오픈소스를 통해 웹캠으로 플레이어의 동작을 인식하며, 미디어파이프의 Pose Landmarks를 기준으로 게임 내의 캐릭터와 매핑하여 캐릭터 동작을 제어하여 복싱 게임에 대한 동작, 자세, 반응속도 등을 연습할 수 있는 콘텐츠를 즐길 수 있다. 제안한 동작 인식 기반 게임은 MediaPipe 기술을 이용하여 자신의 동작으로 게임 캐릭터를 제어하여 더 강한 몰입감을 느낄 수 있고, 비싼 VR 기기들 없이 웹캠만 있으면 어디서든 즐길 수 있고, 다양한 콘텐츠를 싼 가격에 즐길 수 있다.

• Journal of Korea Society of Industrial Information Systems
• /
• v.17 no.3
• /
• pp.51-57
• /
• 2012

Pacman is known as the terminator of the loved classic game in the world. In this paper, classic pacman game without using a keyboard or a mouse we should be able to play the game with simple hand gestures. In other words, It use motion game to be a substitute for the hand direction key using the center coordinates. Also, movements of the monster is to be replaced depending on your hand movements by extracting a pointer of hand taking pictures in the MFC dialog using Cam. In this paper, YCbCbr image is convert to RGB images to extract skin color, and multiplication operations and hybrid median filtering was used in order to obtain better images. And it is used to obtain movement of the hand area based on obtain the center of gravity of the hand region.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.277-278
• /
• 2023

본 논문은 머신러닝 학습 도구인 Teachable Machine을 활용하여 모션 인식 러닝 액션 게임인 Dino Run Game을 개발하는 것을 목표로 한다. JavaScript, HTML, CSS를 사용하여 기본적인 게임 프레임워크를 구현하고, Google에서 개발한 Teachable Machine의 이미지 인식 모델을 활용하여 웹캠을 통해 사용자의 손 이미지를 인식한다. 이를 기반으로 게임 캐릭터를 제어함으로써 키보드를 사용하지 않고도 게임을 즐길 수 있도록 구현한다.

• Journal of Platform Technology
• /
• v.11 no.1
• /
• pp.38-51
• /
• 2023

We propose an intelligent interface algorithm using hand gesture recognition information based on artificial intelligence. This method is functionally an interface that recognizes various motions quickly and intelligently by using MediaPipe and artificial intelligence techniques such as KNN, LSTM, and CNN to track and recognize user hand gestures. To evaluate the performance of the proposed algorithm, it is applied to a self-made 2D top-view racing game and robot control. As a result of applying the algorithm, it was possible to control various movements of the virtual object in the game in detail and robustly. And the result of applying the algorithm to the robot control in the real world, it was possible to control movement, stop, left turn, and right turn. In addition, by controlling the main character of the game and the robot in the real world at the same time, the optimized motion was implemented as an intelligent interface for controlling the coexistence space of virtual and real world. The proposed algorithm enables sophisticated control according to natural and intuitive characteristics using the body and fine movement recognition of fingers, and has the advantage of being skilled in a short period of time, so it can be used as basic data for developing intelligent user interfaces.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.87-94
• /
• 2017

This paper presents a prototype for virtual reality operating system (VR OS) concept with head mount display (HMD) and hand gesture recognition technology based on game engine (Unity3D). We have designed and implemented simple multitasking thread mechanism constructed on the realtime environment provided by Unity3D game engine. Our virtual reality operating system receives user input from the hand gesture recognition device (Leap Motion) to simulate mouse and keyboard and provides output via head mount display (Oculus Rift DK2). As a result, our system provides users with more broad and immersive work environment by implementing 360 degree work space.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.531-537
• /
• 2009

When creating large crowds, it is unavoidable that the models and motions of many characters will be cloned. McDonnell implemented experiments focus on appearance and motion of characters to test user perception of crowds. As a result, appearance clones were easier to perceive than motion clones. In this paper, I researched about relation between character cloning and user perception for real-time game environment expanding McDonnell's research. This paper focuses on the way to recognition of multiple clones in dramatic environment free to change view point and has crowds move to every directions by trajectories. In particular, this paper shows the possibility of character diversification applied various shapes, colors and patterns to game item have important elements for game characters. Also, I suggests range of distances between clones by a series of experiments of user perception for clones's moving direction and distance.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.3
• /
• pp.73-81
• /
• 2018

In this paper, we present a motion-driven rowing simulation framework that allows multiple players to row a boat together by their harmonized movements. In the actual rowing game, it is crucial for the players to synchronize their rowing with respect to time and pose so as to accelerate the boat. Inspired by this interesting feature, we measure the motion similarity among multiple players in real time while they are doing rowing motions and use it to control the velocity of the boat in a virtual environment. We also employ game components such as catching an item which can accelerate or decelerate the boat depending on its type for a moment once it has been obtained by synchronized catching behaviors of the players. By these components, the players can be encouraged to more actively participate in the training for a good teamwork to produce harmonized rowing movements Our methods for the motion recognition for rowing and item catch require the tracking data only for the head and the both hands and are fast enough to facilitate the real-time performance. In order to enhance immersiveness of the virtual environment, we project the rowing simulation result on a wide curved screen.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.01a
• /
• pp.177-178
• /
• 2012

최근의 게임 시장에서 체감형 게임은 홈 엔터테인먼트의 중심이 되어가고 있으며 그만큼 큰 인기를 끌며 발전하고 있다. 본 논문에서는 스마트폰 모션 센서를 실제 게임에 적용하기 위한 동작 인식 방법과 적용방법을 제안한다. 본 논문에서는 모션 센서를 이용하여 테니스 게임에 사용되는 모션들을 인식하고 적용시킨다. 실험의 결과 스마트폰 모션 센서를 적용시켜 게임에 이용하는 데에 사용자가 충분한 만족도를 보였다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.05a
• /
• pp.676-677
• /
• 2019

수부 봉합 수술 환자, 뇌졸중과 중풍으로 인한 수부 마비 환자, 깁스 후 수부 근육 수축 환자 등 수부 재활 치료가 필요한 환자의 수는 계속해서 증가하고 있지만 그에 비해 재활 치료사의 수는 현저히 부족하다. 또한 수부 재활에 대한 예산 부족으로 환자들의 경제적 부담이 증가하고 있다. 이를 해결하고자 본 논문에서는 모션인식 수부 재활 콘텐츠를 리듬 게임의 형태로 구현하였다. 추후 이 콘텐츠를 통해 수부 재활 치료가 필요한 사람들이 비교적 저렴한 가격으로 지속적인 자가 재활 치료를 진행할 수 있을 것으로 기대된다.