• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.16 no.12
• /
• pp.2595-2600
• /
• 2012

In this study, we propose the new interface system for the disabled and old people who do not well using electronic equipment that is used physical switch interface system. The proposed new interface system is consisted of speech and motion recognition system. Speech recognition system is mike in the headset, and motion recognition system is 3-axis accelerometer in the headset. In order to verify the usefulness of the proposed system, we make an experiment on new interface.

• The KIPS Transactions:PartB
• /
• v.9B no.1
• /
• pp.129-138
• /
• 2002

In this paper, a distance measuring algorithm for motion capture using color stereo camera is proposed. The color markers attached on articulations of an actor are captured by stereo color video cameras, and color region which has the same color of the marker's color in the captured images is separated from the other colors by finding dominant wavelength of colors. Color data in RGB (red, green, blue) color space is converted into CIE (Commission Internationale del'Eclairage) color space for the purpose of calculating wavelength. The dominant wavelength is selected from histogram of the neighbor wavelengths. The motion of the character in the cyber space is controlled by a program using the distance information of the moving markers.

• The Journal of Korean Institute for Practical Engineering Education
• /
• v.5 no.1
• /
• pp.34-39
• /
• 2013

This paper suggests an input device that allows a user not only to naturally interact with education contents in virtual environment but also to sense haptic feedback according to his/her interaction. The proposed system measures a user's motion and then creates haptic feedback based on the measured position. To create haptic information in response to a user's interaction with educational contents in virtual environment, we develop a motion input device which consists of a motion controller, a haptic actuator, a wireless communication module, and a motion sensor. To measure a user's motion input, an accelerometer is used as the motion sensor. The experiment shows that the proposed system creates continuous haptic sensation without any jerky motion or vibration.

• Journal of Korea Multimedia Society
• /
• v.7 no.10
• /
• pp.1478-1484
• /
• 2004

This paper presents a method that controls facial expression in realtime of 3D avatar by having the user select a sequence of facial expressions in the space of facial expressions. The space of expression is created from about 2400 frames of facial expressions. To represent the state of each expression, we use the distance matrix that represents the distances between pairs of feature points on the face. The set of distance matrices is used as the space of expressions. Facial expression of 3D avatar is controled in real time as the user navigates the space. To help this process, we visualized the space of expressions in 2D space by using the Principal Component Analysis(PCA) projection. To see how effective this system is, we had users control facial expressions of 3D avatar by using the system. This paper evaluates the results.

• Journal of KIISE:Computer Systems and Theory
• /
• v.33 no.4
• /
• pp.231-241
• /
• 2006

Creating controllable, responsive avatars is an important problem in computer games and virtual environments. Recently, large collections of motion capture data have been exploited for increased realism in avatar animation and control. Large motion sets have the advantage of accommodating a broad variety of natural human motion. However, when a motion set is large, the time required to identify an appropriate sequence of motions is the bottleneck for achieving interactive avatar control. In this paper, we present a novel method for training avatar behaviors from unlabelled motion data in order to animate and control avatars at minimal runtime cost. Based on machine learning technique, called Q-teaming, our training method allows the avatar to learn how to act in any given situation through trial-and-error interactions with a dynamic environment. We demonstrate the effectiveness of our approach through examples that include avatars interacting with each other and with the user.

• The Journal of the Korea Contents Association
• /
• v.8 no.2
• /
• pp.18-26
• /
• 2008

This paper presents a phased visualization method of facial expression space that enables the user to control facial expression of 3D avatars by select a sequence of facial frames from the facial expression space. Our system based on this method creates the 2D facial expression space from approximately 2400 facial expression frames, which is the set of neutral expression and 11 motions. The facial expression control of 3D avatars is carried out in realtime when users navigate through facial expression space. But because facial expression space can phased expression control from radical expressions to detail expressions. So this system need phased visualization method. To phased visualization the facial expression space, this paper use fuzzy clustering. In the beginning, the system creates 11 clusters from the space of 2400 facial expressions. Every time the level of phase increases, the system doubles the number of clusters. At this time, the positions of cluster center and expression of the expression space were not equal. So, we fix the shortest expression from cluster center for cluster center. We let users use the system to control phased facial expression of 3D avatar, and evaluate the system based on the results.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2012.05a
• /
• pp.51-52
• /
• 2012

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2012.10a
• /
• pp.61-62
• /
• 2012

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2013.05a
• /
• pp.71-72
• /
• 2013