• Journal of Korea Multimedia Society
• /
• v.19 no.10
• /
• pp.1759-1766
• /
• 2016

We can implement the virtual touch recognition system by mounting the virtual touch algorithm into an embedded device connected to a depth camera. Since the computing performance is limited in embedded system, the real-time processing of recognizing the virtual touch is difficult when the resolution of the depth image is large. In order to resolve the problem, this paper improves the algorithms of binarization and labeling that occupy a lot of time in all processing of virtual touch recognition. It processes the binarization and labeling in only necessary regions rather than all of the picture. By appling the proposed algorithm, the system can recognize the virtual touch in real-time as about 31ms per a frame in the depth image that has 640×480 resolution.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.4
• /
• pp.57-63
• /
• 2019

In this paper, we propose a new framework to control VR(Virtual reality) contents in real time using user's mouth-wind and acceleration sensor of mobile device. In VR, user interaction technology is important, but various user interface methods is still lacking. Most of the interaction technologies are hand touch screen touch or motion recognition. We propose a new interface technology that can interact with VR contents in real time using user's mouth-wind method with acceleration sensor. The direction of the mouth-wind is determined using the angle and position between the user and the mobile device, and the control position is adjusted using the acceleration sensor of the mobile device. Noise included in the size of the mouth wind is refined using a simple average filter. In order to demonstrate the superiority of the proposed technology, we show the result of interacting with contents in game and simulation in real time by applying control position and mouth-wind external force to the game.

• Proceedings of the KIEE Conference
• /
• 2003.07d
• /
• pp.2265-2267
• /
• 2003

In this paper, the virtual reality system is tried to developed, which controls not only the sense of sight and hearing but also the sense of touch, In order to develope the sense of touch in this study, the stable tactual transaction system, based on summing up the basic algorithm and theory is embodied. Especially, the graphic deformation algorithm is developed in realtime with using the deformed FEM. To apply the FEM, a deformed material model is produced and then the graphic deformation with this model is able to force. Finally, the graphic transaction algorithm is deduced by the realtime calculation and simplification because the purpose of this system is to transact in real time. The result of this study is that the proposed system is possible to deform the graphics and transact the haptic in real time in PC. The simulation program has been made to prove this result.

• The Transactions of the Korean Institute of Electrical Engineers P
• /
• v.52 no.3
• /
• pp.121-126
• /
• 2003

In this paper, we propose the haptic system for the real-time virtual environment-control, which controls the sense of sight, hearing and touch. In order to maintain the stable haptic system in this study, we apply the proxy force rendering algorithm and the real-time graphic deformation algorithm based on the FEM. The applied proxy algorithm makes the system possible to be more stable and prompt with a virtual object. Moreover, the haptic rendering algorithm is applied to work out a problem that the tactual transaction-period is different from the graphic transaction- period. The graphic deformation algorithm is developed in the real-time using the deformed FEM. To apply the FEM, a deformed material-model is produced and then the graphic deformation with this model is able to force. Consequently, the graphic rendering algorithm is deduced by the real-time calculation and simplification because the purpose of this system is to transact in the real time. Applying this system to the PC, we prove that it is possible to deform the graphics and transact the haptic. Finally we suggest the variable simulation program to show the efficiency of this system.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.4
• /
• pp.21-27
• /
• 2018

In this paper, we propose a real-time interaction method using user's mouth wind in mobile device. In mobile and virtual reality, user interaction technology is important, but various user interface methods is still lacking. Most of the interaction technologies are hand touch screen touch or motion recognition. In this study, we propose an interface technology that can interact with real time using user's mouth wind. The direction of the wind is determined by using the angle and the position between the user and the mobile device, and the size of the wind is calculated by using the magnitude of user's mouth wind. To show the superiority of the proposed technique, we show the result of visualizing the flow of the vector field in real time by integrating the mouth-wind interface into the Navier-Stokes equations. We show the results of the paper on mobile devices, but can be applied in the Agumented reality(AR) and Virtual reality(VR) fields requiring interface technology.

• The Journal of the Korea Contents Association
• /
• v.10 no.8
• /
• pp.461-471
• /
• 2010

Recently, Augmented Reality(AR) technologies have been emerged, which shows the types of digital contents integrating real and virtual worlds. To maximize the effect of AR technology, tangible user interface, which enables users to interact with the contents in the same way in which they manipulate objects in real world, is applied. In particular, we expect that the technologies are able to enhance learners' interests and degree of immersion, and produce new learning contents in order to maximize the effect of learning. In this paper, we propose a learning system for scientific experiments with multi-touch screen and tangible user interface. The system consists of an experiment table equipped with a large multi-touch screen and a realistic learning device that can detect the user's simple gestures. In real world, some scientific experiments involve high cost, long time or dangerous objects, but this system will overcome such hindrance and provide learners with a variety of experiment experience in realistic ways.

• Journal of The Institute of Information and Telecommunication Facilities Engineering
• /
• v.10 no.4
• /
• pp.143-147
• /
• 2011

The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

• Journal of the Korea Computer Industry Society
• /
• v.5 no.2
• /
• pp.217-226
• /
• 2004

This paper proposes the electric stimulus tactile apparatus system(TESTAS) loaded on the haptic interface using ultrasonic motors (USMs) To touch the virtual object like wall in graphic, the 6 DOF haptic interface provides force feedback to users as if it is real. But the case of sharp virtual object like a puncture, it could not provided the sense of pain, but only the reaction-force. After the TESTAS had been loaded on this haptic interface, it could provide not only the force but also the pain to users. In this way, when users take the haptic and tactile informations at the same time, they easily have a correct understanding of virtual object.

• Journal of Digital Contents Society
• /
• v.18 no.1
• /
• pp.1-7
• /
• 2017

Virtual reality(VR) is known as immersive multimedia or computer-simulated reality, is a computer technology that replicates an environment, real or imagined, and simulates a user's physical presence and environment to allow for user interaction. Virtual realities artificially create sensory experience including sight, touch, hearing, and smell. Owing to the use of a single device in most VR contents, user have difficulty in manipulating user interface and game object. And also immersion of the game goes down because they can't see the mouse and keyboard in virtual space. In this paper, we design and implement the chess game to easily and accurately control user interface to improve the immersion in game.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.2
• /
• pp.173-178
• /
• 2005

This paper focuses on the use of the virtual dialog system whose aim is to build more convenient living environments. In order to realize this, the main emphasis of the paper lies on the description of the multimedia signal processing on the basis of the technologies such as speech recognition, speech synthesis, video, or sensor signal processing. For essential modules of the dialog system, we incorporated the real-time speech recognizer based on HM-Net(Hidden Markov Network) as well as speech synthesis into the overall system. In addition, we adopted the real-time motion detector based on the changes of brightness in pixels, as well as the touch sensor that was used to start system. In experimental evaluation, the results showed that the proposed system was relatively easy to use for controlling electric appliances while sitting in a sofa, even though the performance of the system was not better than the simulation results owing to the noisy environments.