• Journal of Korea Multimedia Society
• /
• v.13 no.2
• /
• pp.316-323
• /
• 2010

In this paper, we propose fingertip extraction and hand motion recognition method for augmented reality applications. First, an input image is transformed into HSV color space from RGB color space. A hand area is segmented using double thresholding of H, S value, region growing, and connected component analysis. Next, the end points of the index finger and thumb are extracted using morphology operation and subtraction for a virtual keyboard and mouse interface. Finally, the angle between the end points of the index finger and thumb with respect to the center of mass point of the palm is calculated to detect the touch between the index finger and thumb for implementing the click of a mouse button. Experimental results on various input images showed that our method segments the hand, fingertips, and recognizes the movements of the hand fast and accurately. Proposed methods can be used the input interface for augmented reality applications.

• Proceedings of the Korea Contents Association Conference
• /
• 2009.05a
• /
• pp.915-920
• /
• 2009

In terms of development of intelligent information devices, the most important element is the function which is able to deliver the information user wants to input on the device without complexities. By using the mean such as our voice, expression, gesture and physical contact we use in our daily routine, we are able to interact with device easily and simply. In this paper, we are initiated to present interactive surface system, in which allows users to use their hand gesture as a function of mouse and keyboard free, to be interacted within the platform of web application.

• Journal of Digital Contents Society
• /
• v.18 no.1
• /
• pp.1-7
• /
• 2017

Virtual reality(VR) is known as immersive multimedia or computer-simulated reality, is a computer technology that replicates an environment, real or imagined, and simulates a user's physical presence and environment to allow for user interaction. Virtual realities artificially create sensory experience including sight, touch, hearing, and smell. Owing to the use of a single device in most VR contents, user have difficulty in manipulating user interface and game object. And also immersion of the game goes down because they can't see the mouse and keyboard in virtual space. In this paper, we design and implement the chess game to easily and accurately control user interface to improve the immersion in game.

• Journal of Digital Contents Society
• /
• v.18 no.7
• /
• pp.1239-1248
• /
• 2017

The domestic game market is still on a trend of growth. Particularly, as the demand for mobile games is increased, the mobile version is developed in a growing number of cases even after the launch of the games for PCS. In a bid to search for the effective method of UI design depending on the differences between the platforms, this study analyzed the types of different media in the first place and as the approaches to the UI design based on the affordance concept, implemented on the platform of PCS and implemented on the platform of mobile devices were analyzed as the cases which are the same MMORPG games. Since the differences between the game platforms can cause the variations in the physical size of the screens depending on the environment in which the user interface (UI) is rendered and may often involve the controls implemented by the touch of screens rather than the manipulation based on the keyboard and mouse, they usually give the influences on the direction of UI designs. By analyzing these UI elements based on the affordance concept, it may be possible to find the effective method of UI design in the future.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.4
• /
• pp.593-599
• /
• 2012

Objective: This study aims to implement a non-contact gesture-based interface for presentation purposes and to analyze the effect of the proposed interface as information transfer assisted device. Background: Recently, research on control device using gesture recognition or speech recognition is being conducted with rapid technological growth in UI/UX area and appearance of smart service products which requires a new human-machine interface. However, few quantitative researches on practical effects of the new interface type have been done relatively, while activities on system implementation are very popular. Method: The system presented in this study is implemented with KINECT$^{(R)}$ sensor offered by Microsoft Corporation. To investigate whether the proposed system is effective as a presentation support tool or not, we conduct experiments by giving several lectures to 40 participants in both a traditional lecture room(keyboard-based presentation control) and a non-contact gesture-based lecture room(KINECT-based presentation control), evaluating their interests and immersion based on contents of the lecture and lecturing methods, and analyzing their understanding about contents of the lecture. Result: We check that whether the gesture-based presentation system can play effective role as presentation supporting tools or not depending on the level of difficulty of contents using ANOVA. Conclusion: We check that a non-contact gesture-based interface is a meaningful tool as a sportive device when delivering easy and simple information. However, the effect can vary with the contents and the level of difficulty of information provided. Application: The results presented in this paper might help to design a new human-machine(computer) interface for communication support tools.

• Journal of Digital Convergence
• /
• v.9 no.4
• /
• pp.1-8
• /
• 2011

A mobile device is a handheld device, typically having a display screen with touch input and/or a miniature keyboard and accessible to the Internet. Because mobile devices are innovative and rapidly changing products, consumers are confronted with a decision-making problem to select the best device. This paper proposes an Analytic Hierarchy Process method to assess mobile devices and shows a method to select best mobile devices when purchasing. For this paper, the mobile devices considered as in the AHP model included net-book, tablet PC, smart phone, and camera phone. We derived 6 main criteria and 15 sub-criteria to synthesize the overall priority of criteria and mobile devices. The criterion of convenience in carrying showed the highest rank in the criteria. Although smart phones had the highest priority, the four mobile devices did not show significant differences in consumer preference.

• Journal of the Korean Society for Computer Game
• /
• v.31 no.4
• /
• pp.129-135
• /
• 2018

Electronic signatures, QR codes, and bar codes are used in payment systems used in real life. Research has begun on the payment system implemented in the VR environment. This paper proposes a VR electronic sign system that uses hand gesture recognition to implement an existing payment system in a VR environment. In a VR system, you can not hit the keyboard or touch the mouse. There can be several ways to configure a payment system with a VR controller. Electronic signage using hand gesture recognition is one of them, and hand gesture recognition can be classified by the Warping Methods, Statistical Methods, and Template Matching methods. In this paper, the payment system was configured in VR using the $p algorithm belonging to the Template Matching method. To create a VR environment, we implemented a paypal system where actual payment is made using Unity3D and Vive equipment.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.22 no.2
• /
• pp.189-200
• /
• 2012

With increasing the number of smart device such as Tablet PC, smart phone and netbook, information security which based on smart device in mobile environment have become the issue. It is important to enter a password safety. In various types of mobile devices, because of hardware limitation of device, it is difficult that to equip secondary input device such as keyboard and mouse. Also, a loss of accuracy becomes a problem because input information was entered by touch screen. Because of problem mentioned above it can be predicted to change password scheme text based password scheme to graphical password scheme, graphical password scheme is easy to use and is resistant to shoulder surfing attack. So this paper proposes new graphical password scheme based 5 strokes which are made by decomposed the Korean to defend against shoulder surfing attack.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.6
• /
• pp.1313-1320
• /
• 2023

This paper presents the development of a smart mirror that allows control of its display through glove gestures and integrates voice recognition functionality. The hardware configuration of the smart mirror consists of an LCD monitor combined with an acrylic panel, onto which a semi-mirror film with a reflectance of 37% and transmittance of 36% is attached, enabling it to function as both a mirror and a display. The proposed smart mirror eliminates the need for users to physically touch the mirror or operate a keyboard, as it implements gesture control through glove gesture sensors. Additionally, it incorporates voice recognition capabilities and integrates Google Assistant to display results on the screen corresponding to voice commands issued by the user.

• Journal of KIISE:Software and Applications
• /
• v.37 no.10
• /
• pp.788-801
• /
• 2010

Advancing of mobile device is remarkable, so the research on mobile input device is getting more important issue. There are lots of input devices such as keypad, QWERTY keypad, touch and speech recognizer, but they are not as convenient as typical keyboard-based desktop input devices so input strings usually contain many typing errors. These input errors are not trouble with communication among person, but it has very critical problem with searching in database, such as dictionary and address book, we can not obtain correct results. Especially, Hangeul has more than 10,000 different characters because one Hangeul character is made by combination of consonants and vowels, frequency of error is higher than English. Generally, suffix tree is the most widely used data structure to deal with errors of query, but it is not enough for variety errors. In this paper, we propose fast approximate Korean word searching system, which allows variety typing errors. This system includes several algorithms for applying general approximate string searching to Hangeul. And we present profanity filters by using proposed system. This system filters over than 90% of coined profanities.