• IEIE Transactions on Smart Processing and Computing
• /
• v.5 no.4
• /
• pp.267-273
• /
• 2016

Hand posture recognition is an important technique to enable a natural and familiar interface in the human-computer interaction (HCI) field. This paper introduces a hand posture recognition method using a depth camera. Moreover, the hand posture recognition method is incorporated with the Moving Picture Experts Group Rich Media User Interface (MPEG-U) Advanced User Interaction (AUI) Interface (MPEG-U part 2), which can provide a natural interface on a variety of devices. The proposed method initially detects positions and lengths of all fingers opened, and then recognizes the hand posture from the pose of one or two hands, as well as the number of fingers folded when a user presents a gesture representing a pattern in the AUI data format specified in MPEG-U part 2. The AUI interface represents a user's hand posture in the compliant MPEG-U schema structure. Experimental results demonstrate the performance of the hand posture recognition system and verified that the AUI interface is compatible with the MPEG-U standard.

• KIISE Transactions on Computing Practices
• /
• v.21 no.8
• /
• pp.555-560
• /
• 2015

In this paper, we analyzed the existing control methods of the legacy wearable-based CE devices and identified the requirements for improvements. In the conventional system, users waste their time configuring the initial network and registering their devices with the management server. To overcome these hurdles, we implemented the Easy-Setup framework for smart phones to personalized cloud devices.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.11a
• /
• pp.101-104
• /
• 2006

유비쿼터스 시대가 다가오면서 앞으로 가정 및 회사 등 인간이 거주하며 생활하는 공간에서의 좀 더 편리하고 효율적인 다양한 정보를 인간에게 인지시켜 줄 수 있는 환경이 구축되어야한다. 이를 기반으로 유비쿼터스 주변장치들의 네트워크와 인간에게 많은 정보와 편리성이 좀 더 효율적으로 이루어져야 할 것이다. 이를 위해 본 논문에서는 센서모듈에서 추출되는 데이터를 신경망과 퍼지 알고리즘을 사용해 동작인식의 패턴을 분류하여 인간의 사고를 움직임 파악한다. 이러한 패턴의 분류를 통해 홈네트워크 시스템과의 센서모듈의 통신제어가 가능하게 된다 이를 바탕으로 패턴이 분류된 행동들의 명령으로 미리 지정된 간단한 손동작으로 여러 가전기기라든지 홈네트워크 시스템의 제어방식을 더욱 간단히 제어하며, 인간의 건강상태를 파악함으로써 인간행동과 상태에 따른 유비쿼터스 환경의 제어가 이루어 질 수 있는 시스템을 제안한다.

• The Journal of the Korea Contents Association
• /
• v.11 no.10
• /
• pp.1-10
• /
• 2011

In this paper, we proposed the skin color based hand and finger detection technology for the gesture recognition in CCTV surveillance. The aim of this paper is to present the methodology for hand detection and propose the finger detection method. The detected hand and finger can be used to implement the non-contact mouse. This technology can be used to control the home devices such as home-theater and television. Skin color is used to segment the hand region from background and contour is extracted from the segmented hand. Analysis of contour gives us the location of finger tip in the hand. After detecting the location of the fingertip, this system tracks the fingertip by using only R channel alone, and in recognition of hand motions to apply differential image, such as the removal of useless image shows a robust side. We explain about experiment which relates in fingertip tracking and finger gestures recognition, and experiment result shows the accuracy above 96%.

• Science of Emotion and Sensibility
• /
• v.10 no.4
• /
• pp.583-601
• /
• 2007

The desktop interface is not suitable for the environment in which mobile devices are used commonly with moving, because much attention should be paid for it. And the miniaturizing of mobile devices increases the workload for using them, makes the operation speeds lower and makes more errors. So the study of appropriate level of the input interface for this changing environment is needed. In the aspect of mobile devices. input style and the complexity of the menu hierarchy, this study will look for the way to decrease the workload when doing some primary tasks and using mobile devices simultaneously with moving. The input style was classified into gesture input style, button input style, and pointing input style. The accuracy and speed were measured when doing dual tasks, including a menu searching task and a figure memory task, through one input style of three. By Changing the level of menu hierarchy in the menu searching task, the accuracy of task execution was examined. These Experiments were done in standing state and moving state. In both state the pointing input style was the highest in the accuracy of task execution but the slowest in the speed. In contrast, the gesture input style was not high in the accuracy but the fastest in the speed. This fact shows that the gesture input style is suitable for the condition needed for speedy processing rather than accurate execution when moving.

• Journal of Internet Computing and Services
• /
• v.17 no.2
• /
• pp.29-37
• /
• 2016

Humans develop and maintain relationship through communication. Communication is largely divided into verbal communication and non-verbal communication. Verbal communication involves the use of a language or characters, while non-verbal communication utilizes body language. We use gestures with language together in conversations of everyday life. Gestures belong to non-verbal communication, and can be offered using a variety of shapes and movements to deliver an opinion. For this reason, gestures are spotlighted as a means of implementing an NUI/NUX in the fields of HCI and HRI. In this paper, using Kinect and the geometric features of the hand, we propose a method for recognizing the number of fingers and detecting the hand area. A Kinect depth image can be used to detect the hand region, with the finger number identified by comparing the distance of outline and the central point of a hand. Average recognition rate for recognizing the number of fingers is 98.5%, from the proposed method, The proposed method would help enhancing the functionality of the human computer interaction by increasing the expression range of gestures.

• The Journal of Korean Institute of Next Generation Computing
• /
• v.15 no.5
• /
• pp.53-63
• /
• 2019

To provide a hand gesture interface through deep learning in mobile environments, research on the light-weighting of networks is essential for high recognition rates while at the same time preventing degradation of execution speed. This paper proposes a method of real-time recognition of written characters in the air using a finger on mobile devices through the light-weighting of deep-learning model. Based on the SSD (Single Shot Detector), which is an object detection model that utilizes MobileNet as a feature extractor, it detects index finger and generates a result text image by following fingertip path. Then, the image is sent to the server to recognize the characters based on the learned OCR model. To verify our method, 12 users tested 1,000 words using a GALAXY S10+ and recognized their finger with an average accuracy of 88.6%, indicating that recognized text was printed within 124 ms and could be used in real-time. Results of this research can be used to send simple text messages, memos, and air signatures using a finger in mobile environments.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.05a
• /
• pp.675-678
• /
• 2014

One time, Home video game console's penetration was as comparable to the personal computer's penetration, growth has slowed since the advent of smartphones, tablets and moblie devices. But game console actively introducing new IT technologies not available in the pc games and mobile games, still keeping a firm position in the relevent market. In this paper Home video game console's history, contemporary trends, and learn about trends in the company, New IT technologies applied to gaming was analyzed. Home video console market become the arena of New IT technologies according to the introduction of New IT technologies such as gesture recognition technology, speech recognition technology, media facade technology, virtual reality technology.

• International Journal of Computer Science & Network Security
• /
• v.22 no.7
• /
• pp.268-282
• /
• 2022

One of the most important technologies today is augmented reality technology, it allows users to experience the real world using virtual objects that are combined with the real world. This technology is interesting and has become applied in many sectors such as the shopping and medicine, also it has been included in the sector of education. In the field of education, AR technology has become widely used due to its effectiveness. It has many benefits, such as arousing students' interest in learning imaginative concepts that are difficult to understand. On the other hand, studies have proven that collaborative between students increases learning opportunities by exchanging information, and this is known as Collaborative Learning. The use of multimodal creates a distinctive and interesting experience, especially for students, as it increases the interaction of users with the technologies. The research aims at developing collaborative framework for developing achievement of 6th graders through designing a framework that integrated a collaborative framework with a multimodal input "hand-gesture and touch", considering the development of an effective, fun and easy to use framework with a multimodal interaction in AR technology that was applied to reformulate the genetics and traits lesson from the science textbook for the 6th grade, the first semester, the second lesson, in an interactive manner by creating a video based on the science teachers' consultations and a puzzle game in which the game images were inserted. As well, the framework adopted the cooperative between students to solve the questions. The finding showed a significant difference between post-test and pre-test of the experimental group on the mean scores of the science course at the level of remembering, understanding, and applying. Which indicates the success of the framework, in addition to the fact that 43 students preferred to use the framework over traditional education.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.2
• /
• pp.190-195
• /
• 2007

As Ubiquitous era comes, it became necessary to construct environment which can provide more useful information to human in the spaces where people live like homes or offices. On this account, network of the peripheral devices of Ubiquitous should constitute efficiently. For it, this paper researched human pattern by classified motion recognition using sensors module data. (This data processing by Neural network and fuzzy algorithm.) This pattern classification can help control home network system communication. I suggest the system which can control home network system more easily through patterned movement, and control Ubiquitous environment by grasp human's movement and condition.