• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.10
• /
• pp.1323-1329
• /
• 2021

For hand expression recognition, hand pose recognition based on the static shape of the hand and hand gesture recognition based on the dynamic hand movement are used together. In this paper, we propose a hierarchical hand pose model based on finger position and shape for hand expression recognition. For hand pose recognition, a finger model representing the finger state and a hand pose model using the finger state are hierarchically constructed, which is based on the open source MediaPipe. The finger model is also hierarchically constructed using the bending of one finger and the touch of two fingers. The proposed model can be used for various applications of transmitting information through hands, and its usefulness was verified by applying it to number recognition in sign language. The proposed model is expected to have various applications in the user interface of computers other than sign language recognition.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2016.10a
• /
• pp.644-646
• /
• 2016

Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

• Korean Journal of Child Studies
• /
• v.29 no.2
• /
• pp.73-87
• /
• 2008

This research studied the effects of music experiences on the language development of toddlers in the day care setting. Subjects were 44(23 experimental group; 21 control group) 29- to 42-month-old children. The experimental group experienced 10 weeks of music activities, including musical sense, singing, listening, playing instruments, improvisation, finger plays, movement, simple games, word-sound music games and music routines. Language development was tested by the Preschool Receptive-Expressive Language Scale(Kim et al. 2003). Significant differences were found in the receptive language development of 30- to 36-month-old and in the expressive language development of 36- to 42-month-old toddlers, respectively.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.16 no.5
• /
• pp.157-163
• /
• 2016

This paper presents Finger Keyboard which detects the user's key types on a keyboard drawn on the paper using a video camera. The Finger Keyboard software was written in standard C/C++ language and thus easy to port to other computing environments. We installed a popular USB-type web camera on a Windows PC and implemented the Finger Keyboard as a Windows application which detects key typing and then injects the key code into the message queue of the Windows operating system. Also we implemented the Finger Keyboard on the Raspberry Pi 2 embedded computer with a dedicated camera and connected it to the Android device as an external keyboard through the Bluetooth. The result of experiments showed that the average ratio of recognition success is around 80% at the typing speed of 120 characters per minute.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.13 no.4
• /
• pp.91-97
• /
• 2013

A finger-gesture remote controller using the single camera is implemented in this paper, which is base on the recognition of finger number and finger moving direction. Proposed method uses the transformed YCbCr color-difference information to extract the hand region effectively. The number and position of finger are computer by using a double circle tracing method. Specially, a user continuous-command can be performed repeatedly by recognizing the finger-gesture direction of single shape. The position information of finger enables a user command to amplify a same command in the User eXperience. Also, all processing tasks are implemented by using the Intel OpenCV library and C++ language. In order to evaluate the performance of the our proposed method, after applying to the commercial video player software as a remote controller. As a result, the proposed method showed the average 89% recognition ratio by the user command-mode.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.5
• /
• pp.937-941
• /
• 2008

People who have hearing difficulties use sign language as the most important communication method, and they can broaden personal relations and manage their everyday lives without inconvenience through sign language. But they suffer from absence of interpolation between normal people and people who have hearing difficulties in increasing video chatting or video communication services by recent growth of internet communication. In this paper, we proposed a sign language recognition method in order to solve such a problem. In the proposed method, regions of two hands are extracted by tracking of two hands using RGB, YUV and HSI color information from a sign language image acquired from a video camera and by removing noise in the segmented images. The extracted regions of two hands are teamed and recognized by ART2 algorithm that is robust for noise and damage. In the experiment by the proposed method and images of finger number from 1 to 10, we verified the proposed method recognize the numbers efficiently.

• International Journal of Contents
• /
• v.7 no.3
• /
• pp.60-64
• /
• 2011

Jane Campion's is a well-known film for a number of reasons, such as for being an Oscar winner, for having been helmed by an emerging director from New Zealand, and for having the reputation of being a feminist film. In this paper, the first scene of was chosen to examine the heroine Ada's language in terms of the gothic genre. Ada is a dumb woman who lives in the era of man's language. She represents the women's social position in the Victorian era but has her own and unique language for communicating with the outside world. The first scene of introduces Ada's own language, using her fingers. Her fingers speak for her all the time instead of her mouth, and there is someone who can understand what she wants to say when all others cannot. How the film depicts Ada's language and how the first scene well summarizes the film's core are examined herein.

• English Language & Literature Teaching
• /
• v.10 no.2
• /
• pp.89-111
• /
• 2004

The purpose of this article is to study the effect of finger play teaching method on the reproduction of children's English words. The hypotheses are as follows: 1) there will be the difference of the reproduction of children's English words between the experimental group(that is taught by finger play teaching method) and the controlled group (that is taught by only oral teaching method). 2) there will be the difference of children's retention capacity of reproducing English words between the experimental group and the controlled group, The researcher made the time series data The measure tool was the check list for reproduction test of children's English words that was made by Run-Soon Oh and J. Eden(2004). The researcher analyzed the data using the Repeated Measures ANOVA and the Analysis of Covariance. The findings of research are as follows: 1) the more the frequency of teaching increases, the more there are the difference of reproducing English words according to frequencies and groups. The reproduction capacity of the experimental group is better than that of the controlled group. A degree of statistical significance is p<.001. 2) The difference of retention capacity of reproducing English words between the experimental group and the controlled group is a statistical significant, p<.05. The experimental group is better than the controlled group.

• Journal of the Institute of Convergence Signal Processing
• /
• v.15 no.2
• /
• pp.42-47
• /
• 2014

A finger-gesture game controller using the single camera is implemented in this paper, which is based on the recognition of the number of fingers and the index finger moving direction. Proposed method uses the CAMShift algorithm to trace the end-point of index finger effectively. The number of finger is recognized by using a double circle tracing method. Then, HSI color mode transformation is performed for the CAMShift algorithm, and YCbCr color model is used in the double circle tracing method. Also, all processing tasks are implemented by using the Intel OpenCV library and C++ language. In order to evaluate the performance of the proposed method, we developed a shooting game simulator and validated the proposed method. The proposed method showed the average recognition ratio of more than 90% for each of the game command-mode.

• The Transactions of the Korea Information Processing Society
• /
• v.7 no.3
• /
• pp.756-765
• /
• 2000

In this paper, a korean text to sign language translation system is designed and implemented for the hearing impaired people to learn letters and to have a conversation with normal people. We adopt the direct method for machine translation which uses morphological analysis and the dictionary search. And we define the necessary sign language dictionaries. Based on this processes, the system translate korean sentences to sign language moving picture. The proposed dictionaries are composed of the basic sign language dictionary, the compound sing language dictionary, and the resemble sign language dictionary. The basic sign language dictionary includes basic symbols and moving pictures of korean sign language. The compound sing language dictionary is composed of key-words of basic sign language. In addition, we offered the similar letters at the resemble sign language dictionary. The moving pictures of searched sign symbols are displayed on a screen in GIF formats by continuous motion of sign symbols or represented by the finger spelling based on the korean code analysis. The proposed system can provide quick sign language search and complement the lack of sign languages in the translation process by using the various sign language dictionaries which are characterized as korean sign language. In addition, to represent the sign language using GIF makes it possible to save the storage space of the sign language. In addition, to represent the sign language using GIF makes it possible to save storage space of the sign language dictionary.