• 전기전자학회논문지
• /
• 제18권2호
• /
• pp.291-297
• /
• 2014

Since hand gesture recognition was realized thanks to improved image processing algorithms, sign language translation has been a critical issue for the hearing-impaired. In this paper, we extract human hand figures from a real time image stream and detect gestures in order to figure out which kind of hand language it means. We used depth-color calibrated image from the Kinect to extract human hands and made a decision tree in order to recognize the hand gesture. The decision tree contains information such as number of fingers, contours, and the hand's position inside a uniform sized image. We succeeded in recognizing 'Hangul', the Korean alphabet, with a recognizing rate of 98.16%. The average execution time per letter of the system was about 76.5msec, a reasonable speed considering hand language translation is based on almost still images. We expect that this research will help communication between the hearing-impaired and other people who don't know hand language.

• 대한인간공학회지
• /
• 제34권5호
• /
• pp.411-426
• /
• 2015

Objective: The goal of this thesis is to design the interaction structure and framework of system to recognize sign language. Background: The sign language of meaningful individual gestures is combined to construct a sentence, so it is difficult to interpret and recognize the meaning of hand gesture for system, because of the sequence of continuous gestures. This being so, in order to interpret the meaning of individual gesture correctly, the interaction structure and framework are needed so that they can segment the indication of individual gesture. Method: We analyze 700 sign language words to structuralize the sign language gesture interaction. First of all, we analyze the transformational patterns of the hand gesture. Second, we analyze the movement of the transformational patterns of the hand gesture. Third, we analyze the type of other gestures except hands. Based on this, we design a framework for sign language interaction. Results: We elicited 8 patterns of hand gesture on the basis of the fact on whether the gesture has a change from starting point to ending point. And then, we analyzed the hand movement based on 3 elements: patterns of movement, direction, and whether hand movement is repeating or not. Moreover, we defined 11 movements of other gestures except hands and classified 8 types of interaction. The framework for sign language interaction, which was designed based on this mentioned above, applies to more than 700 individual gestures of the sign language, and can be classified as an individual gesture in spite of situation which has continuous gestures. Conclusion: This study has structuralized in 3 aspects defined to analyze the transformational patterns of the starting point and the ending point of hand shape, hand movement, and other gestures except hands for sign language interaction. Based on this, we designed the framework that can recognize the individual gestures and interpret the meaning more accurately, when meaningful individual gesture is input sequence of continuous gestures. Application: When we develop the system of sign language recognition, we can apply interaction framework to it. Structuralized gesture can be used for using database of sign language, inventing an automatic recognition system, and studying on the action gestures in other areas.

• 대한임베디드공학회논문지
• /
• 제14권3호
• /
• pp.133-142
• /
• 2019

The existing auxiliary communicating aids for the hearing-impaired have an inconvenience of using additional expensive sensing devices. This paper presents a hand image detection based algorithm to interpret the sign language of the hearing-impaired. The proposed sign language recognition system exploits the hand image only captured by the camera without using any additional gloves with extra sensors. Based on the hand image processing, the system can perfectly classify several numeric sign language representations. This work proposes a simple lightweight classification algorithm to identify the hand image of the hearing-impaired to communicate with others even further in an environment of complex background. Experimental results show that the proposed system can interpret the numeric sign language quite well with an accuracy of 95.6% on average.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2007년도 심포지엄 논문집 정보 및 제어부문
• /
• pp.216-218
• /
• 2007

Korean Sign Language (KSL) is a communication method for the Deaf in Korea, and hand shape is one of important elements in sign language. In this paper, we developed a KSL hand shape editor to simply compose hand shape and connect it to a database. We can edit hand shape by a graphical user interface (GUI) on 3D virtual reality environment. Hand shape codes are connected to a sign word editor to synthesize sign motion and to decrease total amount of KSL data.

• 한국정보처리학회논문지
• /
• 제7권5호
• /
• pp.1317-1329
• /
• 2000

The advanced techniques for video processing and computer graphics enables a sign language education system to appear. the system is capable of showing a sign language motion for an arbitrary sentence using the captured video clips of sign language words. In this paper, a method is suggested which generates the frames between the last frame of a word and the first frame of its following word in order to animate hand motion. In our method, we find hand locations and angles which are required for in between frame generation, capture and store the hand images at those locations and angles. The inbetween frames generation is simply a task of finding a sequence of hand angles and locations. Our method is computationally simple and requires a relatively small amount of disk space. However, our experiments show that inbetween frames for the presentation at about 15fps (frame per second) are achieved so tat the smooth animation of hand motion is possible. Our method improves on previous works in which computation cost is relativey high or unnecessary images are generated.

• 한국컴퓨터정보학회논문지
• /
• 제19권11호
• /
• pp.63-72
• /
• 2014

본 논문에서는 깊이 카메라를 이용한 사용자의 손 모양 인식 시스템을 제안한다. 특히, 본 시스템에서 이용된 손 모양 템플릿은 수화 언어 중 한국어를 채택 하였다. 손 모양 인식 시스템은 손의 특징 검출과 특징들을 이용한 손 인식으로 크게 2 단계의 작업으로 나눌 수 있다. 손의 특징으로는 손가락의 개수, 길이, 손바닥의 넓이 등이 있다. 특징을 추출하기 위해 본 논문에서는 거리 변환(Distance Transform)을 이용한 손의 뼈대 검출 방법을 제안한다. 이 방법을 사용하면 기존의 윤곽선(Contour)을 이용한 손가락 검출보다 정확도 측면에서 향상된다. 손 모양 인식으로 손의 특징을 이용하여 각 분기를 잘 나눌 수 있는 결정 트리(Decision Tree)를 사용한다. 사용자의 입력을 이용하면 분기값이 정확하게 나오지 못하므로 이 분기 값을 결정하기 위해 해당 분기마다 SVM을 이용하여 분기값을 결정하였다. 실험결과에서는 기존의 연구 방법보다 제안된 방법이 특징 추출과 인식하는데 있어 더욱 개선되었음을 보인다.

• Journal of Computing Science and Engineering
• /
• 제10권3호
• /
• pp.95-101
• /
• 2016

In this study, we propose a new system for constructing parallel corpora for sign languages, which are generally under-resourced in comparison to spoken languages. In order to achieve scalability and accessibility regarding data collection and corpus construction, our system utilizes deep learning-based techniques and predicts depth information to perform pose estimation on hand information obtainable from video recordings by a single RGB camera. These estimated poses are then transcribed into expressions in SignWriting. We evaluate the accuracy of hand tracking and hand pose estimation modules of our system quantitatively, using the American Sign Language Image Dataset and the American Sign Language Lexicon Video Dataset. The evaluation results show that our transcription system has a high potential to be successfully employed in constructing a sizable sign language corpus using various types of video resources.

• 인문언어
• /
• 제6권
• /
• pp.169-183
• /
• 2004

So far I have reviewed the two controversial opinions of the North Korean and the South Korean linguists concerning the position of the Koguryeo language in the formation of Korean. Many South Korean scholars in favor of the Altaic Language Family Hypothesis argue that the ancient Korean language consisted of two different languages, one of which was the northern dialect including four languages such as the Koguryeo language (the largest one within the area), the Puyo language, the Okche language, the Yemaek language, and the other was the southern dialect, the largest language of which is the Shinla language. On the other hand, the linguists of North Korea claim that in Koguryeo and Shinla the same language was spoken and that modern Korean is formed based on the Koguryeo language. Before evaluating which of these claims is correct I would like to turn to the scarcity of the linguistic data of the Koguryeo language. Compared with the pragmatic methodology of the South Korean linguists in the studies on the Altaic affinity of Korean, the North Korean scholars need to present still more evidences in order to support their argument. In Chung (1993) I argued that studies on the genealogy of the Korean language or history had to be performed regardless of tile political purpose or for the purposes. We should admit the historical fact that there had been many tribal states in the Korean peninsula before the ancient Korean stage, those of which had been emerged to become three kingdoms. Those kingdoms were unified by Shinla, which was connected to Koryeo Dynasty. We cannot disregard the fact that the Korean language has been developed hand in hand with these historical process with those steps related with each age. The first thing we should do right now is to collect the remaining data of the Koguryeo language recorded in the old written materials, which have been found in North Korea as many as possible. Also, 1 hope that the linguists of South Korea achieve more academic success in the comparative studies of the Paekjae language, the Shinla language, and other adjacent Altaic languages.

• 대한전자공학회논문지SP
• /
• 제48권4호
• /
• pp.30-37
• /
• 2011

본 논문에서는 수신호 인식기에 쓰이기 위한 분별성 있는 손동작을 만드는 방법을 제안한다. 기존의 수화DB에서 손의 움직임을 분석하여 기본 동작이 되는 4가지의 모션 프리미티브를 선정하였으며, 선정된 모션 프리미티브를 조합하여 구별성 있는 '기본 손동작 집합'을 제작하였다. 제안하는 '기본 손동작 집합' 의 구별성을 증명하기 위하여 '기본 손동작 집합' 인식기를 만들고 인식결과를 확인하였다. 사용된 인식기는 hidden Markov model (HMM) 을 기반으로 제작되었다. 기본 손동작 인식 task에 대한 성능평가 결과 99.01%로써 각 모델 간에 높은 구별성을 보이는 것을 확인할 수 있었다.

• 전자공학회논문지C
• /
• 제34C권2호
• /
• pp.61-70
• /
• 1997

Human-hand gestures have been used a means of communication among people for a long time, being interpreted as streams of tokens for a language. The signed language is a method of communication for hearing impaired person. Articulated gestures and postures of hands and fingers are commonly used for the signed language. This paper presents a system which recognizes the korean sign language (KSL) and translates the recognition results into a normal korean text and sound. A pair of data-gloves are used a sthe sensing device for detecting motions of hands and fingers. In this paper, we propose a dynamic gesture recognition mehtod by employing a fuzzy feature analysis method for efficient classification of hand motions, and applying a fuzzy min-max neural network to on-line pattern recognition.