• Title/Summary/Keyword: sign language recognition

Search Result 84, Processing Time 0.028 seconds

Implementation of Real-time Recognition System for Continuous Korean Sign Language(KSL) mixed with Korean Manual Alphabet(KMA) (지문자를 포함한 연속된 한글 수화의 실시간 인식 시스템 구현)

  • Lee, Chan-Su;Kim, Jong-Sung;Park, Gyu-Tae;Jang, Won;Bien, Zeung-Nam
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.6
    • /
    • pp.76-87
    • /
    • 1998
  • This paper deals with a system which recognizes dynmic hand gestures, Korean Sign Language(KSL), mixed with static hand gesture, Korean Manual Alphabet(KMA), continuously. Recognition of continuous hand gestures is very difficult for lack of explicit tokens indicating beginning and ending of signs and for complexity of each gesture. In this paper, state automata is used for segmenting sequential signs into individual ones, and basic elements of KSL and KMA, which consist of 14 hand directions, 23 hand postures and 14 hand orientations are used for recognition of complex gestures under consideration of expandability. Using a pair of CyberGlove and Polhemus sensor, this system recognizes 131 Korean signs and 31 KMA's in real-time with recognition rate 94.3% for KSL excluding no recognition case and 96.7% for KMA.

  • PDF

The Study of Support Vector Machine-based HOG (Histogram of Oriented Gradients) Feature Vector for Recognition by Numerical Sign Language (숫자 수화 인식을 위한 서포트 벡터 머신 기반의 HOG(Histogram of Oriented Gradients) 특징 벡터 연구)

  • Lee, SeungHwan;Yoo, JaeChern
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2019.07a
    • /
    • pp.271-272
    • /
    • 2019
  • 현재 4차 산업혁명으로 인해 많은 이들의 삶의 질이 이전보다 개선되었음에도 불구하고, 소외된 계층을 위한 개발은 타 분야에 비해서 더뎌지고 있는 실정이다. 현대의 청각 장애인과 언어 장애인들은 시각 언어인 수화를 이용하여 의사소통을 한다. 그러나 수화는 진입 장벽이 높기 때문에, 이를 사용하지 않는 사람들은 청각 장애인 및 언어 장애인과 의사소통을 하는데 어려움을 겪는다. 본 논문은 이러한 불편함을 줄이기 위해 서포트 벡터 머신(Support Vector Machine, SVM) 기반의 HOG(Histogram of Oriented Gradients) 특징 벡터를 이용하여 수화의 기본인 숫자를 분류할 수 있는 시스템을 구현하여 수화를 번역할 수 있는 가능성을 제안한다.

  • PDF

Legibility & Recognition of Signs for Train Station (철도역을 위한 사인의 가독성과 픽토그램의 의미작용에 관한 연구)

  • Han Suk-Woo;Jin Mi-Ja
    • Proceedings of the KSR Conference
    • /
    • 2003.05a
    • /
    • pp.176-184
    • /
    • 2003
  • Railway sign(graphic sign, diagraphics) designs require good recognition with universality to transmit accurate and speedy information as they connect people around the station and other transport systems. An important point of signs is how to design and deliver the contents to the viewers as a communication service tools. It needs to establish design guidelines with standardization and unified system to show their contents and images clearly like common language with visuality, attractivity and generality. These requisites are important for both aesthetics legibility and unified standards to maximize the effectiveness of pictograms for the use of the general public, who require systematic suggestion and management.

  • PDF

Sign Language Shape Recognition Using SOFM Neural Network (SOFM신경망을 이용한 수화 형상 인식)

  • Kim, Kyoung-Ho;Kim, Jong-Min;Jeong, Jea-Young;Lee, Woong-Ki
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.11a
    • /
    • pp.283-284
    • /
    • 2009
  • 본 논문은 단일 카메라 환경에서 손 형상을 입력정보로 사용하여 손 영역만을 분할한 후 자기 조직화 특징 지도(SOFM: Self Organized Feature Map) 신경망 알고리즘을 이용하여 손 형상을 인식함으로서 수화인식을 위한 보다 안정적이며 강인한 인식 시스템을 구현하고자 한다.

Recognition of Finger Language Using FCM Algorithm (FCM 알고리즘을 이용한 지화 인식)

  • Kim, Kwang-Baek;Woo, Young-Woon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.6
    • /
    • pp.1101-1106
    • /
    • 2008
  • People who have hearing difficulties suffer from satisfactory mutual interaction with normal people because there are little chances of communicating each other. It is caused by rare communication of people who have hearing difficulties with normal people because majority of normal people can not understand sing language that is represented by gestures and is used by people who have hearing difficulties as a principal way of communication. In this paper, we propose a recognition method of finger language using FCM algorithm in order to be possible of communication of people who have hearing difficulties with normal people. In the proposed method, skin regions are extracted from images acquired by a camera using YCbCr and HSI color spaces and then locations of two hands are traced by applying 4-directional edge tracking algorithm on the extracted skin lesions. Final hand regions are extracted from the traced hand regions by noise removal using morphological information. The extracted final hand regions are classified and recognized by FCM algorithm. In the experiment using images of finger language acquired by a camera, we verified that the proposed method have the effect of extracting two hand regions and recognizing finger language.

A Design of Sign Language-Text Translation System Using Deep Learning Vedio Recognition (딥러닝 영상인식을 이용한 수화-텍스트 번역 시스템 설계)

  • Lee, JongMyeong;Kim, Kang-Gyoo;Yoo, Seoyeon;Lee, SeungGeon;Chun, Seunghyun;Beak, JeongYoon;Ha, Ok-Kyoon
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.07a
    • /
    • pp.475-476
    • /
    • 2022
  • 본 논문에서는 청각장애인의 사회참여성 증진 및 사회적 차별감소를 목적으로 딥러닝 영상인식 기반으로 MediaPipe 기술을 활용한 수화-텍스트 번역시스템을 설계한다. 제시하는 시스템은 실시간으로 수집된 수화 사용자의 영상정보를 통해 동작과 표정을 인식하여 텍스트로 번역함으로써 장애인과 비장애인의 원활한 의사소통 서비스를 제공하는 것을 주 목적으로한다. 향후 개선된 수화 인식 및 문장 조합을 통해 일상에서 청각장애인과 일반인의 자유로운 커뮤니케이션을 제공하는 서비스로 확장하고자한다.

  • PDF

Hand Motion Design for Performance Enhancement of Vision Based Hand Signal Recognizer (영상기반의 안정적 수신호 인식기를 위한 손동작 패턴 설계 방법)

  • Shon, Su-Won;Beh, Joung-Hoon;Yang, Cheol-Jong;Wang, Han;Ko, Han-Seok
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.4
    • /
    • pp.30-37
    • /
    • 2011
  • This paper proposes a language set of hand motions for enhancing the performance of vision-based hand signal recognizer. Based on the statistical analysis of the angular tendency of hand movements in sign language and the hand motions in practical use, we construct four motion primitives as building blocks for basic hand motions. By combining these motion primitives, we design a discernable 'fundamental hand motion set' toward increasing the hand signal recognition. To demonstrate the validity of proposed designing method, we develop a 'fundamental hand motion set' recognizer based on hidden Markov model (HMM). The recognition system showed 99.01% recognition rate on the proposed language set. This result validates that the proposed language set enhances discernaility among the hand motions such that the performance of hand signal recognizer is improved.

Hand Gesture Recognition with Convolution Neural Networks for Augmented Reality Cognitive Rehabilitation System Based on Leap Motion Controller (립모션 센서 기반 증강현실 인지재활 훈련시스템을 위한 합성곱신경망 손동작 인식)

  • Song, Keun San;Lee, Hyun Ju;Tae, Ki Sik
    • Journal of Biomedical Engineering Research
    • /
    • v.42 no.4
    • /
    • pp.186-192
    • /
    • 2021
  • In this paper, we evaluated prediction accuracy of Euler angle spectrograph classification method using a convolutional neural networks (CNN) for hand gesture recognition in augmented reality (AR) cognitive rehabilitation system based on Leap Motion Controller (LMC). Hand gesture recognition methods using a conventional support vector machine (SVM) show 91.3% accuracy in multiple motions. In this paper, five hand gestures ("Promise", "Bunny", "Close", "Victory", and "Thumb") are selected and measured 100 times for testing the utility of spectral classification techniques. Validation results for the five hand gestures were able to be correctly predicted 100% of the time, indicating superior recognition accuracy than those of conventional SVM methods. The hand motion recognition using CNN meant to be applied more useful to AR cognitive rehabilitation training systems based on LMC than sign language recognition using SVM.

A Decision Tree based Real-time Hand Gesture Recognition Method using Kinect

  • Chang, Guochao;Park, Jaewan;Oh, Chimin;Lee, Chilwoo
    • Journal of Korea Multimedia Society
    • /
    • v.16 no.12
    • /
    • pp.1393-1402
    • /
    • 2013
  • Hand gesture is one of the most popular communication methods in everyday life. In human-computer interaction applications, hand gesture recognition provides a natural way of communication between humans and computers. There are mainly two methods of hand gesture recognition: glove-based method and vision-based method. In this paper, we propose a vision-based hand gesture recognition method using Kinect. By using the depth information is efficient and robust to achieve the hand detection process. The finger labeling makes the system achieve pose classification according to the finger name and the relationship between each fingers. It also make the classification more effective and accutate. Two kinds of gesture sets can be recognized by our system. According to the experiment, the average accuracy of American Sign Language(ASL) number gesture set is 94.33%, and that of general gestures set is 95.01%. Since our system runs in real-time and has a high recognition rate, we can embed it into various applications.