• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.10 no.4
• /
• pp.674-679
• /
• 2006

In this paper a gesture recognition system using 3D feature data is described. The system relies on a novel 3D sensor that generates a dense range mage of the scene. The main novelty of the proposed system, with respect to other 3D gesture recognition techniques, is the capability for robust recognition of complex hand postures such as those encountered in sign language alphabets. This is achieved by explicitly employing 3D hand features. Moreover, the proposed approach does not rely on colour information, and guarantees robust segmentation of the hand under various illumination conditions, and content of the scene. Several novel 3D image analysis algorithms are presented covering the complete processing chain: 3D image acquisition, arm segmentation, hand -forearm segmentation, hand pose estimation, 3D feature extraction, and gesture classification. The proposed system is tested in an application scenario involving the recognition of sign-language postures.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.3
• /
• pp.319-327
• /
• 2012

In this paper, we present a sign language recognition model which does not use any wearable devices for object tracking. The system design issues and implementation issues such as data representation, feature extraction and pattern classification methods are discussed. The proposed data representation method for sign language patterns is robust for spatio-temporal variances of feature points. We present a feature extraction technique which can improve the computation speed by reducing the amount of feature data. A neural network model which is capable of incremental learning is described and the behaviors and learning algorithm of the model are introduced. We have defined a measure which reflects the relevance between the feature values and the pattern classes. The measure makes it possible to select more effective features without any degradation of performance. Through the experiments using six types of sign language patterns, the proposed model is evaluated empirically.

• Journal of Korea Multimedia Society
• /
• v.4 no.3
• /
• pp.238-246
• /
• 2001

We have developed the sign-language synthesis system, which can be applied for intelligent terminal equipments, for the purpose of communications between normal people and the hearing-impaired. In the system, we generate the behavior of the sign-language words using CG animation based on Motion-Primitives of the motion observed of each legion of the body in the generation of words, the conventional system was difficult to control the shape of hands and the motions of hands and shoulder, requiring lots of time for the processing. Also it is a big problem to make a large database of sign-language, because it requires over 5,000 words to translate the sign-language. Therefore, in this paper, we propose the new system that is easy to construct the database by using Motion-Primitives, which can make paths of various motions more smooth than conventional systems. We have tested 100 words of the sign-language against the hearing-impaired with the proposed system. As the result of testing by the proposed system, we have earned a good recognition rate with 82%. On the other hand, we had earned the recognition ratio with 76% by using the former system.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.11a
• /
• pp.1047-1048
• /
• 2023

청각장애인은 수화 언어, 즉 수어를 통해 의사소통한다. 따라서 본 논문에서는 의료 상황에서 청각 장애인이 겪는 소통의 어려움을 해결하기 위해 의료 상황 중심의 수어 데이터셋을 구축한 뒤, R(2+1)D 딥러닝 모델을 이용해 수어 동작을 영상 단위로 인식하고 분류할 수 있도록 하였다. 그리고 이를 Django를 이용한 웹 사이트로 만들어 사용할 수 있게 하였다. 이 웹 페이지는 청각장애인 개인 뿐만 아니라 의료 사회 전반적으로 긍정적인 효과를 줄 것으로 기대한다.