• Journal of KIISE
• /
• v.44 no.2
• /
• pp.163-170
• /
• 2017

Despite the rise of studies in spoken to sign language translation, low-resource problems of sign language corpus have been rarely addressed. As a first step towards translating from spoken to sign language, we addressed the problems arising from resource scarcity when translating spoken language to manual signals translation using statistical machine translation techniques. More specifically, we proposed three preprocessing methods: 1) paraphrase generation, which increases the size of the corpora, 2) lemmatization, which increases the frequency of each word in the corpora and the translatability of new input words in spoken language, and 3) elimination of function words that are not glossed into manual signals, which match the corresponding constituents of the bilingual sentence pairs. In our experiments, we used different types of English-American sign language parallel corpora. The experimental results showed that the system with each method and the combination of the methods improved the quality of manual signals translation, regardless of the type of the corpora.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.552-554
• /
• 2019

Deaf mutism (a hearing-impaired person and speech disorders) communicates using sign language. There are difficulties in communicating by voice. However, sign language can only be limited in communicating with people who know sign language because everyone doesn't use sign language when they communicate. In this paper, a finger language translation system is proposed and implemented as a means for the disabled and the non-disabled to communicate without difficulty. The proposed algorithm recognizes the finger language data by leap motion and self-learns the data using machine learning technology to increase recognition rate. We show performance improvement from the simulation results.

• Journal of Korean Philosophical Society
• /
• v.126
• /
• pp.295-320
• /
• 2013

This thesis amis to demonstrate basically that language has the potential enough to be able to determine human's belief, attitude and behavior for Spinoza. As long as the language could be conceived with the potential to do, then it is very important in human community. And it is through dynamic and changeable, not fixed state, that meaning of this language is revealed. For Spinoza, even sign and its meaning compose one language system, but both of which are different from the other community. Because language as sign used in a specific society is articulated expression of body image, each imagination as idea is necessarily followed by its sign. This fact makes us say that language express imaginal knowledge. But language should not be considered as an means to express adequate idea of it. By the reason that order of meaning is only determined by the connection of signs, and that of meanings, each meaning of sign is not fixed. In this respect, certain meaning is changeable on account of changing new order of ideas. Through re-arranging new order of meaning, language could express more adequate and better idea than before. but what the most important fact is that it is not sufficient to express adequate idea by the means of language. Power of language determining human's belief and attitude does not depend on whether meaning of sign is true or not, but on hegemony of order of meaning. with this regard, this world could be seen as battle area of conflicting for orders of meaning. The more members accept newly created rational thought through newly arranged words, the more new views of value gain power. Solidarity of man using common language can change the world. For this purpose, first step depends on freedom of thought, freedom of deliverance of thought in which spinoza insists through A Theological - Political Treatise.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1106-1110
• /
• 2004

A human sign language is generally composed of both static and dynamic gestures. Each gesture is represented by a hand shape, its position, and hand movement (for a dynamic gesture). One of the problems found in automated sign language translation is on segmenting a hand movement that is part of a transitional movement from one hand gesture to another. This transitional gesture conveys no meaning, but serves as a connecting period between two consecutive gestures. Based on the observation that many dynamic gestures as appeared in Thai sign language dictionary are of quasi-periodic nature, a method was developed to differentiate between a (meaningful) dynamic gesture and a transitional movement. However, there are some meaningful dynamic gestures that are of non-periodic nature. Those gestures cannot be distinguished from a transitional movement by using the signal quasi-periodicity. This paper proposes a hybrid method using a combination of the periodicity-based gesture segmentation method with a HMM-based gesture classifier. The HMM classifier is used here to detect dynamic signs of non-periodic nature. Combined with the periodic-based gesture segmentation method, this hybrid scheme can be used to identify segments of a transitional movement. In addition, due to the use of quasi-periodic nature of many dynamic sign gestures, dimensionality of the HMM part of the proposed method is significantly reduced, resulting in computational saving as compared with a standard HMM-based method. Through experiment with real measurement, the proposed method's recognition performance is reported.

• Advances in robotics research
• /
• v.2 no.3
• /
• pp.183-199
• /
• 2018

This paper presents the development of a 3D printed humanoid robotic hands of SignBot, which can perform Malaysian Sign Language (MSL). The study is considered as the first attempt to ease the means of communication between the general community and the hearing-impaired individuals in Malaysia. The signed motions performed by the developed robot in this work can be done by two hands. The designed system, unlike previously conducted work, includes a speech recognition system that can feasibly integrate with the controlling platform of the robot. Furthermore, the design of the system takes into account the grammar of the MSL which differs from that of Malay spoken language. This reduces the redundancy and makes the design more efficient and effective. The robot hands are built with detailed finger joints. Micro servo motors, controlled by Arduino Mega, are also loaded to actuate the relevant joints of selected alphabetical and numerical signs as well as phrases for emergency contexts from MSL. A database for the selected signs is developed wherein the sequential movements of the servo motor arrays are stored. The results showed that the system performed well as the selected signs can be understood by hearing-impaired individuals.

• International Journal of Contents
• /
• v.7 no.1
• /
• pp.14-22
• /
• 2011

Temporal Sign Language Recognition (TSLR) from hand motion is an active area of gesture recognition research in facilitating efficient communication with deaf people. TSLR systems consist of two stages: a motion sensing step which extracts useful features from signers' motion and a classification process which classifies these features as a performed sign. This work focuses on two of the research problems, namely unknown time varying signal of sign languages in feature extraction stage and computing complexity and time consumption in classification stage due to a very large sign sequences database. In this paper, we propose a combination of Dynamic Time Warping (DTW) and application of the Single hidden Layer Feedforward Neural networks (SLFNs) trained by Extreme Learning Machine (ELM) to cope the limitations. DTW has several advantages over other approaches in that it can align the length of the time series data to a same prior size, while ELM is a useful technique for classifying these warped features. Our experiment demonstrates the efficiency of the proposed method with the recognition accuracy up to 98.67%. The proposed approach can be generalized to more detailed measurements so as to recognize hand gestures, body motion and facial expression.

• Journal of Digital Contents Society
• /
• v.6 no.4
• /
• pp.217-222
• /
• 2005

The purpose of this study is to design and implement a sign language dictionary for the deaf to understand information communication terminologies. When the deafs who have difficulties in communication use the internet, they an get help from this dictionary in accessing various types of information and expressing their intension. In order for the deaf to utilize the internet as efficiently as ordinary people, they must understand information communication terminologies first In order to implement the dictionary, we defined the concepts of the deaf and examined their characteristics. In addition, we established principles in designing this dictionary and selected some terminologies. When explaining the terminologies. we tried to use expressions common to the deaf, but sometimes modified them to keep the original meanings of the terms in producing sign language videos. This studies are applied as learning aid to information education for the deaf, and the deaf's understanding of ICT was measured through two tests.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.37 no.5
• /
• pp.21-30
• /
• 2000

As a means of getting over the linguistic barrier between different languages, a sign-language communication system using CG animation techniques has been studied. In order to generate a kind of sign-language animation in the system, the joint angles of the arms and the hands corresponding to the gesture have to be determined Up to date, however, the values of joint angles have been decided by trial-and-error methods based on the animator's experiences To overcome the drawback, m this paper, we design an integrated keyframe editor of the arms and the hands for 3D sign-language animation with which we can easily and quickly generate the keyframes of the sign-language animation required to build up In the Implemented keyframe editor, the values of joint angles are calculated by using mverse kinematics, and the same transformation matrix is applied to the joints of two arms and twenty fingers Experimental results show a possibility that the editor could be used efficiently for making up the sign-language communication dictionaries needed for inter-communication between different languages.

• Journal of Korea Multimedia Society
• /
• v.4 no.3
• /
• pp.238-246
• /
• 2001

We have developed the sign-language synthesis system, which can be applied for intelligent terminal equipments, for the purpose of communications between normal people and the hearing-impaired. In the system, we generate the behavior of the sign-language words using CG animation based on Motion-Primitives of the motion observed of each legion of the body in the generation of words, the conventional system was difficult to control the shape of hands and the motions of hands and shoulder, requiring lots of time for the processing. Also it is a big problem to make a large database of sign-language, because it requires over 5,000 words to translate the sign-language. Therefore, in this paper, we propose the new system that is easy to construct the database by using Motion-Primitives, which can make paths of various motions more smooth than conventional systems. We have tested 100 words of the sign-language against the hearing-impaired with the proposed system. As the result of testing by the proposed system, we have earned a good recognition rate with 82%. On the other hand, we had earned the recognition ratio with 76% by using the former system.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.21 no.2
• /
• pp.461-467
• /
• 2017

As the number of smart devices increases, e-book contents and services are proliferating. However, the text based e-book is difficult for a hearing-impairment person to understand. In this paper, we developed an android based application in which we can choose an e-book text file and each sentence is translated to sign-language elements which are shown in videos that are retrieved from the sign-language contents server. We used the korean sentence to sign-language translation algorithm based on the morpheme analysis. The proposed translation algorithm consists of 3 stages. Firstly, some elements in a sentence are removed for typical sign-language usages. Secondly, the tense of the sentence and the expression alteration are applied. Finally, the honorific forms are considered and word positions in the sentence are revised. We also proposed a new method to evaluate the performance of the translation algorithm and demonstrated the superiority of the algorithm through the translation results of 100 reference sentences.