• Title/Summary/Keyword: sign-language

Search Result 278, Processing Time 0.02 seconds

The Research of Information Support System in the Classrooms and Auditoriums for the Sign Language Interpreters (수화통역사를 위한 강의실 및 강당에서의 정보지원 시스템에 관한 연구)

  • You, Hyun-Bea
    • Journal of Digital Contents Society
    • /
    • v.11 no.4
    • /
    • pp.513-518
    • /
    • 2010
  • As the number of the deaf who go out into the society has been increasing, in most of the lectures, the demands for the sign language interpretation and the accuracy of the interpretation have become more important. Especially, in order to improve the accuracy of the sign language interpretation, the interpreter must be aware of the appearances of the lecturer and the contents of the lecture, and at the same time, the interpreter must look toward the audience. This research introduces a system which can be effective in a small classrooms or auditorium, by providing the maximum information about the lecturer and the contents of the lecture. Also, in order to verify the effectiveness of the proposed system, this research includes the discussions about the related systems and test methods. In conclusion, delivering the images of the lecturer and the contents of the lecture to the interpreter by employing the proposed system has been proved effective.

The Physical Acting as a Sign: Its Theatrical Features and Cognitive Science Principles. (기호로서의 신체적 연기: 그것의 연극적 특성과 인지과학적 원리)

  • Kim, Yongsoo
    • Journal of Korean Theatre Studies Association
    • /
    • no.52
    • /
    • pp.271-317
    • /
    • 2014
  • This essay studied the acting theories of Diderot, Delsarte, Meyerhold, and Artaud to know the historical formation of 'sign acting' and its theoretical and aesthetic appropriateness. The sign acting so far discussed shows the repetitive patterns of idea as follows. The sign acting (1) emphasizes the physical expression such as gesture and movement, (2) assumes that the physical expression functions as a sign evoking special emotion and thought, (3) thus recommends the imitation of the outer sign, (4) uses a tableau for the effective reception of outer sign, (5) aims for the spectator oriented aesthetics as it stresses the result of outer sign rather than the creative process of a role, (6) assumes that the emotional reaction or the intellectual understanding springs from the physical experience, (7) thus emphasizes the physical language rather than speech, (8) can attain the appropriateness of physical language by the recent theories of cognitive science. Besides having such commonness, the sign acting also reveals the individual differences. For instance, the intended sign for Diderot and Delsarte was the sign of emotion, for Meyerhold the stylized sign of circus and acrobatics, and for Artaud the spiritual sign. If Diderot and Meyerhold demands the cool consciousness for the correct sign acting, Artaud's sign acting tends to pursue the state of trance. And if Diderot, Delsarte, and Meyerhold think the sign acting on the level of sensory appeal, Artaud insists that the sign acting should dismantle the spectator's sense. As such the discussion of sign acting shows both recurrent ideas and new visions, forming an unity out of diversity. Perhaps the sign acting is a matter of practice before we consider it as a theory. It is not only supposed to have been existed practically since ancient theatre, but also used by actors consciously and unconsciously in expressing certain emotion and thought. We need to study the sign acting more academically, considering its long history and aesthetic potentials. In fact the sign acting has been an essential element of acting, in spite of bad reputation judging it as a banal and worn-out style. It is true that the sign acting, in the worst case, could produce a stereotypical expression. It was this aspect of sign acting that caused a fierce negative reaction of the realists who sought the natural expression based upon psychological truth. Of course the sign acting has a serious problem when it stays banal and artificial. But we need to see this issue from a different perspective. What is the natural expression of emotion? How is it free from the learned way of expression? In some respect, we use, in reality, a learned expression of emotion that could be accepted socially. For instance, when we attend a funeral, we use the outer sign of mourning gestures learned socially. If a semiotic expression pervades various aspects of our life, the acting, being the representation of life, seems not to be free from codified expression. The sign acting could be used consciously and unconsciously in all kinds of acting.

On-line dynamic hand gesture recognition system for the korean sign language (KSL) (한글 수화용 동적 손 제스처의 실시간 인식 시스템의 구현에 관한 연구)

  • Kim, Jong-Sung;Lee, Chan-Su;Jang, Won;Bien, Zeungnam
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.34C no.2
    • /
    • pp.61-70
    • /
    • 1997
  • Human-hand gestures have been used a means of communication among people for a long time, being interpreted as streams of tokens for a language. The signed language is a method of communication for hearing impaired person. Articulated gestures and postures of hands and fingers are commonly used for the signed language. This paper presents a system which recognizes the korean sign language (KSL) and translates the recognition results into a normal korean text and sound. A pair of data-gloves are used a sthe sensing device for detecting motions of hands and fingers. In this paper, we propose a dynamic gesture recognition mehtod by employing a fuzzy feature analysis method for efficient classification of hand motions, and applying a fuzzy min-max neural network to on-line pattern recognition.

  • PDF

Improvement of Korean Sign Language Recognition System by User Adaptation (사용자 적응을 통한 한국 수화 인식 시스템의 개선)

  • Jung, Seong-Hoon;Park, Kwang-Hyun;Bien, Zeung-Nam
    • Proceedings of the KIEE Conference
    • /
    • 2007.04a
    • /
    • pp.301-303
    • /
    • 2007
  • This paper presents user adaptation methods to overcome limitations of a user-independent model and a user-dependent model in a Korean sign language recognition system. To adapt model parameters for unobserved states in hidden Markov models, we introduce new methods based on motion similarity and prediction from adaptation history so that we can achieve faster adaption and higher recognition rates comparing with previous methods.

  • PDF

Design and Implementation of Finger Language Translation System using Raspberry Pi and Leap Motion (라즈베리 파이와 립 모션을 이용한 지화 번역 시스템 설계 및 구현)

  • Jeong, Pil-Seong;Cho, Yang-Hyun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.19 no.9
    • /
    • pp.2006-2013
    • /
    • 2015
  • Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

Translating a Complex Sentence in Korean into a Sign Language Script for an Automatic Sign Language Generation (수화 애니메이션 자동 생성을 위한 한국어 복문의 수화 스크립트 변환 방법)

  • Kim, Sangha;Chang, Eunyoung;Park, Jong C.
    • Annual Conference on Human and Language Technology
    • /
    • 2007.10a
    • /
    • pp.15-22
    • /
    • 2007
  • 한국 수화는 시각, 공간언어로 한국어와는 상이한 문법체계를 가진 언어로 수화를 일차 언어로 사용하는 농인들에게 있어 복잡한 구조의 한국어 문장은 부담이 된다. 본 논문은 이런 한국어 문장의 복잡한 구조를 농인들이 이해하기 쉬운 구조의 전개방식으로 변환하는 수화 스크립트 생성 시스템을 제안한다. 시스템은 세 단계로 구성되는데, 첫 번째 단계는 한국어 문장의 결합범주문법을 이용한 구문 분석이며, 두 번째 단계는 농인들이 이해하기 수월한 전개방식으로의 절단위 재배열이고, 세 번째 단계는 공간이동을 고려한 스크립트 형태로의 변환이다. 본 논문은 한국 수화의 복문 실현 방법에 대해 살펴본 후, 이를 처리하는 시스템의 단계별 처리 방안에 대해 구체적으로 논의한다.

  • PDF

Hand Language Translation Using Kinect

  • Pyo, Junghwan;Kang, Namhyuk;Bang, Jiwon;Jeong, Yongjin
    • Journal of IKEEE
    • /
    • v.18 no.2
    • /
    • pp.291-297
    • /
    • 2014
  • Since hand gesture recognition was realized thanks to improved image processing algorithms, sign language translation has been a critical issue for the hearing-impaired. In this paper, we extract human hand figures from a real time image stream and detect gestures in order to figure out which kind of hand language it means. We used depth-color calibrated image from the Kinect to extract human hands and made a decision tree in order to recognize the hand gesture. The decision tree contains information such as number of fingers, contours, and the hand's position inside a uniform sized image. We succeeded in recognizing 'Hangul', the Korean alphabet, with a recognizing rate of 98.16%. The average execution time per letter of the system was about 76.5msec, a reasonable speed considering hand language translation is based on almost still images. We expect that this research will help communication between the hearing-impaired and other people who don't know hand language.

Development of a Hand Shape Editor for Sign Language Expression (수화 표현을 위한 손 모양 편집 프로그램의 개발)

  • Oh, Young-Joon;Park, Kwang-Hyun;Bien, Zeung-Nam
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.44 no.4 s.316
    • /
    • pp.48-54
    • /
    • 2007
  • Hand shape is one of important elements in Korean Sign Language (KSL), which is a communication method for the deaf. To express sign motion in a virtual reality environment based on OpenGL, we need an editor which can insert and modify sign motion data. However, it is very difficult that people, who lack knowledge of sign 1anguage, exactly edit and express hand shape using the existing editors. We also need a program to efficiently construct and store the hand shape data because the number of data is very large in a sign word dictionary. In this paper we developed a KSL hand shape editor to easily construct and edit hand shape by a graphical user interface (GUI), and to store it in a database. Hand shape codes are used in a sign word editor to synthesize sign motion and decreases total amount of KSL data.

A Study on the Communication System Design for Auditory Disabled (청각장애인을 위한 의사소통 시스템 디자인 연구)

  • Yang, Sung-Ho;Song, Ji-Won
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.1172-1175
    • /
    • 2009
  • This study aims to develop communication devices and interfaces to address the communication needs of the hearing impaired. Through three FGI (Focused Group Interview)s with deaf persons and sign-language interpreters, we studied the communication methods, devices, and needs of the deaf. On the basis of our analysis, we propose a communication framework to improve their means of communication with normal or other deaf persons. We have designed a communication system that is based on the proposed framework: this system suggests functions for remote sign-language interpretation services for conversations in close-range and over the phone. Details are presented regarding the design of interfaces for video calls, text messages, and digital memos, addressing the conversation patterns of the deaf. The system includes hardware form factors for video phones that facilitate sign language conversations and also mitigate other auditory problems in daily life, such as problems with door bells. The design concept has been verified through a test with six deaf users.

  • PDF

Development of Korean Sign Language Generation System using TV Caption Signal (TV 자막 신호를 이용한 한글 수화 발생 시스템의 개발)

  • Kim, Dae-Jin;Kim, Jung-Bae;Jang, Won;Bien, Zeung-Nam
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.39 no.5
    • /
    • pp.32-44
    • /
    • 2002
  • In this paper, we propose TV caption-based KSL(Korean Sign Language) generation system. Through TV caption decoder, this caption signal is transmitted to PC. Next, caption signal is segmented into meaning units by morphological analyzer in considering specific characteristics of Korean sign language. Finally, 3D KSL generation system represents the transformed morphological information by 3D visual graphics. Specifically, we propose a morphological analyzer with many pre-processing techniques for real-time capability. Our developed system is applied to real TV caption program. Through usage of the deaf, we conclude that our system is sufficiently usable compared to conventional TV caption program.