• Journal of Korea Multimedia Society
• /
• v.4 no.3
• /
• pp.238-246
• /
• 2001

We have developed the sign-language synthesis system, which can be applied for intelligent terminal equipments, for the purpose of communications between normal people and the hearing-impaired. In the system, we generate the behavior of the sign-language words using CG animation based on Motion-Primitives of the motion observed of each legion of the body in the generation of words, the conventional system was difficult to control the shape of hands and the motions of hands and shoulder, requiring lots of time for the processing. Also it is a big problem to make a large database of sign-language, because it requires over 5,000 words to translate the sign-language. Therefore, in this paper, we propose the new system that is easy to construct the database by using Motion-Primitives, which can make paths of various motions more smooth than conventional systems. We have tested 100 words of the sign-language against the hearing-impaired with the proposed system. As the result of testing by the proposed system, we have earned a good recognition rate with 82%. On the other hand, we had earned the recognition ratio with 76% by using the former system.

• The Journal of the Korea Contents Association
• /
• v.13 no.9
• /
• pp.305-311
• /
• 2013

This study analyzed the oral status after recording the images by using QLF-D with targets of 38 youth people with hearing impairment and hearing language impairment. In order to investigate the state of oral hygiene, plaque index (O'Leary index) and contents of investigation of the state of the teeth included the number of sound teeth, the number of caries teeth, dental caries experience and the number of filling teeth. The following results were obtained. First, women lacked the management on plaque and had more caries teeth compared with men. In terms of impairment classification, subjects with both hearing and language impairment lacked the management on plaque and had more caries teeth. Second, subjects who did not get an oral exam for one year had more caries teeth. Oral hygiene score was the highest with the brushing time for 3-4 minutes. The number of sound teeth was increased as the brushing time was increased. In addition, the oral hygiene management time was the highest when cleaning the teeth, gums and tongue at the same time. Third, it was shown that the satisfaction of oral health education by using the new equipment was high. As a result of this study, in order to improve the oral health level of impaired students, they shall be trained to manage their teeth by themselves and educated to increase their motivation and practice. Thus, it is thought that various approaches which are differentiated from existing methods are required to be tried.

• Journal of Korea Multimedia Society
• /
• v.8 no.6
• /
• pp.768-775
• /
• 2005

For sign languages are main communication means among hearing-impaired people, there are communication difficulties between speaking-oriented people and sign-language-oriented people. Automated sign-language recognition may resolve these communication problems. In sign languages, finger spelling is used to spell names and words that are not listed in the dictionary. There have been research activities for gesture and posture recognition using glove-based devices. However, these devices are often expensive, cumbersome, and inadequate for recognizing elaborate finger spelling. Use of colored patches or gloves also cause uneasiness. In this paper, a vision-based finger spelling recognition system is introduced. In our method, captured hand region images were separated from the background using a skin detection algorithm assuming that there are no skin-colored objects in the background. Then, hand postures were recognized using a two-dimensional grid analysis method. Our recognition system is not sensitive to the size or the rotation of the input posture images. By optimizing the weights of the posture features using a genetic algorithm, our system achieved high accuracy that matches other systems using devices or colored gloves. We applied our posture recognition system for detecting Korean Sign Language, achieving better than $93\%$ accuracy.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.46-51
• /
• 2006

청각 장애인은 집에서 발생하는 여러 가지 소리나 가전 제품의 신호를 감지하지 못하므로 생활의 불편을 상당히 느끼고 있다. 이러한 사람들을 위해 소리 정보를 시각 정보로 변경하여, 사용자들의 시야에 보여주는 것을 목적으로 연구를 시작하였다. 본 연구에서는 집이라는 환경에서 사용자의 위치와 오리엔테이션 정보를 습득하여, 사용자에게 필요한 정보를 시야에 들어오는 범위에 방해되거나 불편하지 않게 표시하는 시스템을 제안한다. 프로젝터에 부착된 카메라를 이용하여 사용자를 인식하고, 사용자를 따라다니며 화면을 디스플레이 하는 기존 방법의 단점들을 해결하기 위해 위치 센서로 사람의 위치와 방향을 파악하여 사용자에게 필요한 정보를 사용자가 현재 바라보는 곳에 디스플레이 하는 방법을 제안한다. 3D 모델로 제작된 집의 구조를 이용하여, 프로젝터의 방향과 초점 제어를 사전에 계산하여 보다 정확한 위치에 정보가 디스플레이 되도록 하였다. 본 논문에서 제안하는 방법이 기존의 PDA 나 PC 모니터를 이용해 정보를 제공하는 방법보다 사용자들이 정보를 인지하는 데 걸리는 시간이 좀더 빠르고 이 방법을 선호하기 때문에, 청각 장애인에게 정보를 제공하는 시스템으로 적합하다는 결론을 도출하였다.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.34C no.2
• /
• pp.61-70
• /
• 1997

Human-hand gestures have been used a means of communication among people for a long time, being interpreted as streams of tokens for a language. The signed language is a method of communication for hearing impaired person. Articulated gestures and postures of hands and fingers are commonly used for the signed language. This paper presents a system which recognizes the korean sign language (KSL) and translates the recognition results into a normal korean text and sound. A pair of data-gloves are used a sthe sensing device for detecting motions of hands and fingers. In this paper, we propose a dynamic gesture recognition mehtod by employing a fuzzy feature analysis method for efficient classification of hand motions, and applying a fuzzy min-max neural network to on-line pattern recognition.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.120-123
• /
• 2021

디지털화와 기술의 급격한 발전으로 방송 서비스도 고품질 서비스를 보다 편리하게 이용할 수 있도록 진화하고 있다. 이러한 변화하는 방송 환경에서 비장애인 대비 소외계층의 정보 접근성을 높이기 위한 연구에 대한 필요성이 증가하고 있다. 이러한 연구의 일환으로 UHD 자막 방송 서비스를 개선하기 위한 연구인 '감성표현 자막 서비스 기술' 연구를 진행하였다. 감성표현 자막 서비스 기술은 단순한 텍스트의 전달이 아닌 이미지와 폰트 스타일을 포함한 다양한 시각적 표현을 통해 청각장애인의 방송 내용에 대한 이해도를 향상시키기 위한 기술이다. 본 논문에서는 이러한 감성표현 자막 서비스를 소개하고 해당 서비스를 가능하게 하는 관련 기술과 시스템 구현 결과에 대하여 다룬다. 지상파 UHD 방송을 대상으로 개선된 형태의 자막 서비스를 제공하기 위한 핵심 시스템인 감성자막 편집기를 개발하였다. 감성자막 편집기는 화자의 감정 정보 등을 입력, 편집하고 편집된 감성자막을 영상과 싱크를 맞추어 재생하는 기술과 감성자막을 UHD 송출시스템으로 전송하는 시스템이다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.469-471
• /
• 2020

방송의 디지털화에 따른 비장애인 대비 소외 계층의 정보 접근성의 부족은 소외 계층에 대한 정보 격차를 심화시킬 수 있다. 이에 캐릭터 수화 방송, 자막 방송 등 장애인을 위한 방송 서비스의 양적, 질적 개선에 관한 연구가 진행되고 있다. 자막 방송 서비스의 경우, 관련 법령에 따라 서비스를 실시하고 있으며 지상파 UHD 방송의 경우에도 본 방송을 시작한 이래 폐쇄 자막 서비스 시스템을 구축하여 서비스를 제공하고 있다. 이러한 기존 자막 서비스는 텍스트 형태의 단조로운 내용 전달 방식이어서 다양한 스타일로 풍부하게 내용을 전달하는 것에 대한 요구가 있다. 이에 본 논문에서는 지상파 UHD 방송을 대상으로 개선된 형태의 자막 서비스인 감성자막 서비스를 소개하고 이를 위한 감성 자막 편집기 기술 개발에 대하여 다룬다. 감성자막 서비스는 화자의 감정 정보를 자막 메타데이터에 추가적으로 제공하여, 감정에 따라 다양한 이모티콘이나 다른 종류의 폰트 스타일로 자막 서비스가 가능하게 하는 서비스이다. 감성자막 편집기는 이러한 감성 자막 메타데이터를 추가, 편집하고 감성자막 파일로 생성하기 위한 시스템으로, 지상파 UHD 송출 시스템 및 폐쇄 자막 표준을 고려하여 개발하였다.

• The Journal of the Acoustical Society of Korea
• /
• v.38 no.4
• /
• pp.427-432
• /
• 2019

In this paper, we propose a home monitoring system using sound event detection based on a bidirectional gated recurrent neural network for the hard-of-hearing. First, in the proposed system, packet loss concealment is used to recover a lost signal captured through wireless sensor networks, and reliable channels are selected using multi-channel cross correlation coefficient for effective sound event detection. The detected sound event is converted into the text and haptic signal through a harmonic/percussive sound source separation method to be provided to hearing impaired people. Experimental results show that the performance of the proposed sound event detection method is superior to the conventional methods and the sound can be expressed into detailed haptic signal using the source separation.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.16 no.6
• /
• pp.1355-1362
• /
• 2021

Recently, not only congenital hearing impairment, but also the number of people with hearing impairment due to acquired factors is increasing. The environment in which sign language can be learned is poor. Therefore, this study intends to present a sign language (sign language number/sign language text) evaluation system as a sign language learning assistance tool for sign language learners. Therefore, in this paper, sign language is captured as an image using OpenCV and Convolutional Neural Network (CNN). In addition, we study a system that recognizes sign language behavior using MediaPipe, converts the meaning of sign language into text-type data, and provides it to users. Through this, self-directed learning is possible so that learners who learn sign language can judge whether they are correct dez. Therefore, we develop a sign language learning assistance system that helps us learn sign language. The purpose is to propose a sign language learning assistance system as a way to support sign language learning, the main language of communication for the hearing impaired.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.31 no.3
• /
• pp.191-211
• /
• 2020

The main purpose of this research is to identify limitations and problems in access to information using reading aids devices for the visually impaired and to suggest ways to activate the use of alternative materials using reading aids devices. A survey was conducted on adults with visual impairment in order to identify the factors of limitation in using reading aids devices. The analysis resulted in six aspects of limiting factors in activating the use of reading aids devices. The approaches for activating the use of reading aids devices were proposed by dividing them into policy and operational aspects, focusing on the limiting factors derived. Policy aspects suggested developing low-cost reading aids devices, increasing awareness of the devices, and complying with Web standard guidelines for improving the applicability of the devices, while operational aspects suggested reinforcing hearing-use functions, expanding information services related to reading aids devices, and enhancing portability of the devices.