• Title/Summary/Keyword: Hearing-impaired

Search Result 281, Processing Time 0.024 seconds

Sound Event Classification Based on Concatenated Residual Network Applicable to Closed Captioning Services for the Hearing Impaired (청각장애인용 자막방송 서비스를 위한 연쇄잔차 신경망 기반 음향 사건 분류 기법)

  • Kim, Nam Kyun;Park, Dong Keun;Kim, Jun Ho;Kim, Hong Kook;Ahn, Chung Hyun
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.472-475
    • /
    • 2020
  • 본 논문에서는 청각장애인에게 자막방송을 제공하기 위하여 오디오 콘텐츠에 등장하는 음향 사건을 분류하는 기법을 제안한다. 제안된 기법은 복수의 잔차 신경망(ResNet)을 연결하는 연쇄잔차(concatenated residual) 신경망 구조를 갖는다. 신경망의 입력 특징을 위해 음성의 멜-주파수 켑스트럼 벡터를 다수의 프레임으로 결합하여 형성한 2 차원 이미지와 전체 프레임에 대한 멜-주파수 켑스트럼 벡터들로부터 얻은 1 차원의 통계 특징벡터를 얻는다. 각각의 입력은 2 차원 잔차 신경망과 1 차원 잔차 신경망으로 모델링되고, 두 개의 잔차 신경망을 연쇄연결(concatenation)하는 구조를 가진 연쇄잔차 신경망으로 구성된다. 성능평가를 위해 수집된 데이터셋으로부터 6-fold 교차검증을 통해 평가한 결과, 85.48%의 분류 정확도를 얻을 수 있었다.

  • PDF

Development of IoT-based Lighting System for the Hearing impaired (청각장애인을 위한 IoT 기반 조명 시스템 개발)

  • Son, Hyun-ji;Lee, So-jung;Han, Min-seo;Han, Hye-jin;Kim, Sung-wook
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.11a
    • /
    • pp.968-970
    • /
    • 2022
  • 일반적으로 가정 내에서 발생하는 안전 사고의 비율은 비장애인에 비해 청각장애인이 높다. 이는 외부인에게 도움을 받을 수 없는 상황에서 청각장애인 스스로 위험상황에 대한 소리를 인지하지 못하기 때문이다[1]. 본 연구에서는 이러한 문제를 해결하기 위해 시각적 효과 또는 진동 신호를 통해 청각장애인들에게 사고 상황 인지를 돕는 시스템을 제안한다. 현재 상용 제품의 경우는 청각장애인이 스마트기기를 소지하고 있을 때만 알림을 인지할 수 있기 때문에 긴급 상황에서 효과가 떨어질 수 있다. 따라서 제안 시스템에서는 어플리케이션 알림과 함께 건물내 전등 색상에 변화를 주는 서비스를 개발하여 스마트 기기를 소지하지 않는 상황에서도 위험상황에 대한 즉각적인 인지를 통해 위험에 대처할 수 있도록 한다. 소리를 시각화하는 것이 본 연구의 핵심 방법론이며 이를 위해 Convolutional Neural Network 모델과 라즈베리파이를 활용하였다.

Molecular Mechanisms of Inner Ear Development and Disease

  • Hayoung Yang;Jiho Ryu;Sungbo Shim
    • Biomedical Science Letters
    • /
    • v.29 no.3
    • /
    • pp.95-102
    • /
    • 2023
  • The inner ear constitutes a complex organ responsible for auditory perception and equilibrium. It comprises diverse cellular entities operating collaboratively to perceive and transmit sensory information to the brain. Inner ear disease is a sophisticated and multifactorial scenario substantially impacting the quality of life of affected individuals. Gaining insights into the developmental process of the inner ear is crucial for diagnosing and treating inner ear diseases, which can lead to hearing loss and impaired balance. Recent research in inner ear development and associated pathophysiology has focused on several pivotal domains, including identifying new genes and signaling pathways involved in inner ear development, using stem cells for inner ear regeneration, and developing novel therapies for inner ear diseases. Recent advances in genetics research have shed new light on the fundamental etiologies of inner ear diseases, with a growing body of evidence suggesting that genetic mutations might exert a pivotal influence on the development and progression of this condition. In this review, we have delved into certain common genetic mutations linked to inner ear disorders. We also discussed ongoing research endeavors and future directions for understanding the genetic mechanisms underlying this condition and potential therapeutic avenues.

Research on Development of VR Realistic Sign Language Education Content Using Hand Tracking and Conversational AI (Hand Tracking과 대화형 AI를 활용한 VR 실감형 수어 교육 콘텐츠 개발 연구)

  • Jae-Sung Chun;Il-Young Moon
    • Journal of Advanced Navigation Technology
    • /
    • v.28 no.3
    • /
    • pp.369-374
    • /
    • 2024
  • This study aims to improve the accessibility and efficiency of sign language education for both hearing impaired and non-deaf people. To this end, we developed VR realistic sign language education content that integrates hand tracking technology and conversational AI. Through this content, users can learn sign language in real time and experience direct communication in a virtual environment. As a result of the study, it was confirmed that this integrated approach significantly improves immersion in sign language learning and contributes to lowering the barriers to sign language learning by providing learners with a deeper understanding. This presents a new paradigm for sign language education and shows how technology can change the accessibility and effectiveness of education.

A Study on the Communication System Design for Auditory Disabled (청각장애인을 위한 의사소통 시스템 디자인 연구)

  • Yang, Sung-Ho;Song, Ji-Won
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.1172-1175
    • /
    • 2009
  • This study aims to develop communication devices and interfaces to address the communication needs of the hearing impaired. Through three FGI (Focused Group Interview)s with deaf persons and sign-language interpreters, we studied the communication methods, devices, and needs of the deaf. On the basis of our analysis, we propose a communication framework to improve their means of communication with normal or other deaf persons. We have designed a communication system that is based on the proposed framework: this system suggests functions for remote sign-language interpretation services for conversations in close-range and over the phone. Details are presented regarding the design of interfaces for video calls, text messages, and digital memos, addressing the conversation patterns of the deaf. The system includes hardware form factors for video phones that facilitate sign language conversations and also mitigate other auditory problems in daily life, such as problems with door bells. The design concept has been verified through a test with six deaf users.

  • PDF

Convergence Development of Video and E-learning System for Education Disabled Students (장애학생의 학습을 위한 화상과 이러닝 시스템의 융합 개발)

  • Son, Yeob-Myeong;Jung, Byeong-Soo
    • Journal of the Korea Convergence Society
    • /
    • v.6 no.4
    • /
    • pp.113-119
    • /
    • 2015
  • Currently, we are presenting an alternative educational environment for the normal student of education rules failure of the only that has been the school system student. The study for students with disabilities, it is designed especially to be able to use difficult disabilities the use of hand. Development objectives of the learning video e-learning system of persons with disabilities, is that to be able to capable of self-directed learning of disabled students. Configuration of e-running system, Web-based multimedia system, utilizing the system that will change the video conferencing system and voice to a character hearing impaired students through the chat system is 1:1 by communication, and teachers it is possible to perform two-way communication. A learning disability e-learning system developed in this paper between teachers and students with disabilities 1:1 training is conducted using a two-way communication algorithms.

A Study on Multimedia Application Service using DTV Closed Caption Data (디지털방송 자막데이터를 이용한 멀티미디어 응용 서비스 연구)

  • Kim, Jung-Youn;Nam, Je-Ho
    • Journal of Broadcast Engineering
    • /
    • v.14 no.4
    • /
    • pp.488-500
    • /
    • 2009
  • In this paper, we study on making a use of value-added services using DTV closed caption data. Note that Closed-Captioning service helps to bridge "digital divide" through extending broadcasting accessibility of a neglected class such as hearing-impaired person and foreigner. In Korea, DTV Closed Captioning standard was developed in June 2007, and Closed Captioning service should be provided by an enforcing law in all broadcasting services in April 2008. Here, we describe the method of extracting a caption data from MPEG-2 Transport Stream of ATSC-based digital TV signal and generating a caption file using the extracted caption data and time information. In addition, we present the segmentation method of broadcasting content using caption file. Experimental results show that implemented S/W tool provides the feasibility of the proposed methods and the usability of closed caption for a variety of data application service.

Development of Implant Devices for the Hearing Impaired and Their Clinical Applications (청각장애인을 위한 인공이식기 개발 및 임상응용 (I))

  • Park, S.H.;Shin, J.I.;Park, H.G.;Kim, H.N.;Lee, H.K.;Kim, C.S.;Chang, S.O.;Lim, D.H.;Oh, S.H.;Jung, W.H.;Byun, S.W.;Lee, K.H.;Choi, K.A.
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1997 no.05
    • /
    • pp.203-206
    • /
    • 1997
  • 본 연구는 G7 의료공학기술개발사업의 1차년도 연구결과이다. 본 연구의 최종목표는 청각계통중 내이의 손상에 의한 감각성 난청환자에게 소리를 인식할 수 있게 하는 한국형 인공와우의 개발, 전 음성 난청환자의 음성인식 효율을 높일 수 있는 한국형 인공이소골의 개발 그리고 인공와우 시술환자에게 적합한 재활용 프로그램을 개발하는데 있다. 이를 위하여 지난 1차년도에는 코클리어의 전기생리학적 현상을 규명하고, 이식전극시스템과 그 주변장치를 설계, 평가하였다. 그리고 한국인의 성인사체의 16귀를 측정하여 한국인 체형에 적합한 인공이소골의 설계기준을 확립하였다. 또한, 인공와우 시술 후 청력회복에 필요한 한국형 재활프로그램의 개발을 위하여 인공와우의 coding strategy에 따른 언어분별력 조사, 유소아의 어음특성분석등을 행하였다. 이 연구결과를 토대로 차기년도에는 상용화에 근접한 프로토타잎의 제품개발과 임상실험이 진행되리라 생각된다.

  • PDF

A Comparative Study of Disabled People's Welfare and Accessibility Facilities in Korea and Japan

  • Park Rae-Joon
    • The Journal of Korean Physical Therapy
    • /
    • v.11 no.1
    • /
    • pp.1-21
    • /
    • 1999
  • Japanese welfare legislation for the disabled was enacted via Law 283 on December 26. 1956. The push for such legislation at the national level had gown concurrent with development of Japan's post-war economy Korean welfare law for disabled was made 22 years later and was again amended in 1989. The current legislation promotes and supports the legal welfare of the Koran disabled. The following are the results of a comparison between Korean and Japanese accessibility facilities and welfare law; 1) Japan's developement of disabled people's welfare law is inextricably linked to the development of disabled people's advocacy and the human rights movement. In addition, welfare policy has shifts its mandate from rehabilitation to independent living. It follows that local altitudes will play a pivotal role in further policy initiatives. Korean disabled people's welfare policy emerged hand in hand with economic recovery and development following the Korean War. By 1977 a special education law was enacted which-like it Japanese counterpart-promoted the education of disabled children. 2) Accessibility facilities were developed privately movement. The disabled faced constant and systematic disadvantages in public/private buildings and transportation systems. A general lack of cultural awareness and information relating ti these problems prevailed. These included-hut were by no means limited to sign language (for hearing the impaired) and braille(the language of blind). However, new attitudes and improvements have since emerged and new laws have resulted in the publication of Korean 'White Book' outlining the everyday problems faced by the disabled. In addition, mort convenient access facilities have been constructed in public and private buildings. In closing, legal support for the disabled, senior citizens and pregnant women continues to be improved by newer legislation enacted tin April 6, 1977.

  • PDF

Analysis of Signal Transfer Characteristics of Implantable Middle Ear System using Acoustic Model (청각모델을 이용한 이식형 인공중이 시스템의 신호 전달 특성 해석)

  • 송병섭;조진호
    • Journal of Biomedical Engineering Research
    • /
    • v.23 no.3
    • /
    • pp.227-233
    • /
    • 2002
  • The IME(implantable middle ear) system is Promising due to its ability to free from sound feedback and Produce a good sound quality and intelligibility with low distortion even if it is operated with high gain for severe hearing impaired. The differential electromagnetic vibration transducer. which was developed for using in IME system and has two small magnets attached the same Pole facing in the coil. is not influenced by environmental external magnetic field. Besides, it has high vibration efficiency and good frequency response characteristics. In this Paper, using acoustic model of the transducer and ear model of normal Person. the signal transfer characteristics of the IME system are analyzed and investigated From the differences of the characteristics between normal ear and the IME system, it is Possible that design of the IME system that have the signal transfer characteristics similar to normal person's ear.