[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.9708/jksci.2021.26.12.105

A Design and Implementation of Speech Recognition and Synthetic Application for Hearing-Impairment

Kim, Woo-Lin (Dept. of Computer Science & Engineering, Inha Technical College)
Ham, Hye-Won (Dept. of Computer Science & Engineering, Inha Technical College)
Yun, Sang-Un (Dept. of Applied Artificial Intelligence, Hanyang University)
Lee, Won Joo (Dept. of Computer Science & Engineering, Inha Technical College)

Publication Information

Journal of the Korea Society of Computer and Information / v.26, no.12, 2021 , pp. 105-110 More about this Journal

Abstract

In this paper, we design and implement an Android mobile application that helps hearing impaired people communicate based on STT(Speech-to-Text) and TTS(Text-to-Speech) APIs and accelerometer sensor of a smartphone. This application provides the ability to record what the hearing-Impairment person's interlocutor is saying with a microphone, convert it to text using the STT API, and display it to the hearing-Impairment person. In addition. In addition, when a hearing-impaired person inputs a text using the TTS API, it is converted into voice and told to the interlocutor. When a hearing-impaired person shakes their smartphone, an accelerometer based background service function is provided to run the application. The application implemented in this paper provides a function that allows hearing impaired people to communicate easily with other people when communicating with others without using sign language as a video call.

Keywords

Google Cloud Platform; STT(Speech-to-Text); TTS(Text-to-Speech); Accelerometer sensor;

Citations & Related Records

Reference

1	Jae-il Kwon, "Study of Usage in Language of a hearing- impaired people" The National Institute of the Korean Language, Vol. 4, No. 3, pp. 40-57, Mar. 2009.
2	http://www.mohw.go.kr/react/jb/sjb030301vw.jsp
3	https://developer.android.com/jetpack/androidx/releases/recyclerview
4	https://rogervoice.com/en/
5	https://github.com/GoogleCloudPlatform/android-docs-samples/tree/master/speech/Speech/app/src/main/java/com/google/cloud/android/speech
6	Android developers, "Background Execution Limits" https://developer.android.com/about/versions/oreo/background
7	https://developer.android.com/reference/java/nio/Buffer
8	https://www.talovstudio.com/speakliz
9	https://developer.android.com/studio?gclid=CjwKCAiAnvj9BRA4EiwAuUMDf2lTS3NGbD6v5EgidTOKz_2tt2wgJiSJRLaqu7TY4tjnEFyIJfYNjhoCUJkQAvD_BwE&gclsrc=aw.ds
10	https://cloud.google.com/speech-to-text