Browse > Article
http://dx.doi.org/10.6109/jkiice.2018.22.12.1604

Speech Recognition based Message Transmission System for the Hearing Impaired Persons  

Kim, Sung-jin (Department of Electrical, Electronics & Communication Engineering, Korea University of Technology and Education(KOREATECH))
Cho, Kyoung-woo (Department of Electrical, Electronics & Communication Engineering, Korea University of Technology and Education(KOREATECH))
Oh, Chang-heon (Department of Electrical, Electronics & Communication Engineering, Korea University of Technology and Education(KOREATECH))
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.22, no.12, 2018 , pp. 1604-1610 More about this Journal
Abstract
The speech recognition service is used as an ancillary means of communication by converting and visualizing the speaker's voice into text to the hearing impaired persons. However, in open environments such as classrooms and conference rooms it is difficult to provide speech recognition service to many hearing impaired persons. For this, a method is needed to efficiently provide it according to the surrounding environment. In this paper, we propose a system that recognizes the speaker's voice and transmits the converted text to many hearing impaired persons as messages. The proposed system uses the MQTT protocol to deliver messages to many users at the same time. The end-to-end delay was measured to confirm the service delay of the proposed system according to the QoS level setting of the MQTT protocol. As a result of the measurement, the delay between the most reliable Qos level 2 and 0 is 111ms, confirming that it does not have a great influence on conversation recognition.
Keywords
speech recognition; message transmission system; speech-to-text; MQTT(Message Queue Telemetry Transport); hearing-impaired persons;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Y. T. Lee, W. H. Hsiao, C. M. Huang, and S. C. T. Chou, "An integrated cloud-based smart home management system with community hierarchy," IEEE Transactions on Consumer Electronics, vol. 62, no. 1, pp. 1-9, Feb. 2016.   DOI
2 S. H. Kim, D. H. Kim, H. S. Oh, H. S. Jeon, and H. J. Park, "The data collection solution based on MQTT for stable IoT platforms," Journal of Korea Institute of Information and Communication Engineering, vol. 20, no. 4, pp. 728-738, Apr. 2016.   DOI
3 Google Cloud, Cloud Speech-to-Text[Internet], Available: https://cloud.google.com/speech-to-text/.
4 Mosquitto, Mosquitto[Internet], Available: http://mosquitto-.org/.
5 eclipse paho, paho[Internet], Available: http://eclipse.org-/paho/.
6 T. Aujeszky, and M. Eid, "A gesture recogintion architecture for arabic sign language communication system," Multimedia Tools and Applications, vol. 75, no. 14, pp. 8493-8511, Jul. 2016.   DOI
7 E. W. Healy, and S. E. Yoho, "Difficulty understanding speech in noise by the hearing impaired: underlying causes and technological solutions," in Proceedings of the 38th Annual International Conference of The IEEE in Medicine and Biology Society, pp. 89-92, Orlando: Florida, 2016.
8 R. Akmeliawati, D. Bailey, S. Bilal, S. Demidenko, N. Gamage, S. Khan, Y. C. Kuang, M. Ooi, and G. S. Gupta, "Assistive technology for relieving communication lumber between hearing/speech impaired and hearing people," The Journal of Engineering, vol. 2014, no. 6, pp. 312-323, Jun. 2014.   DOI
9 S. E. Han, S. A. Kim, and G. H. Hwang, "E-book to sign-language translation program based on morpheme analysis," Journal of Korea Institute of Information and Communication Engineering, vol. 21, no. 2, pp. 461-467, 2017.   DOI
10 D. Watanabe, Y. Takeuchim, T. Matsumoto, H. Kudo, and N. Ohnishi, "Communication support system of smart glasses for the hearing impaired," in Proceedings of the 16th International Conference on Computers Helping People with Special Needs, Linz: Austria, pp. 225-232, Jul. 2018.
11 A. Chern, Y. H. Lai, Y. P. Chang, Y. Tsao, R. Y. Chang, and H. W. Chang, "A smartphone-based multi-functional hearing assistive system to facilitate speech recognition in the classroom," IEEE Access, vol. 5, pp. 10339-10351, Jun. 2017.   DOI
12 P. Patil, and J. Prajapat, "Implementation of a real time communication system for deaf people using internet of things," in Proceedings of the International Conference on Trends in Electronics and Informatics, Tirunelveli: India, pp. 313-316, May 2017.
13 J. Ming, and D. Crookes, "Speech enhancement based on full-sentence correlation and clean speech recognition," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 3, pp. 531-543, Mar. 2017.   DOI
14 C. K. A. Reddy, N. Shankar, G. S. Bhat, R. Charan, and I. Panahi, "An individualized super-gaussian single microphone speech enhancement for hearing aid users with smartphone as an assistive device," IEEE Signal Processing Letters, vol. 24, no. 11, pp. 1601-1605, Nov. 2017.   DOI
15 OASIS Standard, MQTT version 3.1.1[Internet], Available: http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/mqtt-v3.1.1.html.