Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Application of Artificial Neural Network For Sign Language Translation

  • Cho, Jeong-Ran (Dept. of Health Administration, Kwangju Womens University) ;
  • Kim, Hyung-Hoon (Dept. of Cosmetic Science, Kwangju Womens University)
  • Received : 2019.01.11
  • Accepted : 2019.02.12
  • Published : 2019.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In the case of a hearing impaired person using sign language, there are many difficulties in communicating with a normal person who does not understand sign language. The sign language translation system is a system that enables communication between the hearing impaired person using sign language and the normal person who does not understand sign language in this situation. Previous studies on sign language translation systems for communication between normal people and hearing impaired people using sign language are classified into two types using video image system and shape input device. However, the existing sign language translation system does not solve such difficulties due to some problems. Existing sign language translation systems have some problems that they do not recognize various sign language expressions of sign language users and require special devices. Therefore, in this paper, a sign language translation system using an artificial neural network is devised to overcome the problems of the existing system.

Keywords

CPTSCQ_2019_v24n2_185_f0001.png 이미지

Fig. 1. Overview of the TeST System

CPTSCQ_2019_v24n2_185_f0002.png 이미지

Fig. 2. System design with deep running technique

CPTSCQ_2019_v24n2_185_f0003.png 이미지

Fig. 3. Conceptual structure of biological neurons

CPTSCQ_2019_v24n2_185_f0004.png 이미지

Fig. 4. Structure of artificial neural network

CPTSCQ_2019_v24n2_185_f0005.png 이미지

Fig. 5. Concept of sign language-korean translation system using artificial neural network

CPTSCQ_2019_v24n2_185_f0006.png 이미지

Fig. 6. Artificial neural network concept of sign language video recognition system

CPTSCQ_2019_v24n2_185_f0007.png 이미지

Fig. 7. Concept of korean-sign language translation system using artificial neural network

CPTSCQ_2019_v24n2_185_f0008.png 이미지

Fig. 8. Artificial neural network concept of sign language translation system

Table 1. Characteristics of Korean Sign Language and Standard Sign Language for Korean

CPTSCQ_2019_v24n2_185_t0001.png 이미지

References

  1. Vijaykumar Sutariya, Anastasia Groshev, Prabodh Sadana, Deepak Bhatia, Yashwant Pathak, "Artificial Neural Network in Drug Delivery and Pharmaceutical Research", The Open Bioinformatics Journal, Jul. 2013.
  2. Kyung-Hyuk Kwon, Yo-Seop Woo, Hong-Ki Min, "Design and Implementation of a Korean Text to Sign Language Translation System", The KIPS Transactions, Vol 7, No 3, pp. 756-765, March 2000.
  3. Korea deaf children's neighbors love society, "Open sign language", Book published blue ears, pp. 231-232, Jan. 1998.
  4. Su-Hyun Park, Seok-Hoon Kang, Hyuk-Chul Kwon, "Morpheme Conversion for Korean Text-to-sign Language Translation System", The KIPS Transactions, Vol.5, No.3, pp. 688-702, March 1996.
  5. Mi-Sook Eum, "Analysis of Syntactic Characteristics of Korean Sign Language", Daegu university Graduate School M.S., 1996.
  6. Ryu M. W., "Design and Implementation of Bi-directional Sign Language System for Emergency Medical Situation", Pusan National University M.S, Feb. 2015.
  7. Seung-Seok Lee, Jeong-Hyun Heo, Seung-Woo No, Hyeon-Jin Yoon, So-Hyun Park, Chan-Kyu Kim, "Sign Language Translation System based on Deep Learning for speech disorders", Proceedings of Symposium of the Korean Institute of communications and Information Sciences, pp. 951-952, Jun. 2018.
  8. Haesun Paeng, Jihun Lee, Jaeyun Cho, "Research for Sign Language Translation Application Development Base on Smartphone Environment", Proceedings of Symposium of The HCI Society of Korea, pp. 62-65. Jan. 2012.
  9. Hyo-Seob, Se-Jin Chang, Byung-Ju Shin, Yun-Mo Yang, "Sign-Language Recognition using the Information of Hand Shape and Moving Direction", Journal of KISS(B): Software and Applications, Vol.26, No.6, pp. 804-810, Jun. 1999.
  10. Hoon Jang, Young-Jun Oh, "Sign language interpretation system design and implementation", Proceedings of The KISS Conference, Vol.29, No.22, pp. 691-693, 2002.
  11. F. Liu, M. J. Er, "A novel efficient learning algorithm for self-generating fuzzy neural network with applications", International Journal of Neural Systems, Vol. 22, pp21-35, Feb. 2012. https://doi.org/10.1142/S0129065712003067
  12. D. K. Kim, "C++ API OpenCV Programming", The Publish Company of KAME, May 2015.
  13. Lee Hyun-Suk, Kim Seung-Pil, Chung Wan-Young, "Development of Sign Language Translation System using Motion Recognition of Kinect", Journal of the institute of signal processing and systems, Vol. 14, No. 4, pp.235-242, Oct. 2013.