Browse > Article
http://dx.doi.org/10.14372/IEMEK.2019.14.3.133

Numeric Sign Language Interpreting Algorithm Based on Hand Image Processing  

Gwon, Kyungpil (Daegu University)
Yoo, Joonhyuk (Daegu University)
Publication Information
IEMEK Journal of Embedded Systems and Applications / v.14, no.3, 2019 , pp. 133-142 More about this Journal
Abstract
The existing auxiliary communicating aids for the hearing-impaired have an inconvenience of using additional expensive sensing devices. This paper presents a hand image detection based algorithm to interpret the sign language of the hearing-impaired. The proposed sign language recognition system exploits the hand image only captured by the camera without using any additional gloves with extra sensors. Based on the hand image processing, the system can perfectly classify several numeric sign language representations. This work proposes a simple lightweight classification algorithm to identify the hand image of the hearing-impaired to communicate with others even further in an environment of complex background. Experimental results show that the proposed system can interpret the numeric sign language quite well with an accuracy of 95.6% on average.
Keywords
Numeric sign language interpreter; Hand image processing; Hearing-Impaired;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Zhang, W. Zhous, C. Xie, J. Pu, H. Li, "Chinese Sign Language Recognition with Adaptive HMM," Proceedings of IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2016.
2 P. Molchanov, S Gupta, K. Kim, J. Kautz, "Hand Gesture Recognition with 3D Convolutional Neural Networks," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-7, 2015.
3 S. Kolkur, D. Kalbandee, P. Shimpi, C. Bapat, J. Jatakia, "Human Skin Detection Using RGB, HSV, and YCbCr Color Models," Proceedings of IEEE Conference on Acoustics, Speech and Signal Processing, 2017.
4 Wikipedia document (HSL and HSV) Avaliable on : https://en.wikipedia.org/wiki/HSL_and_HSV
5 Y. Xu, G. Pok, "Identification of Hand Region Based on YCgCr Color Representation," Journal of Applied Engineering Research, Vol. 12, No. 6, pp. 1031-1034, 2017.
6 Z. Zhengzhen, S. Yuexiang, "Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Space," Proceedings of Conference on Image Analysis and Signal Processing, pp. 221-225, 2009.
7 W.Burger, M.J. Burge, "Digital Image Processing: An Algorithmic Introduction Using Java Second Edition," Springer, 2016
8 Python library, Avaliable on : https://docs.python.org/3/library/math.html
9 A. Dhawan, V. Honrao, "Implementation of Hand Detection based Techniques for Human Computer Interaction," International Journal of Computer Applications, Vol. 72, No. 17, pp. 6-13, 2013.
10 Statistics Korea 1. (The Number of Registered Disabled Person - By City, Type, Gender) 2. (Characteristics of Hearing Disabled - Method to Communicate Who Mostly Use).
11 S. Glennen, DC. Decoste, "The Handbook of Augmentative and Alternative Communication," Singular Publishing Group, INC. San Diego. London, 1997.
12 Joshua R. New, "A Method for Hand Gesture Recognition," Proceedings of IEEE Communication Systems and Network Technologies, pp. 919-923, 2002.
13 C. Dong, C. Leu, Z. Yin, "American Sign Language Alphabet Recognition Using Microsoft Kinect," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.44-25, 2015
14 EnableTalk website, Avaliable on : http://enabletalk.com.
15 S. Koo, I. Jang, Y. Son, "An Open Source Hardware based Sign Language Interpreter Glove & Situation Awareness Auxiliary IoT Device for the Hearing Impaired," Journal of Korean Institute of Information Scientists and Engineers Transactions on Computing Practices, Vol. 24, No. 4, pp. 204-209, 2018 (in Korean).
16 M. Frenando, J. Wijayanayaka, "Low Cost Approach for Real Time Sign Language Recognition," Proceedings of IEEE Conference on Industrial and Information Systems, pp. 18-20, 2013.
17 S. Chae, K. Jun, "HSV Color Model based Hand Contour Detector Robust to Noise," Journal of Korea Multimedia Society, Vol. 18, No. 10, pp. 1149-1156, 2015 (in Korean).   DOI
18 S.S. Hazari, Asaduzzaman, L.Alam, N.A. Goni, "Designing a Sign Language Translation System Using Kinect Motion Sensor Device," Proceedings of Conference on Electrical, Computer and Communication Engineering, pp. 16-18, 2017.
19 D.M. Capilla, "Sign Language Translator Using Microsoft Kinect XBOX 360TM," Department of Electrical Engineering and Computer Science - compute Vision Lab, University of Tennessee, 2012.
20 A. Kumar, K. Thankachan, M.M. Dominic, "Sign Language Recognition," Proceedings of Conference on Recent Advances in Information Technology, 2016.
21 R.N. Nagashree, S. Michahial, G.N. Aishwarya, B.H. Azeez, M.R. Jayalakshmi, R.K. Rani, "Hand Gesture Recognition Using Support Vector Machine," Journal of Engineering And Science (IJES), Vol. 4, No. 6, pp. 42-46, 2015.
22 T. Lindeberg, "Scale Invariant Feature Transform," Journal of Computer Sciences Computer Vision and Robotics (Autonomous Systems), Vol. 7, No. 5, pp. 10491, 2012.