Browse > Article
http://dx.doi.org/10.9728/dcs.2017.18.2.267

Development of Smart Mirror System for Hearing Deaf's Pronunciation Training  

Jung, Ha-Yoon (Department of IT Engineering, Sookmyung Women's University)
Jeong, Da-Mi (Department of IT Engineering, Sookmyung Women's University)
Lee, Jong-Hyeok (Big Data Utilization Research Center, Sookmyung Women's University)
Kim, Byung-Gyu (Department of IT Engineering, Sookmyung Women's University)
Publication Information
Journal of Digital Contents Society / v.18, no.2, 2017 , pp. 267-274 More about this Journal
Abstract
Recently, there is a new trend about internet of things (IoT) such as shops with smart mirror around the fashion and beauty industry. Since smart mirror can display a content through a monitor which is attached to back of mirror system while looking through a mirror, it can be applied to various industries such as fashion, beauty and health care. This paper proposes an efficient learning system requiring no assistance from others for the hearing deaf who atrophy verbal skill and are inaccurate in pronunciation by using features of smart mirror. Also, this system proposes an efficient and simple lip reading method which can be applied to an embedded system and improves a learning efficiency by employing previously verified pronunciation training data.
Keywords
Embedded system; Feature-extraction; Lip-detection; Lip-reading; Smart-mirror;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 M. S. Lee, Experiences of Raising Children without Hearing Impairments among Hearing-Impaired Mothers, Thesis of master's degree, Department of Social Welfare, Chonbuk National University, 2010.
2 S. H. Kim, Y. H. Lee, J. H. Hwang, M. Oh, M. G. Yee, N. H. Yee, D. Kang, S. J. Kwon, H. K. Oh ,S. Y. Yoon, S. W. Lee, Survey on the Actual Condition of Disabled Person at 2014, Korea Institute for Health and Social Affairs, Policy Report, 2014.
3 Y. J. Lee, S. M. Lim, Y. J. Choi, B. H. Moon, "A Mobile App(See&Speech) of Correcting Pronunciation for Hearing-Impaired Persons," The Journal of Korean Association of Computer Education, Vol. 18, No. 4, pp.11-18, June 2015.
4 J. W. Lee, J. W. Ryoo, J. D. Lee, J. H. Choi, "A Study on the Technical Trends of the IoT Home Assistant in Global Market," Journal of the Korea Society of Computer and Information, Vol. 25, No. 1, pp 109-110, January 2017.
5 M. S. Oh, "Evaluation Research on Smart Mirror UX for Efficient Communication of the IoT Generation," Journal of the Korea Society of Digital Industry and Information Management, Vol. 11, No. 1, pp 121-133, March 2015.   DOI
6 M. S. Oh, "A Study on Analysis of User Behavior and Needs for Efficient Use of a Home Smart Mirror," Journal of the Korea Society of Digital Industry and Information Management, Vol. 12, No. 1, pp 119-129, March 2016.   DOI
7 Mina Moon, Seonhee Kim, Hyejin Yun, "IoT Construction thorugh Smart Mirror and its Connection with Wearable Devices", Korean Institute of Information Scientists and Engineers, Pyeongchang, 2016.
8 B. H. Choi, Study on the Values of Smart Mirror Products in the Smart Home Industry, Thesis of master's degree, Graduate School of Business Administration, Sungkyunkwan University, 2013.
9 E. S. Lee, "Design & Implementation of Lipreading System using Robust Lip Area Extraction," The Journal of Korea Multimedia Society, pp. 524-527, May 2003.
10 Y. U. Kim, "Real Time Lip Reading System Implementation in Embedded Environment," The Journal of Information Processing Society , Vol 17, No. B, pp. 227 -232, June 2010.
11 J. S. Lee, "A New Temporal Filtering Method for Improved Automatic Lipreading," The Journal Korean Information Processing Society , Vol 15, No. B, pp. 123 -130, April 2008.
12 H. M. Park, Articulation training supporting system for the hearing-impaired using a lip shape recognition method, Thesis of master's degree, Department of Computer Engineering, Dongguk University, 2009.
13 Hwa-Jin Park, "Auditory and Language Training Service Model and Serious Game Contents Design for the hearing-impaired," Journal of Digital Contents Society, vol.12, no.4, pp.467-474, 2011   DOI
14 J. S. Yang, K. S. Hong, "A Study on Lip Reading Based on Geometric Facial Feature," The Institute of Electronics and Information Engineers, Daegu, 2016.
15 K. H. Lee, J. J. Kum, and S. B. Rhee, "Design & Implementation of Lipreading System using the Articulatory Controls Analysis of the Korean 5 Vowels," Journal of the Korea Computer Industry Society, vol. 8, no. 4, pp. 281-288, 2007.
16 J. Y. Kim, S. H. Min, and S. H. Choi, "Robustness of Bimodal Speech Recognition on Degradation of Lip Parameter Estimation Performance," Journal of the Korean Society of Phonetic Science and Speech Technology, vol. 10, no. 2, pp. 29-33, 2003.