Browse > Article
http://dx.doi.org/10.13064/KSSS.2020.12.2.063

Development of the video-based smart utterance deep analyser (SUDA) application  

Lee, Soo-Bok (Department of Speech Language Therapy and Aural Rehabilitation, Woosong University)
Kwak, Hyo-Jung (Department of Communication Disorders, Ewha Womans University)
Yun, Jae-Min (Bory Inc.)
Shin, Dong-Chun (Bory Inc.)
Sim, Hyun-Sub (Department of Communication Disorders, Ewha Womans University)
Publication Information
Phonetics and Speech Sciences / v.12, no.2, 2020 , pp. 63-72 More about this Journal
Abstract
This study aims to develop a video-based smart utterance deep analyser (SUDA) application that analyzes semiautomatically the utterances that child and mother produce during interactions over time. SUDA runs on the platform of Android, iPhones, and tablet PCs, and allows video recording and uploading to server. In this device, user modes are divided into three modes: expert mode, general mode and manager mode. In the expert mode which is useful for speech and language evaluation, the subject's utterances are analyzed semi-automatically by measuring speech and language factors such as disfluency, morpheme, syllable, word, articulation rate and response time, etc. In the general mode, the outcome of utterance analysis is provided in a graph form, and the manger mode is accessed only to the administrator controlling the entire system, such as utterance analysis and video deletion. SUDA helps to reduce clinicians' and researchers' work burden by saving time for utterance analysis. It also helps parents to receive detailed information about speech and language development of their child easily. Further, this device will contribute to building a big longitudinal data enough to explore predictors of stuttering recovery and persistence.
Keywords
stuttering; longitudinal study; video-based utterance analyser; hybrid application; speech language therapy;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Lee, Y., Lee, S., & Sung, M. (2015). Analysis of mobile application trends for speech and language therapy of children with disabilities in Korea. Korean Society of Speech Sciences, 7(3), 153-163.   DOI
2 Lim, J. H., & Park, E. H. (2012). Development and research trends of application as the smart education media for ASD. Journal of the Korean Association for Persons with Autism, 12(1), 93-117.
3 MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk (3rd ed.). Mahwah, NJ: Erlbaum.
4 Manning, W. H. (2001). Clinical decision making in fluency disorders (2nd ed.). San Diego, CA: Singular.
5 Miller, J. F., & Iglesias, A. (2015). Systematic analysis of language transcripts [Computer software]. Middleton, WI: Salt Software.
6 Owens, R. E. Jr. (2016). Language development: An introduction (9th ed.). Harlow, UK: Pearson.
7 Pae, S., Kim, K. S., Sung, K. H., & Sung, J. A. (1998). Computer and language assessment: Korean computerized language analysis1.0. Communication Sciences & Disorders, 3(1), 123-138.
8 Paul, R., & Norbury, C. (2012). Language disorders from infancy through adolescence (4th ed.). St. Louit, MO: Mosby.
9 Park, M. H. (2012). Development of a web-based fluency evaluation system for generalization programs. Journal of Speech-Language & Hearing Disorders, 21(3), 241-257.   DOI
10 Pavelko, S. L., & Owens, R. E. (2017). Sampling utterance and grammatical analysis revised (SUGAR): New normative values for language sample analysis measures. Language, Speech, and Hearing Services in Schools, 48(3), 197-215.   DOI
11 Pezold, M. J., Imgrund, C. M., & Storkel, H. L. (2020). Using computer programs for language sample analysis. Language Speech, and Hearing Services in Schools, 51(1), 103-114.   DOI
12 Shin, M. S., & Park, M. H. (2014). A study of the web-based evaluation system model of adults who stutter. Journal of Speech-Language & Hearing Disorders, 23(3), 1-11.   DOI
13 Sim, H. S., Shin, M. J., & Lee, E. J. (2010). Paradise-fluency assessment II. Seoul, Korea: Paradise Welfare Foundation.
14 Smith, A., & Kelly, E. (1997). Stuttering: A dynamic, multifactorial model. In R. F. Curlee & G. M. Siegel (Eds.), Nature and treatment of stuttering: New directions (pp. 204-207). Boston, MA: Allyn and Bacon.
15 Van Riper, C. (1982). The nature of stuttering (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
16 Yairi, E., & Ambrose, N. G. (2005). Early childhood stuttering for clinicians by clinicians. Austin, TX: Pro-ED.
17 Yang, S. Y., & Kang, E. J. (2011). Development of serious mobile game improving social abilities for children with developmental disorders. Journal of Children’s Media & Education, 10(2), 23-43.
18 Peters, T. J., & Guitar, B. (1991). Stuttering: An integrated approach to its nature and treatment. Baltimore, MD: Williams & Wilkins.
19 Yim, D., Kim, S. Y., Park, W., Cheon, S., & Lee, Y. J. (2014). Analysis on needs based survey of parents and speech-language pathologists for smartphone programs. Communication Sciences & Disorders, 19(4), 486-500.   DOI
20 Byun, J. W., Lee, E. J., & Sim, H. S. (2004). A study on the characteristics of speech disfluencies in early childhood stuttering. Communication Sciences & Disorders, 9(1), 1-14.
21 Chon, H. (2010). Stuttering-like disfluencies in phonological words in preschool children who stutter. Communication Sciences & Disorders, 15(3), 422-432.
22 Costanza-Smith, A. (2010). The clinical utility of language samples. Perspectives on Language Learning and Education, 17(1), 9-15.   DOI
23 Ha, S., Seol, A., So, J., & Pae, S. (2016). Speech and language development patterns of Korean two-year-old children from analysis of spontaneous utterances. Communication Sciences & Disorders, 21(1), 47-59.   DOI
24 Garbarino, J., Ratner, N. B., & MacWhinney, B. (2020). Use of computerized language analysis to assess child language. Language, Speech, and Hearing Services in Schools, 51(2), 504-506.   DOI
25 Guitar, B. (1988). Stuttering: An integrated approach to its nature and treatment. Philadelphia, PA: Lippincott Williams & Wilkins.
26 Go, G., Kwon, Y., Noh, H., Song, K., & Choi, Y. (2017). The effects of speech-language therapy using a smartphone application to improve language ability in patients with aphasia. Journal of Speech-Language & Hearing Disorders, 26(4), 1-10.   DOI
27 Hall, K. D., Amir, O., & Yairi, E. (1999). A longitudinal investigation of speaking rate in preschool children who stutter. Journal of Speech, Language, and Hearing Research, 42(1), 1367-1377.   DOI
28 Hugh-Jones, S., & Smith, P. (1999). Self-reports of short- and long-term effects of bullying on children who stammer. British Journal of Educational Psychology, 69(2), 141-158.   DOI
29 Im, H., Song, J. Y., Cho, Y. K., Kim, Y. J., Kim. H. K., & Kang, Y. J. (2013). The use of smartphone applications in stroke rehabilitation in Korea. Brain & NeuroRehabilitation, 6(1), 33-40.   DOI
30 Jang, Y. J., & Kim, C., W. (2010). The evolution of smartphone market & the effect by android. Communications of the Korean Institute of Information Scientists and Engineers, 28(5), 48-56.
31 Jeong, P. Y. (2014). Speech-language therapy using apps for a student with cerebral palsy. AAC Research & Practice, 2(1), 119-126.
32 Kim, Y. T. (2014). Assessment and treatment of language disorders in children (2nd ed.). Seoul: Hakjisa.
33 Kloth, S. A. M., Janssen, P., Kraaimaat, F. W., & Brutten, G. J.(1998). Chid and mother variables in the development of stuttering among high-risk children: A longitudinal study, Journal of Fluency Disorders, 24, 253-265.   DOI
34 Kim, J., Lee, E., & Hwang, M. (2008). The relationships between stuttering severity, Perception of stuttering severity, and social anxiety of adults who stutter. Communication Sciences & Disorders, 13, 677-690.
35 Kim, S. J., & Shin, J. Y. (2007). Articulatory and phonological disorders. Seoul, Korea: Sigma Press.
36 Lee, B. W. (2015). Korean grammar for speech therapists. Seoul: Hakjisa.
37 Lee, E. J. (2005). The study of temperament of preschool children who stutter, temperament and parenting behavior of the mothers (Doctoral dissertation). Ewha Womans University, Seoul, Korea.
38 Lee, H. N., Park, J. H., & Yoo, J. Y. (2019). Development of smartphone-based voice therapy program. Phonetics and Speech Sciences, 11(1), 51-61.   DOI
39 Lee, H. R., & Lee, S. (2014). Parent survey on the effects of digital instrument on the language development in Korean children. Communication Sciences & Disorders, 19(2), 178-190.   DOI
40 Lee, S. B., Park, H. Y., & Sim, H. S. (2019). Research trends on the longitudinal studies of childhood stuttering. Communication Sciences & Disorders, 24(2), 490-506.   DOI
41 Lee, Y., Kim, Y. T., & Park, E. H. (2016). Analysis on currentpractice and needs based survey of parents and speech-language pathologists for reading intervention with smart device applications. Communication Sciences & Disorders, 21(3), 502-514.   DOI
42 Lee, Y., & Lee, S. (2017). Effect of smartphone applications for aural habilitation in cochlear implanted children: Improvement for auditory memory skills. Audiology and Speech Research, 13(2), 176-188.   DOI