Browse > Article
http://dx.doi.org/10.14695/KJSOS.2018.21.4.77

Emotion Perception and Multisensory Integration in Autism Spectrum Disorder: A Review of Behavioral and Cognitive Neuroscience Studies  

Cho, Hee-Joung (Department of Psychology, Duksung Women's University)
Kim, So-Yeon (Department of Psychology, Duksung Women's University)
Publication Information
Science of Emotion and Sensibility / v.21, no.4, 2018 , pp. 77-90 More about this Journal
Abstract
Behavioral studies of emotion recognition in autism spectrum disorders (ASD) have yielded mixed results. Most of the studies focused on emotion recognition abilities with regard to ASD using stimuli with unisensory modality, making it difficult to determine difficulties in real life emotion perception in ASD. Herein, we review the recent behavioral and cognitive neuroscience studies on emotion recognition functions in ASD, including both unisensory and multisensory emotional information, to elucidate the possible difficulties in emotion recognition in ASD. In our study, we discovered that people with ASD have problems in the process of integrating emotional information during emotion recognition tasks. The following four points are discussed: (1) The restrictions of previous studies, (2) deficits in emotion recognition in ASD especially in recognizing multisensory information, (3) possible compensation mechanisms for emotion recognition in ASD, and (4) the possible roles of attention and language functions in emotion recognition in ASD. The compensatory mechanisms proposed herein for ASD with regard to emotion recognition abilities could contribute to a therapeutic approach for improving emotion recognition functions in ASD.
Keywords
Autism Spectrum Disorders; Compensatory Mechanism; Emotion Recognition; Multisensory Integration;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Taylor, N., Isaac, C., & Milne, E. (2010). A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. Journal of Autism and Developmental Disorders, 40(11), 1403-1411. DOI: 10.1007/s10803-010-1000-4   DOI
2 Thomas, L. A., De Bellis, M. D., Graham, R., & LaBar, K. S. (2007). Development of emotional facial recognition in late childhood and adolescence. Developmental Science, 10(5), 547-558. DOI: 10.1111/j.1467-7687.2007.00614.x   DOI
3 Vannetzel, L., Chaby, L., Cautru, F., Cohen, D., & Plaza, M. (2010). Neutral versus emotional human stimuli processing in children with pervasive developmental disorders not otherwise specified, Research in Autism, 5(2), 775-783. DOI: 10.1016/j.rasd.2010.09.005
4 Kwon, J. S., Kim, J. J., Namkoong, K., Bahk, W. M., Shin, M. S., Yu, B. H., Yoon, J. S., Lee, S. I., Lee, W. H., Lee, Y. W., Lee, H. J., Rim, H. D., Kang, D. H., Choi, S. H. (2015). Diagnostic and Statistical Manual of Mental Disorders (DSM-5) (fifth ed.). Seoul: Hakjisa.
5 Lee, J. S., Cho, H. J. (2009). Validation of Autism Spectrum Screening Questionnaire(ASSQ) and the relationship among ASSQ, Theory of Mind, Executive Function, and Social Skills. Korean Journal of Developmental Psychology, 22(1), 93-115.
6 Kim, S. Y. (2014). Attentional Functions and Dysfunctions in ADHD. Korean Journal of Cognitive & Biological Psychology, 26(2), 67-94.   DOI
7 Kim, S. Y. (2014). Attentional impairment in patients with schizophrenia. Korean Journal of Cognitive & Biological Psychology, 28(1), 99-122.
8 Yeon, B. R., Kim, S. Y. (2018). Effects of attentional bias for positive emotion on associative memory in old adults. Korean Journal of Developmental Psychology, 31(1), 50-70.
9 Cho, H. J., Kim, S. Y. (2017). Effects of reputation on cooperative behaviors in school-age children in social dilemma situations. Journal of Developmental Psychology, 30(4), 161-177.
10 American Psychiatric Association(2013). Diagnostic and Statistical Manual of Mental Disorders, 5th ed., Washington DC; American Psychiatric Association.
11 Doyle-Thomas, K. A., R., Goldberg, J., Szatmari, P., & Hall, G. B. C. (2013). Neurofunctional underpinnings of audiovisual emotion processing in teens with autism spectrum disorders. Frontiers in Psychiatry, 4, DOI: 10.3389/fpsyt.2013.00048   DOI
12 Wang, A. T., Lee, S. S., Sigman, M., & Dapretto, M. (2007). Reading Affect in the Face and Voice: Neural Correlates of Interpreting Communicative Intent in Children and Adolescents With Autism Spectrum Disorders. Arch Gen Psychiatry, 64, 698-708. DOI: 10.1001/archpsyc.64.6.698   DOI
13 Xavier, J., Vignaud, V., Ruggiero, R., Bodeau, N., Cohen, D., & Chaby, L. (2015). A multidimensional approach to the study of emotion recognition in autism spectrum disorders. Frontiers in Psychology, 24(6), DOI: 10.3389/fpsyg.2015.01954.
14 Young R. L, Posselt, M.(2012). Using the transporters DVD as a learning tool for children with autism spectrum disorders(ASD). Journal of Autism and Developmental Disorders, 42, 984-991. DOI: 10.1007/s10803-011-1328-4   DOI
15 Bal, E., Harden, E., Lamb, D., Van Hecke, A. V., Denver, J. W., & Porges, S. W. (2010). Emotion recognition in children with autism spectrum disorders: relations to eye gaze and autonomic state. Journal of Autism and Developmental Disorders, 40(3), 358-370. DOI: 10.1007/s10803-009-0884-3   DOI
16 Berggren, S., Fletcher-Watson, S., Milenkovic, N. Marschik, P. B., Bolte, S., Jonsson, U.(2017). Emotion recognition training in autism spectrum disorder: A systeatic review of challenges related to generalizability. Developmental Neurorehabilitation, 21(3), 141-151. DOI: 10.1080/17518423.2017.1305004   DOI
17 Charbonneau, G., Bertone, A., Lepore, F., Nassim, M., Lassonde, M., Mottron, L., & Collignon, O. (2013). Multilevel alterations in the processing of audio- visual emotion expressions in autism spectrum disorders. Neuropsychologia, 51(5), 1002-1010. DOI: 10.1016/j.neuropsychologia.2013.02.009   DOI
18 Doi, H., Fujisawa, T. X., Kanai, C., Ohta, H., Yokoi, H., Iwanami, A., Kato, N., & Shinohara, K. (2013). Recognition of Facial Expressions and Prosodic Cues with Graded Emotional Intensities in Adults with Asperger Syndrome. Journal of Autism and Developmental Disorders, 43, 2099-2113. DOI: 10.1007/s10803-013-1760-8.   DOI
19 Eigsti, I.-M., Schuh, J., Mencl, E., Schultz, R. T., & Paul, R. (2012). The neural underpinnings of prosody in autism. Child Neuropsychology. A Journal on Normal and Abnormal Development in Childhood and Adolescence, 18(6), 600-617. DOI: 10.1080/09297049.2011.639757.
20 Fridenson-Hayo, S., Berggren, S., Lassalle, A., Tal, S., Pigat, D., Bolte, S., Baron-Cohen, S., & Golan, O. (2016). Basic and complex emotion recognition in children with autism: cross-cultural findings. Molecular Autism, 7(52), 1-11. DOI: 10.1186/s13229-016-0113-9.   DOI
21 Harmas, M. B., Martin, A., & Wallace, G. L. (2010). Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. Neuropsychology Review, 20, 290-322. DOI: 10.1007/s11065-010-9138-6   DOI
22 Griffiths, S., Jarrold, C., Penton‑Voak, I. S., Woods, A. T., Skinner, A. L., & Munafò, M. R. (2017). Impaired Recognition of Basic Emotions from Facial Expressions in Young People with Autism Spectrum Disorder: Assessing the Importance of Expression Intensity. Journal of Autism and Developmental Disorders, 1-11. DOI: 10.1007/s10803-017-3091-7
23 Grossman, R. B., & Tager-Flusberg, H. (2012). "who said that?" matching of low- and high-intensity emotional prosody to facial expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42(12), 2546-2557. DOI: 10.1007/s10803-012-1511-2.   DOI
24 Hadjikhani, N., Joseph, R. M., Snyder, J., Chabris, C. F., Clark, J., Steele, S., McGrath, L., Vangel, M., Aharon, I., Feczko, E., Harris, G. J., & Tager- Flusberg, H. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. Neuroimage, 22(3), 1141-1150. DOI: 10.1016/j.neuroimage.2004.03.025   DOI
25 Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happe, F., Scott, S. K., Sauter, D., Tregay, J., Phillips, R. J., Baird, G, Simonoff, E., & Charman, T. (2011). A multi-modal approach to emotion recognition ability in autism spectrum disorders. Journal of Autism Psychology Psychiatry, 52, 275-285. DOI: 10.1111/j.1469-7610.2010.02328.x   DOI
26 Golan O., Gordon I., Fichman, K., Keinan, G. (2018). Specific Patterns of Emotion Recognition from Faces in Children with ASD: Results of a Cross- Modal Matching Paradigm. Journal of Autism and Developmental Disorders, 48(3), 844-852. DOI: 10.1007/s10803-017-3389-5   DOI
27 Loveland, K. A., Steinberg, J. L., Pearson, D. A., Mansour, R., & Reddoch, S. (2008). Judgments of auditory-visual affective congruence in adolescents with and without autism: a pilot study of a new task using fMRI. Perceptual and Motor Skills, 107, 557-575. DOI: 10.2466/pms.107.2.557-575
28 Kim, K., Rosenthal, M. Z., Gwaltney, M., Jarrold, W., Hatt, N., Mclntyre, N., Swain, L., Solomon, M., & Mundy, P. (2015). A virtual joy-stick study of emotional responses and social motivation in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(12), 3891- 3899. DOI: 10.1007/s10803-014-2036-7   DOI
29 Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M., Ebeling, H., Jussila, K., Bolte, S, & Moilanen, I. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 938-945. DOI: 10.1007/s10803-009-0700-0   DOI
30 Lerner, M. D., McPartlandc, J. C., & Morrisa, J. P. (2013). multi-modal emotion processing in autism spectrum disorders: An event-related potential study. Developmental Cognitive Neuroscience, 3, 11-21. DOI: 10.1016/j.dcn.2012.08.005   DOI
31 Magnee, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2007). Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. Journal of Child Psychology and Psychiatry, 48(11), 1122-1130. DOI: 10.1111/j.1469-7610.2007.01779.x   DOI
32 Rozga, A., King, T. Z., Vuduc, R. W., & Robins, D. L. (2013). Undifferentiated facial electromyography responses to dynamic, audio-visual emotion displays in individuals with autism spectrum disorders. Developmental Science, 16(4), 499-514. DOI: 10.1111/desc.12062   DOI
33 Magnee, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C.(2011). Multisensory integration and attention in autism spectrum disorder: evidence from event-related potentials. PLoS ONE, 6(8): e24196. DOI: 10.1371/journal.pone.0024196   DOI
34 O' Connor, K. (2007). Brief Report: Impaired Identification of Discrepancies Between Expressive Faces and Voices in Adults with Asperger's Syndrome. Journal of Autism and Developmental Disorders, 37(10), 2008-2013. DOI: 10.1007/s10803-006-0345-1   DOI
35 Oerlemans, A. M., van der Meer, J. M. J., van Steijn, D. J., Saskia W. de Ruiter, S. de Bruijn, W., Y. G. E., de Sonneville, L. M. J., Jan K. Buitelaar, J. K., & Rommelse, N. N. J. (2014). Recognition of facial emotion and affective prosody in children with ASD(+ADHD) and their unaffected siblings. European Child & Adolescent Psychiatry, 23, 257-271. DOI: 10.1007/s00787-013-0446-2   DOI
36 Pelphrey, K. A., Morris, J. P., McCarthy, G., & LaBar, K. S. (2007). Perception of dynamic changes in facial affect and identity in autism. Social Cognitive and Affective Neuroscience, 2(2), 140-149. DOI: 10.1093/scan/nsm010   DOI
37 Philip, R. C. M., Whalley, H. C., Stanfield, a C., Sprengelmeyer, R., Santos, I. M., Young, A. W., Atikinson, A. P., Calder, A. J., Johnstone, E. C., Lawrie, S. M., & Hall, J. (2010). Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine, 40(11), 1919-29. DOI: 10.1017/S0033291709992364.   DOI
38 Sato, W., Toichi, M., Uono, S., & Kochiyama, T. (2012). Impaired social brain network for processing dynamic facial expressions in autism spectrum disorders. BMC Neuroscience, 13, 99. DOI: 10.1186/1471-2202-13-99   DOI
39 Stewart, M. E., McAdam, C., Ota, M., Peppe, S., & Cleland, J. (2011). Emotional recognition in autism spectrum conditions from voices and faces. Autism, 17(1), 6-14. DOI: 10.1177/1362361311424572   DOI
40 Solomon M, Goodlin-Jones B. L, Anders T. F.(2004). A social adjustment enhancement intervention for high functioning autism, Asperger's syndrome, and pervasive developmental disorder NOS. Journal of Autism and Developmental Disorders, 34, 649-668. DOI: 10.1007/s10803-004-5286-y   DOI
41 Taylor, L. J., Maybery, M, T., Grayndler, L., & Whitehouse, A. J. O. (2015). Evidence for shared deficits in identifying emotions from faces and from voices in autism spectrum disorders and specific language impairment. International Journal of Language and Communication Disorders, 50(4), 452-466. DOI: 10.1111/1460-6984.12146   DOI
42 Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown C., Stahl., S., Kaiser, M. D., & Schultz, R. T. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let's Face It! Program. Journal of Child Psychology and Psychiatry, 51, 944-952. DOI: 10.1111/j.1469-7610.2010.02258.x   DOI
43 Tardif, C., Laine, F., Rodriguez, M., & Gepner, B. (2007). Slowing Down Presentation of Facial Movements and Vocal Sounds Enhances Facial Expression Recognition and Induces Facial-Vocal Imitation in Children with Autism. Journal of Autism and Developmental Disorders, 37, 1469-1484. DOI: 10.1007/s10803-006-0223-x   DOI