Journal of Music and Human Behavior (인간행동과 음악연구)

Korean Music Therapy Education Association (한국음악치료교육학회)
권호 표지
DOI QR코드

DOI QR Code

Depending on Mode and Tempo Cues for Musical Emotion Identification in Children With Cochlear Implants

조성 및 템포 단서에 따른 인공와우이식 아동의 음악 정서 지각

  • Received : 2023.10.30
  • Accepted : 2023.12.21
  • Published : 2024.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to investigate how children with cochlear implants (CI) perceive emotion in music depending on mode and tempo cues, and to compare them to NH children. Participants in this study included 13 CI children who were implanted with either unilateral or bilateral cochlear implants aged between 7 and 13 years, 36 NH children, and 20 NH adults. The musical stimuli used in this study were piano recordings in either major or minor mode, with tempos of 130 bpm and 56 bpm. A comparison of the emotion perception levels of NH children and NH adults before the experiment showed that there was no significant difference between the two groups. Meanwhile, the way they perceive different emotions from each music condition varies, in that CI children perceived all music conditions except as happy, while NH children perceived music in a major key as happy and music in a minor key as sad. It supports that CI children tend to rely primarily on tempo cues to process and identify emotional information from music, which is contrary to NH children. It is important to note that this study enhanced and specified the understanding of how CI children perceive music emotion and use specific musical elements in the process. These findings indicate baseline data on emotion perception in music in CI children.

본 연구는 인공와우이식(CI) 아동이 조성 및 템포 단서에 따라 구성된 음악에서 정서를 어떻게 지각하는지 알아보고 이를 건청(NH) 아동과 비교함으로써 CI 아동의 음악에서의 정서 지각에 대한 기초 자료를 마련하기 위해 실시되었다. 참여 대상자는 만 7세-13세 사이 CI 아동 13명과 NH 아동 36명으로 각 아동은 <장조+빠름>, <장조+느림>, <단조+빠름>, <단조+느림>의 4개 조건으로 구성된 음악을 듣고, 행복과 슬픔 중 해당 음악에서 느껴지는 정서를 선택하고 해당 정서가 어느 정도로 느껴지는지를 평정하는 과제에 참여하였다. 본 실험 전 규준 집단으로서 포함된 NH 아동이 NH 성인과 유사하게 정확한 정서 지각을 보이는지 확인하기 위한 사전 검증 절차를 진행하였으며, 두 그룹 간 유의한 차이가 없는 것으로 나타났다. 이후 CI 아동과 NH 아동의 정서 지각 수준을 비교 분석한 결과, 두 그룹 모두 <장조+빠름>의 음악을 행복의 정서로 가장 많이 지각하였으며, <단조+느림>의 음악을 가장 슬프게 지각하는 것으로 나타났다. 또한 CI 아동은 <단조+느림>을 제외한 모든 조건의 음악을 행복의 정서로 지각하는 반면, NH 아동은 장조로 구성된 음악은 행복의 정서를, 단조로 구성된 음악은 슬픔의 정서로 지각하는 것으로 나타났다. 본 연구 결과를 통해 CI 아동이 정서를 지각하는 데 있어 조성 단서보다는 템포 단서에 의존하는 경향이 있음을 확인하였으며, CI 아동의 음악에서의 정서 지각 과정을 보다 다각적으로 이해할 수 있도록 하는 기초 자료를 제시했다는 데 그 의의가 있다.

Keywords

References

  1. Aguert, M., Laval, V., Le Bigot, L., & Bernicot, J. (2010). Understanding expressive speech acts: The role of prosody and situational context in French-speaking 5-to 9-year-olds. Journal of Speech, Language, and Hearing Research, 53(6), 1629-1641.
  2. Caldwell, M. T., Jiam, N. T., & Limb, C. J. (2017). Assessment and improvement of sound quality in cochlear implant users. Laryngoscope Investigative Otolaryngology, 2(3), 119-124.
  3. Caldwell, M., Rankin, S. K., Jiradejvong, P., Carver, C., & Limb, C. J. (2015). Cochlear implant users rely on tempo rather than on pitch information during perception of musical emotion. Cochlear Implants International, 16(sup3), S114-S120.
  4. Cannon, S. A., & Chatterjee, M. (2019). Voice emotion recognition by children with mild-to -moderate hearing loss. Ear and Hearing, 40(3), 477-492.
  5. D'Onofrio, K. L., Caldwell, M., Limb, C., Smith, S., Kessler, D. M., & Gifford, R. H. (2020). Musical emotion perception in bimodal patients: Relative weighting of musical mode and tempo cues. Frontiers in Neuroscience, 14, 114.
  6. Gfeller, K., Christ, A., Knutson, J., Witt, S., & Mehr, M. (2003). The effects of familiarity and complexity on appraisal of complex songs by cochlear implant recipients and normal hearing adults. Journal of Music Therapy, 40(2), 78-112.
  7. Giannantonio, S., Polonenko, M. J., Papsin, B. C., Paludetti, G., & Gordon, K. A. (2015). Experience changes how emotion in music is judged: Evidence from children listening with bilateral cochlear implants, bimodal devices, and normal hearing. PLoS One, 10(8), 0136685.
  8. Gifford, R. H., Shallop, J. K., & Peterson, A. M. (2008). Speech recognition materials and ceiling effects: Considerations for cochlear implant programs. Audiology and Neurotology, 13(3), 193-205.
  9. Hopyan, T., Manno III, F. A., Papsin, B. C., & Gordon, K. A. (2016). Sad and happy emotion discrimination in music by children with cochlear implants. Child Neuropsychology, 22(3), 366-380.
  10. Hsiao, F., & Gfeller, K. (2012). Music perception of cochlear implant recipients with implications for music instruction: A review of the literature. Update Applications of Research in Music Education, 30(2), 5-10.
  11. Hunter, P. G., Schellenberg, E. G., & Stalinski, S. M. (2011). Liking and identifying emotionally expressive music: Age and gender differences. Journal of Experimental Child Psychology, 110(1), 80-93.
  12. Kim, M. Y., & Yoon, M. S. (2018). Recognition of voice emotion in school aged children with cochlear implants. Communication Sciences & Disorders, 23(4), 1102-1110.
  13. Komosinski, M., & Mensfelt, A. (2016). Emotions perceived and emotions experienced in response to computer-generated music. Music Perception: An Interdisciplinary Journal, 33(4), 432-445.
  14. Limb, C. J., & Roy, A. T. (2014). Technological, biological, and acoustical constraints to music perception in cochlear implant users. Hearing Research, 308, 13-26.
  15. Looi, V., McDermott, H., McKay, C., & Hickson, L. (2008). Music perception of cochlear implant users compared with that of hearing aid users. Ear and Hearing, 29(3), 421-434.
  16. Nakata, T., Trehub, S. E., & Kanda, Y. (2012). Effect of cochlear implants on children's perception and production of speech prosody. The Journal of the Acoustical Society of America, 131(2), 1307-1314.
  17. Nelson, P. B., Jin, S. H., Carney, A. E., & Nelson, D. A. (2003). Understanding speech in modulated interference: Cochlear implant users and normal-hearing listeners. The Journal of the Acoustical Society of America, 113(2), 961-968.
  18. Nogueira, W., Nagathil, A., & Martin, R. (2018). Making music more accessible for cochlear implant listeners: Recent developments. IEEE Signal Processing Magazine, 36(1), 115-127.
  19. Peppe, S., McCann, J., Gibbon, F., O'Hare, A., & Rutherford, M. (2007). Receptive and expressive prosodic ability in children with high-functioning autism. Journal of Speech, Language, and Hearing Research, 50(4), 1015-1028.
  20. Shirvani, S., Jafari, Z., Motasaddi Zarandi, M., Jalaie, S., Mohagheghi, H., & Tale, M. R. (2016). Emotional perception of music in children with bimodal fitting and unilateral cochlear implant. The Annals of Otology, Rhinology & Laryngology, 125(6), 470-477.
  21. Van De Velde, D. J., Schiller, N. O., Levelt, C. C., Van Heuven, V. J., Beers, M., Briaire, J. J., & Frijns, J. H. (2019). Prosody perception and production by children with cochlear implants. Journal of Child Language, 46(1), 111-141.
  22. Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., & Bouchard, B. (2008). Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognition and Emotion, 22(4), 720-752.
  23. Volkova, A., Trehub, S. E., Schellenberg, E. G., Papsin, B. C., & Gordon, K. A. (2013). Children with bilateral cochlear implants identify emotion in speech and music. Cochlear Implants International, 14(2), 80-91.
  24. Vongpaisal, T., Trehub, S. E., & Schellenberg, E. G. (2006). Song recognition by children and adolescents with cochlear implants. Journal of Speech, Language and Hearing Research, 49(5), 1091-1103.
  25. Waaramaa, T., Kukkonen, T., Mykkanen, S., & Geneid, A. (2018). Vocal emotion identification by children using cochlear implants, relations to voice quality, and musical interests. Journal of Speech, Language, and Hearing Research, 61(4), 973-985.
  26. Whipple, C. M., Gfeller, K., Driscoll, V., Oleson, J., & McGregor, K. (2015). Do communication disorders extend to musical messages? An answer from children with hearing loss or autism spectrum disorders. Journal of Music Therapy, 52(1), 78-116.
  27. Wiefferink, C. H., Rieffe, C., Ketelaar, L., De Raeve, L., & Frijns, J. H. (2013). Emotion understanding in deaf children with a cochlear implant. Journal of Deaf Studies and Deaf Education, 18(2), 175-186.