Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

A Convergence Study on Music-color Association Responses of People with Visual Impairment Mediated by Emotion

시각장애인의 정서 기반 음악-색채 연합에 대한 융복합적 연구

  • Received : 2019.03.29
  • Accepted : 2019.05.20
  • Published : 2019.05.28
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to examine music-color association response(MCAR) of people with visual impairment through music-emotion scale and music-color scale. The study was conducted on 60 participants(30 congenital/ 30 adventitious) who are using services of two welfare centers at S and B cities. For this, four basic emotions (happiness, sadness, anger, and fear) mediated by music were selected, and MCAR to emotion-inducing music were analyzed through self-report method. As a result, first, there were found contrasts in MCAR between happiness and sadness according to type of emotion, however, similar in anger and fear. Second, in MCAR among three variables of the music-emotion scale(valence, arousal and intensity), valence was congruent with MCAR according to type of emotion, arousal marked high scores in negative emotions, and scores of intensity in happiness and sadness were higher than those in anger and fear. Third, there were no significant differences between two groups of people with congenital and adventitious visual impairments. It is meaningful that this study showed the MCAR can be mediated by music through investigating those of people with visual impairment.

본 연구의 목적은 음악-정서 척도와 음악-색 척도를 사용하여 시각장애인의 음악-색 연합 반응을 살펴보는 것이다. 참여자는 S시와 B시에 소재한 장애인복지관의 서비스를 이용하고 있는 시각장애인 60명(선천성 30명, 후천성 30명)이다. 이를 위해 음악으로 유도될 수 있는 기본 정서 유형 4가지, 행복, 슬픔, 분노, 두려움을 선정하고, 해당 정서를 유도하는 음악에 대한 음악-색 연합 반응을 자기보고식 척도를 사용하여 분석하였다. 그 결과 첫째, 정서 유형에 따른 음악-색 연합 반응에서 행복과 슬픔은 분명한 대조를 보인 반면, 분노와 두려움은 유사한 것으로 확인되었다. 둘째, 음악 정서 변인(정서가, 정서각성, 정서강도)에 따른 음악-색 연합 반응에서 정서가는 정서 유형별 반응과 일치하였고, 정서각성은 부정적인 정서가 높았으며, 정서강도는 행복/슬픔이 분노/두려움에 비해 높았다. 셋째, 장애발생 시기별(선천성, 후천성) 음악-색 연합에는 유의한 차이가 없었다. 이에 본 연구는 시각장애인의 음악-색 연합 반응을 살펴봄으로써, 음악-색 연합 반응이 정서를 매개로 연결 될 수 있음을 밝혔다는 점에서 의의가 있다.

Keywords

Table 1. Demographic characteristics of participants

OHHGBW_2019_v10n5_313_t0001.png 이미지

Table 2. Music-color response according types of emotion

OHHGBW_2019_v10n5_313_t0002.png 이미지

Table 3. Music-color response according variables of emotion

OHHGBW_2019_v10n5_313_t0003.png 이미지

Table 4. Music-color Response to Types of Emotion according Onset of Visual Impairment

OHHGBW_2019_v10n5_313_t0004.png 이미지

Table 5. Music-color Response to Variables of Emotion according Onset of Visual Impairment

OHHGBW_2019_v10n5_313_t0005.png 이미지

References

  1. S. E. Palmer, K. B. Schloss, Z. Xu & L. R. Prado-Leon. (2013). Music-color associations are mediated by emotion. Proceedings of the National Academy of Sciences, 110(22), 8836-8841. DOI : 10.1073/pnas.1212562110
  2. J. Ward, B. Huckstep & E. Tsakanikos. (2006). Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all?. Cortex, 42(2), 264-280. DOI : 10.1016/s0010-9452(08)70352-6
  3. L. E. Marks. (1975). On colored-hearing synesthesia: cross-modal translations of sensory dimensions. Psychological Bulletin, 82(3), 303. DOI : 10.1037//0033-2909.82.3.303
  4. J. L. Caivano. (1994). Color and sound: Physical and psychophysical relations. Color Research & Application, 19(2), 126-133. https://doi.org/10.1111/j.1520-6378.1994.tb00072.x
  5. C. Spence. (2011). Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics, 73(4), 971-995. DOI : 10.3758/s13414-010-0073-7
  6. K. Evans & A. Treisman. (2009). Natural cross-modal mappings between visual and auditory features. Journal of vision, 10(1), 6-6. DOI : 10.1167/10.1.6
  7. R. Bresin. (2005). What is the color of that music performance? Proceedings of the International Computer Music Conference-ICMC 2005 (International Computer Music Association, San Francisco, CA), 367-370.
  8. J. M. Barbiere, A. Vidal & D. A. Zellner. (2007). The color of music: Correspondence through emotion. Empirical Studies of the Arts, 25(2), 193-208. DOI : 10.2190/a704-5647-5245-r47p
  9. S. Baron-Cohen. (1996). Is there a normal phase of synaesthesia in development. Psyche, 2(27), 223-228.
  10. D. Maurer. (1993). Neonatal synesthesia: Implications for the processing of speech and faces. In Developmental neurocognition, Speech and face processing in the first year of life (pp. 109-124). Springer Netherlands.
  11. H. N. Schifferstein & I. Tanudjaja. (2004). Visualising fragrances through colours: the mediating role of emotions. Perception, 33(10), 1249-1266. DOI : 10.1068/p5132
  12. M. S. Steven & C. Blakemore. (2004). Visual synaesthesia in the blind. Perception, 33(7), 855-868. DOI : 10.1068/p5160
  13. R. H. Wheeler & T. D. Cutsforth. (1921). The Role of Synaesthesia in Learning. Journal of Experimental Psychology, 4(6), 448. https://doi.org/10.1037/h0074800
  14. N. Sadato, A. Pascual-Leone, J. Grafman & V. Ibanez. (1996). Activation of the primary visual cortex by Braille reading in blind subjects. Nature, 380(6574), 526-528. DOI : 10.1038/380526a0
  15. H. Burton. (2003). Visual cortex activity in early and late blind people. Journal of Neuroscience, 23(10), 4005-4011. DOI : 10.1523/jneurosci.23-10-04005.2003
  16. H. Burton, A. Z. Snyder, J. B. Diamond & M. E. Raichle. (2002). Adaptive changes in early and late blind: a FMRI study of verb generation to heard nouns. Journal of Neurophysiology, 88(6), 3359-3371. DOI : 10.1152/jn.00129.2002
  17. R. Weeks, B. Horwitz, A. Aziz-Sultan, B. Tian, C. M. Wessinger, L. G. Cohen, ... & J. P. Rauschecker. (2000). A positron emission tomographic study of auditory localization in the congenitally blind. Journal of Neuroscience, 20(7), 2664-2672. DOI : 10.1523/jneurosci.20-07-02664.2000
  18. J. Ward & P. Meijer. (2010). Visual experiences in the blind induced by an auditory sensory substitution device. Consciousness and Cognition, 19(1), 492-500. DOI : 10.1016/j.concog.2009.10.006
  19. R. Kupers, A. Fumal, A. M. De Noordhout, A. Gjedde, J. Schoenen & M. Ptito. (2006). Transcranial magnetic stimulation of the visual cortex induces somatotopically organized qualia in blind subjects. Proceedings of the National Academy of Sciences, 103(35), 13256-13260. DOI : 10.1073/pnas.0602925103
  20. J. Ward. (2009). The frog who croaked blue: Synesthesia and the mixing of the senses. New York: Routledge. DOI : 10.4324/9780203871737
  21. P. N. Juslin & P. Laukka. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychological Bulletin, 129(5), 770-814. DOI : 10.1037/0033-2909.129.5.770
  22. T. Eerola & J. K. Vuoskoski. (2011). A comparison of the discrete and dimensional models of emotion in music. Psychology of Music, 39(1), 18-49. DOI : 10.1177/0305735610362821
  23. T. Fritz, S. Jentschke, N. Gosselin, D. Sammler, I. Peretz, R. Turner, ... & S. Koelsch. (2009). Universal recognition of three basic emotions in music. Current Biology, 19(7), 573-576. DOI : 10.1016/j.cub.2009.02.058
  24. H. Y. Park & H. J. Chong. (2019). A comparative study of the perception of music emotion between adults with and without visual impairment. Psychology of Music, 47(2), 225-240. DOI : 10.1177/0305735617745148
  25. D. D. Smith. (2004). Introduction to special education: Teaching in an age of opportunity (5th ed.). Boston: Allyn and Bacon.
  26. B. Lowenfeld. (1981). Effects of blindness on the cognitive functions of children. In B. Lowenfeld, Berthold Lowenfeld on blindness and blind people. New York: American Foundation for the blind.
  27. F. Gougoux, F. Lepore, M. Lassonde, P. Voss, R. J. Zatorre & P. Belin. (2004). Pitch discrimination in the early blind. Nature, 430(6997), 309. DOI : 10.1038/430309a
  28. H. Y. Park, H. J. Chong & S. J. Kim. (2015). A comparative study on the attitudes and uses of music by adults with visual impairments and those who are sighted. Journal of Visual Impairment & Blindness, 109(4), 303-316. DOI : 10.1177/0145482x1510900406
  29. P. N. Juslin & P. Laukka. (2004). Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. Journal of New Music Research, 33(3), 217-238. DOI : 10.1080/0929821042000317813
  30. S. Scott, A. Young, A. Calder, D. Hellawell, J. Aggleton & M. Johnsons. (1997). Impaired auditory recognition of fear and anger following bilateral amygdala lesions. Nature, 385(6613), 254-257. DOI : 10.1038/385254a0
  31. A. A. Darrow. (2006). The role of music in deaf culture: Deaf students' perception of emotion in music. Journal of Music Therapy, 43(1), 2-15. DOI : 10.1093/jmt/43.1.2
  32. G. Kreutz, E. Schubert & L. A. Mitchell. (2008). Cognitive styles of music listening. Music Perception, 26(1), 57-73. DOI : 10.1525/mp.2008.26.1.57
  33. E. G. Schellenberg, I. Peretz & S. Vieillard. (2008). Liking for happy-and sad-sounding music: Effects of exposure. Cognition & Emotion, 22(2), 218-237. DOI : 10.1080/02699930701350753
  34. S. A. Shankman & D. N. Klein. (2003). The relation between depression and anxiety: an evaluation of the tripartite, approach-withdrawal and valence-arousal models. Clinical Psychology Review, 23(4), 605-637. DOI : 10.1016/s0272-7358(03)00038-2
  35. D. Gold, A. Shaw & K. Wolffe. (2010). The social lives of Canadian youths with visual impairments. Journal of Visual Impairment & Blindness, 104(7), 431-443. DOI : 10.1177/0145482x1010400706
  36. A. Gabrielsson. (2002). Old people's remembrance of strong experiences related to music. Psychomusicology, 18(1-2), 103-122. DOI : 10.1037/h0094048
  37. P. G. Hunter, E. G. Schellenberg & U. Schimmack. (2010). Feelings and perceptions of happiness and sadness induced by music: Similarities, differences, and mixed emotions. Psychology of Aesthetics, Creativity, and the Arts, 4(1), 47-56. DOI : 10.1037/a0016873
  38. H. Y. Park, H. J. Chong & S. H. Park. (2015). Differences in verbal description of music listening experiences between college students with total blindness and typical vision. The Journal of Special Education: Theory and Practice, 16(4), 149-171.
  39. K. H. Yang. (1990). A study of contents analysis on the drawing expression of visually impaired children and normal children. Art Education Review, 6, 25-42.
  40. K. D. Kwon. (1974). A Study on Color Affection of the Blind. Journal of Special Education, 4, 31-49.
  41. J. H. Park. (1994). A study on the associative language of the color preference of the blind. The Journal of Visual Impairment, 10, 93-118.
  42. E. S. Isbilen & C. L. Krumhansl. (2016). The color of music: Emotion-mediated associations to Bach's Well-tempered Clavier. Psychomusicology: Music, Mind, and Brain, 26(2), 149-161. DOI : 10.1037/pmu0000147
  43. C. Lau, K. B. Schloss, D. M. Eagleman & S. E. Palmer. (2011). Color-grapheme associations in non-synesthetes: Evidence of emotional mediation. Journal of Vision, 11(11), 394. DOI : 10.1167/11.11.394
  44. V. S. Ramachandran & D. Brang. (2008). Tactile-emotion synesthesia. Neurocase, 14(5), 390-399. DOI : 10.1080/13554790802363746
  45. V. S. Ramachandran, L. Miller, M. S. Livingstone & D. Brang. (2012). Colored halos around faces and emotion-evoked colors: a new form of synesthesia. Neurocase, 18(4), 352-358. DOI : 10.1080/13554794.2011.608366