Science of Emotion and Sensibility (감성과학)

Korean Society for Emotion and Sensibility (한국감성과학회)
권호 표지
DOI QR코드

DOI QR Code

Effect of Emotional Incongruence in Negative Emotional Valence & Cross-modality

교차 양상과 부정 정서에서의 정서 불일치 효과에 따른 기억의 차이

  • Kim, Soyeon (Graduate Program in Cognitive Science, Yonsei University) ;
  • Han, Kwang-Hee (Department of Psychology, Yonsei University)
  • 김소연 (연세대학교 대학원 인지과학 협동 과정) ;
  • 한광희 (연세대학교 문과대학 심리학과)
  • Received : 2014.03.19
  • Accepted : 2014.09.12
  • Published : 2014.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the current study, it is suggested that when two emotions are presented through cross-modality, such as auditory and visual, incongruence will influence arousal, recognition, and recall of subjects. The first hypothesis is that incongruent cross-modality does not only increase arousal more than the congruent, but it also increases recall and recognition more than congruent. The second hypothesis is that arousal modulates recall and recognition of subjects. To demonstrate the two hypotheses, our experiment's conditions were manipulated to be congruent and incongruent by presenting positive or negative emotions, visually and acoustically. For dependent variables, we measured recall rate and recognition rates. and arousal was measured by PAD (pleasure-arousal-dominance) scales. After eight days, only recognition was measured repeatedly online. As a result, our behavioral experiment showed that there was a significant difference between arousal before watching a movie clip and after (p<.001), but no difference between the congruent condition and incongruent condition. Also, there was no significant difference between recognition performance in the congruent condition and incongruent condition, but there was a main effect of the clips' emotions. Interestingly after analyzing recognition rates separately depending on clips' emotions, there was a significant difference between congruent and incongruent conditions in the only negative clip (p= .044), not in the positive clip. In a detailed result, recognition in the incongruent condition is more than in the congruent condition. Furthermore, in the case of recall performance, there was a significant interaction between the clips' emotions shown in the clips and congruent conditions (p=.039). Through these results, the effect of incongruence with negative emotion was demonstrated, but an incongruent effect by arousal could not be demonstrated. In conclusion, in our study, we tried to determine the impact of one method to convey a story dramatically and have an effect on memory. These effects are influenced by the subjects' perceived emotions (valence and arousal).

본 연구에서는 정서를 두 양상(청각, 시각)으로 제시할 시, 두 양상의 정서가 일치 혹은 불일치 할 경우 각성과 재인 기억, 회상 기억에 영향을 미친다는 것을 알아보고자 하였다. 본 연구의 첫 번째 가설은 교차 양상에서의 정서 불일치는 일치 할 때 보다 각성 뿐만 아니라 재인, 회상 기억 모두 높을 것이라는 것이다. 두 번째 가설은 각성이 회상 기억과 재인 기억을 modulate한다는 것이다. 가설을 증명하기 위해 시각과 청각의 정서를 긍정 정서와 부정 정서로 조작하여 일치 조건과 불일치 조건으로 조작하였다. 각 조건에서는 재인 기억과제와 회상 기억 과제의 정확도를 종속 변인으로 측정하였으며, PAD(Pleasure-arousal-dominance) 척도를 이용하여 참가자의 각성 수준을 측정하였다. 또한 8일이 지난 후, 참가자 모두에게 실험 자극으로 쓰인 영상에 대해 재인 기억 과제를 통해 다시 검사하였다. 연구 결과, 각성의 경우 영상을 본 후의 각성 차이는 통계적으로 유의미하게 나타났지만(p<.001), 일치와 불일치 조건 간의 각성 차이는 나타나지 않았다. 또한 정서가 일치하는 조건과 불일치하는 조건에서 재인 기억이 통계적으로 유의미하지는 않았지만, 영상 정서의 주 효과가 통계적으로 유의미하게 나타났다. 이로 인해 두 가지 정서로 나누어 분석한 결과, 부정 정서 영상에 노출된 조건에서만 일치 조건과 불일치 조건에서의 재인 기억이 통계적으로 유의미한 차이를 보였다(p= .044). 사후 분석 결과, 불일치 조건에서 일치 조건 보다 높은 점수를 보였다. 회상 기억의 경우, 영상 정서조건과 일치, 불일치 조건 간의 상호작용이 나타났다(p=.039). 따라서 본 연구에서는 부정 정서에서의 불일치 효과는 증명하였지만, 각성으로 인한 효과는 증명하지 못하였다.

Keywords

References

  1. Bae, E. Y. (2009). The Effect of Type of Harmony and Tempo on Emtional Response Evaluation (화음의 종류와 템포의 변화가 정서반응 평가에 미치는 영향), Unpublished master's degree dissertation, Sookmyung Woman's Graduate School of Music Therapy, Seoul.
  2. Bolivar, V. J., Cohen, A. J., & Fentress, J. C. (1994). Semantic and formal congruency in music and motion pictures: Effects on the interpretation of visual action. Psychomusicology, 13, 28-59. https://doi.org/10.1037/h0094102
  3. Boltz, M. G., Schulkind, M., & Kantra, S. (1991). Effects of background music on the remembering of filmed events. Memory & Cognition, 19, 593-606. https://doi.org/10.3758/BF03197154
  4. Boltz, M. G. (2004). The cognitive processing of film and musical soundtracks. Memory& Cognition, 32(7), 1194-1205. https://doi.org/10.3758/BF03196892
  5. Bordwell, D. & Thompson, K. (1979). Film art: An introduction.reading, MA: Addison-Wesley.
  6. Bower, G. H. (2001). Mood and social memory. In J. P. Forgas (Ed.), Handbook of affect and social cognition. Mahwah: Erlbaum, 95-120.
  7. Cohen, A. J. (2001). Music as a source of emotion in film. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research. Oxford: Oxford University Press, 249-272.
  8. Davidson, D. & Vanegas, S. B. (2014). The role of emotion on the recall of central and peripheral information from script-based text. Cognition & Emotion, http://dx.doi.org/10.1080/02699931.2014. 896319
  9. Eich, E. Kihlstrom, J. F., Bower, G. H., Forgas, J. P., & Niedenthal, P. M. (2000). Cognition and emotion. London: Oxford University Press.
  10. E.Ronald de Kloet. (1995). Steroids, stability and stress. Frontiers in Neuroendocrinology, 16, 416-425. https://doi.org/10.1006/frne.1995.1015
  11. Forgas, J. P. & Bower, G. H. (1987). Mood effects on person--perception judgments. Journal of Personality & Social Psychology, 53, 53-60. https://doi.org/10.1037/0022-3514.53.1.53
  12. Giannetti, L. D. (1982). Understanding movies (3rd ed.). Englewood Cliffs: Prentice-Hall.
  13. Greene, C. M., Bahri, P., & Soto, D. (2010). Interplay between Affect and Arousal in Recognition Memory. Plos One, 5(7), e11739. https://doi.org/10.1371/journal.pone.0011739
  14. Gold, P. E., Van Buskirk, R. B., & McGaugh, J.L. (1975). Effects of hormones on time dependent memory storage processes. Progress in Brain Research, 42, 210-211.
  15. Hevner, K.(1935). The affective character of the major and minor modes in music. American Journal of Psychology, 47, 186-204.
  16. Jefferies, L. N., Smilek, D., Eich, E.,& Enns, J.T. (2008). Emotional Valence and Arousal Interact in Attentional Control. Psychological science, 19(3), 290-295. https://doi.org/10.1111/j.1467-9280.2008.02082.x
  17. Kensinger, E. A. & Schacter, D. L. (2008). Memory and emotion. In M. Lewis, J. M. Haviland-Jones, & L. Feldman Barrett (Eds.), Handbook of emotions. New York: The Guildford Press, 601-.617.
  18. Kim, S. G. & Yi, H. U. (2009). The Effects of the Mood Valence and Arousal Level of TV Programs on Ad Cognitive Response: Focusing on the Moderating Effects of Affect Intensity (TV 프로그램의 무드 극성과 각성 수준이 광고 인지적 반응에 미치는 영향). Korean Strategic Marketing Association, 17(1), 1-30. https://doi.org/10.1080/09652540802619160
  19. Ko, H. E. (2004). Study on role of Modern music in Movie (영화 속 현대음악의 역할 가능성 연구), Unpublished master's degree dissertation, Chung-Ang Graduate school of art, Seoul.
  20. Kring, A. M. & Neale, J. M. (1996). Do schizophrenic patients show a disjunctive relationship among expressive, experiential, and psychological components of emotion?. Journal of Abnormal Psychology, 105, 249-257. https://doi.org/10.1037/0021-843X.105.2.249
  21. Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50, 46-70. https://doi.org/10.1111/j.1460-2466.2000.tb02833.x
  22. Lee, S. J. (2001). Study of Musical Emotional Response Focused on Major key and Minor key (장조와 단조를 중심으로 한 음악적 정서 반응에 관한 연구), Unpublished master's degree dissertation, Ewha Graduate School of Education, Seoul.
  23. Levine, L. J. & Edelstein, R. S. (2009). Emotion and memory narrowing: A review and goal-relevance approach. Cognition and Emotion, 23, 833-875. https://doi.org/10.1080/02699930902738863
  24. Levine, L. J. & Pizarro, D. A. (2004). Emotion and memory research: A grumpy overview. Social Cognition, 22, 530-554. https://doi.org/10.1521/soco.22.5.530.50767
  25. Lim, S. H. (2009). Fact versus Fiction: The Effect of Perceived Realism on the Viewer's Psychological Responses (영상 콘텐츠의 사실성과 유인가가 수용자의 심리적 반응에 미치는 효과에 관한 연구), Korean Association for Broadcasting & Telecommunication Studies, 23(5), 339-379.
  26. Lupien, S. J. & McEwen, B.S. (1997). The acute effects of corticosteroids on cognition: integration of animal and human model studies. Brain Research Reviews, 24, 1-27. https://doi.org/10.1016/S0165-0173(97)00004-0
  27. Marshall, S. & Cohen, A. J. (1988). Effects of musical soundtracks on attitudes toward animated geometric figures. Music Perception, 6, 95-112. https://doi.org/10.2307/40285417
  28. Mehrabian, A. & Russell, J.A. (1974). An Approach to Environmental Psychology, Massachusetts: MIT Press.
  29. Murdock, B. B. (1960). The distinctiveness of stimuli. Psychological Review, 67, 16-31. https://doi.org/10.1037/h0042382
  30. Neath, I., Brown, G. D. A., McCormack, T., Chater, N., & Freeman, R. (2006). Distinctiveness models of memory and absolute identification: Evidence for local, not global, effect. The Quarterly Journal of Experimental Psychology, 59, 121-135. https://doi.org/10.1080/17470210500162086
  31. Quevedoa, J., Anna, M. K. S., Madruga, M., Lovato, I., De-Paris, F., Kapczinski, F., Izquierdo, I., & Cahill, L. (2003). Differential effects of emotional arousal in short- and long-term memory in healthy adults. Neurobiology of Learning and Memory, 79, 132-135. https://doi.org/10.1016/S1074-7427(02)00034-5
  32. Reisberg, D. & Heuer, P. (2004). Memory for emotional events. In D. Reisberg & P. Hertel (Eds.), Memory and emotion. New York: Oxford University Press, 3-41.
  33. Schiffenbauer, A. I. (1974). Effect of observer''s emotional state on judgments of emotional state of others. Journal of Personality & Social Psychology, 30, 31-35. https://doi.org/10.1037/h0036643
  34. Sharot, T. & Phelps. E. A. (2004). How arousal modulates memory: Disentangling the effects of attention and retention. Cognitive, Affective, & Behavioral Neuroscience, 4(3), 294-306. https://doi.org/10.3758/CABN.4.3.294
  35. Spreckelmeyer, K. N., Kutas, M., Urbach T. P., Altenüller, E., &Münte, T.F. (2005). Combined perception of emotion in pictures and musical sounds. Brain research, 1070(2006), 160-170.
  36. Teasdale, J. D. & Fogarty, S. J. (1979). Differential effects of induced mood on retrieval of pleasant and unpleasant events from episodic memory. Journal of Abnormal Psychology, 88, 248-257. https://doi.org/10.1037/0021-843X.88.3.248
  37. Von Restorff, H. (1933). Analyse von Vorgangen im Spurenfeld. I. Uber die Wirkung von Bereichsbildungen im Spurenfeld (Analysis of processes in the memory trace. I. On the effect of group formations on the memory trace). Psychologische Forschung, 18, 299-342. https://doi.org/10.1007/BF02409636
  38. Woloszy, M. R. & Ewert, R. (2012). Memory for facial expression is influenced by the background music playing during study. Advances in Cognitive Psychology, 8(3), 226-233. https://doi.org/10.5709/acp-0118-9