Browse > Article

The Effect of Emotional Sounds on Multiple Target Search  

Kim, Hannah (Department of Psychology, Yonsei University)
Han, Kwang Hee (Department of Psychology, Yonsei University)
Publication Information
Korean Journal of Cognitive Science / v.26, no.3, 2015 , pp. 301-322 More about this Journal
Abstract
This study examined the effect of emotional sounds on satisfaction of search (SOS). SOS occurs when detection of a target results in a lesser chance of finding subsequent targets when searching for an unknown number of targets. Previous studies have examined factors that may influence the phenomenon, but the effect of emotional sounds is yet to be identified. Therefore, the current study investigated how emotional sound affects magnitude of the SOS effect. In addition, participants' eye movements were recorded to determine the source of SOS errors. The search display included abstract T and L-shaped items on a cloudy background and positive and negative sounds. Results demonstrated that negative sounds produced the largest SOS effect by definition, but this was due to superior accuracy in low-salient single target trials. Response time, which represents efficiency, was consistently faster when negative sounds were provided, in all target conditions. On-target fixation classification revealed scanning error, which occurs because targets are not fixated, as the most prominent type of error. These results imply that the two dimensions of emotion - valence and arousal - interactively affect cognitive performance.
Keywords
satisfaction of search; visual search; emotional sound; eye tracking;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2008). Cross-modal Emotional Attention: Emotional Voices Modulate Early Stages of Visual Processing. Journal of Cognitive Neuroscience, 21(9), 1670-1679.   DOI
2 Cain, M. S., Adamo, S. H., & Mitroff, S. R. (2013). A taxonomy of errors in multiple-target visual search. Visual Cognition, 21(7), 899-921.   DOI
3 Cain, M. S., Dunsmoor, J. E., LaBar, K. S., & Mitroff, S. R. (2011). Anticipatory Anxiety Hinders Detection of a Second Target in Dual-Target Search. Psychological Science, 22(7), 866-871.   DOI
4 Derakshan, N., & Eysenck, M. W. (2009). Anxiety, processing efficiency, and cognitive performance: New developments from attentional control theory. European Psychologist, 14(2), 168-176.   DOI
5 Fernandes, M. A., Koji, S., Dixon, M. J., & Aquino, J. M. (2011). Changing the focus of attention: The interacting effect of valence and arousal. Visual Cognition, 19(9), 1191-1211.   DOI
6 Fleck, M. S., Samei, E., & Mitroff, S. R. (2010). Generalized “satisfaction of search”: Adverse influences on dual-target search accuracy. Journal of Experimental Psychology: Applied, 16(1), 60-71.   DOI
7 Gasper, K., & Clore, G. L. (2002). Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information. Psychological Science, 13(1), 34-40.   DOI
8 Jefferies, L. N., Smilek, D., Eich, E., & Enns, J. T. (2008). Emotional Valence and Arousal Interact in Attentional Control. Psychological Science, 19(3), 290-295.   DOI
9 Kensinger, E. A. (2009). Remembering the Details: Effects of Emotion. Emotion Review, 1(2), 99-113.   DOI
10 Lang, A., Dhillon, K., & Dong, Q. (1995). The effects of emotional arousal and valence on television viewers’ cognitive capacity and memory. Journal of Broadcasting & Electronic Media, 39(3), 313-327.   DOI
11 Maiworm, M., Bellantoni, M., Spence, C., & Roder, B. (2012). When emotional valence modulates audiovisual integration. Attention, Perception, & Psychophysics, 74(6), 1302-1311.   DOI
12 Mogg, K., & Bradley, B. P. (1999). Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness. Cognition and Emotion, 13(6), 713-740.   DOI
13 Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130(3), 466-478.   DOI
14 Schupp, H. T., Markus, J., Weike, A. I., & Hamm, A. O. (2003). Emotional Facilitation of Sensory Processing in the Visual Cortex. Psychological Science, 14(1), 7-13.   DOI
15 Storbeck, J., & Clore, G. L. (2005). With Sadness Comes Accuracy; With Happiness, False Memory: Mood and the False Memory Effect. Psychological Science, 16(10), 785-791.   DOI
16 Thompson, W. F., Schellenberg, E. G., & Husain, G. (2001). Arousal, Mood, and The Mozart Effect. Psychological Science, 12(3), 248-251.   DOI
17 Vuilleumier, P. (2005). How brains beware: neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585-594.   DOI
18 Wolfe, J. M. (2012). When do I Quit? The Search Termination Problem in Visual Search. In M. D. Dodd & J. H. Flowers (Eds.), The Influence of Attention, Learning, and Motivation on Visual Search (pp.183-208): Springer New York.
19 Alzubaidi, M., Black, J. A., Jr., Patel, A., & Panchanathan, S. (2009, 2-5 Aug. 2009). Conscious vs. subconscious perception, as a function of radiological expertise. Paper presented at the Computer-Based Medical Systems, 2009. CBMS 2009. 22nd IEEE International Symposium on.
20 Zeelenberg, R., & Bocanegra, B. R. (2010). Auditory emotional cues enhance visual perception. Cognition, 115(1), 202-206.   DOI
21 Anderson, A. K. (2005). Affective Influences on the Attentional Dynamics Supporting Awareness. Journal of Experimental Psychology: General, 134(2), 258-281.   DOI
22 Anderson, A. K., Christoff, K., Stappen, I., Panitz, D., Ghahremani, D. G., Glover, G., . . . Sobel, N. (2003). Dissociated neural representations of intensity and valence in human olfaction. Nature Neuroscience, 6(2), 196-202.   DOI
23 Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305-309.   DOI
24 Andriole, K. P., Wolfe, J. M., Khorasani, R., Treves, S. T., Getty, D. J., Jacobson, F. L., . . . Seltzer, S. E. (2011). Optimizing Analysis, Visualization, and Navigation of Large Image Data Sets: One 5000-Section CT Scan Can Ruin Your Whole Day. Radiology, 259(2), 346-362.   DOI
25 Berbaum, K. S., Franklin, E. A. J., Caldwell, R. T., & Schartz, K. M. (2010). Satisfaction of search in traditional radiographic imaging. In E. Samei & E. Krupinski (Eds.), The Handbook of Medical Image Perception and Techniques (pp. 107-138). Cambridge, United Kingdom: Cambridge University Press.
26 Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia, 40(7), 817-826.   DOI
27 Becker, M. W. (2009). Panic Search: Fear Produces Efficient Visual Search for Nonthreatening Objects. Psychological Science, 20(4), 435-437.   DOI
28 Berbaum, K. S., Franken Jr, E. A., Dorfman, D. D., Miller, E. M., Krupinski, E. A., Kreinbring, K., . . . Lu, C. H. (1996). Cause of satisfaction of search effects in contrast studies of the abdomen. Academic Radiology, 3(10), 815-826.   DOI
29 Biggs, A. T., Cain, M. S., Clark, K., Darling, E. F., & Mitroff, S. R. (2013). Assessing visual search performance differences between Transportation Security Administration Officers and nonprofessional visual searchers. Visual Cognition, 21(3), 330-352.   DOI
30 Bolls, P. D., Lang, A., & Potter, R. F. (2001). The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements. Communication Research, 28(5), 627-651.   DOI
31 Bradley, M. M., & Lang, P. J. (2007). The International Affective Digitized Sounds (2nd Edition; IADS-2): Affective ratings of sounds and instruction manual Technical report B-3. Gainesville, Fl.: University of Florida.