The Journal of the Acoustical Society of Korea (한국음향학회지)

The Acoustical Society of Korea (한국음향학회)
권호 표지
DOI QR코드

DOI QR Code

Variation of heart rate during listening to music

음악 청취 시 정서적 특성에 따른 심박수 변화

  • Jiyun Han ;
  • Soojin Kang ;
  • Junghwan Moon ;
  • Kyung Myun Lee (School of Digital Humanities and Social Sciences, Korea Advanced Institute of Science and Technology) ;
  • Jihwan Woo (Department of Electrical, Electronic and Computer Engineering, University of Ulsan)
  • 한지윤 (울산대학교 대학원 전기전자컴퓨터공학과) ;
  • 강수진 (한국과학기술원 디지털인문사회과학센터) ;
  • 문정환 (울산대학교 대학원 전기전자컴퓨터공학과) ;
  • 이경면 (한국과학기술원 디지털인문사회과학센터) ;
  • 우지환 (울산대학교 대학원 전기전자컴퓨터공학과)
  • Received : 2024.07.01
  • Accepted : 2024.08.30
  • Published : 2024.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Music has a close connection with human emotions, and this relationship has been explored in various fields. Recently, research has been attempted to quantify these subjective emotions based on biosignals such as brain signals. However, emotional changes when listening to music, as measured by heart rate, which can be easily measured in daily life, are not sufficiently known. In this study, we investigated how changing emotions are expressed through variations in heart rate during music listening. The electrocardiogram (ECG) was measured while participants listened to music, and the emotional characteristics of preference, familiarity, arousal, and valence after listening were evaluated using Likert scale scores to analyze the correlation between changes in heart rate and emotional characteristics. The study confirmed that smaller changes in heart rate were associated with lower preference, higher arousal, and more negative emotional valence, while larger heart rate differences were associated with higher preference, lower arousal, and more positive emotional valence. This study demonstrates that heart rate can be used to objectively predict emotional changes due to music listening, and it is expected to have applications in various music-related industries in the future.

음악은 인간의 감정과 긴밀한 연관성을 가지며, 다양한 분야에서 음악의 효과와 응용 가능성을 탐구하기 위해 음악과 감정의 관계를 연구하고 있다. 최근, 이러한 주관적인 감정에 대한 척도를 뇌신호와 같은 생체신호에 기반하여 정량화 하는 연구가 시도되고 있다. 본 연구에서는 음악 청취 시 변화하는 감정이 심박수에 어떤 형태로 발현되는지에 관한 상관 관계를 분석하여 심박수가 감정의 변화를 예측할 수 있는 객관적인 지표인지를 연구하였다. 음악 청취 시 심전도를 측정하며, 음악 청취 후 선호도, 친숙도, 각성도, 정서가의 정서적 특성을 리커트 척도 점수로 평가하여 음악 청취 시 나타나는 정서적 특성에 따른 심박수의 변화를 분석하였다. 청취 음악에 대해 낮은 선호, 높은 각성, 부정적 정서가의 특성을 보인 경우 차이심박수가 작았으며, 높은 선호, 낮은 각성, 긍정적 정서가의 특성을 보인 경우 차이심박수가 상대적으로 큰 경향을 보였다. 본 연구 결과 심박수는 음악 청취에 따른 정서적 특성의 변화를 예측할 수 있음을 보여주고 있으며, 향후 다양한 음악 산업에 활용할 수 있으리라 기대한다.

Keywords

Acknowledgement

본 연구는 한국연구재단의 중견연구과제(NRF-2020R1A2C2003319, 2023R1A2C100475511) 및 기초연구사업과제(RS-2023-00222383)의 지원을 받아 진행함.

References

  1. J. H. Choi and H. J. Chong, "An explorative study on the perceived emotion of music: according to cognitive styles of music listening" (in Korean), J. Acoust. Soc. Kr. 40, 290-296 (2021).
  2. D. S. Naser and G. Saha, "Influence of music liking on EEG based emotion recognition," Biomed. Signal Process. Control. 64, 102251 (2021).
  3. J. H. Lee, J. Y. Kim, D. K. Jeong, and H. G. Kim, "Music classification system through emotion recognition based on regression model of music signal and electroencephalogram features" (in Korean), J. Acoust. Soc. Kr. 41, 115-121 (2022).
  4. S. Koelsch and L. Jancke, "Music and the heart," Eur. Heart J. 36, 3043-3049 (2015).
  5. C. G. Ballmann, "The influence of music preference on exercise responses and performance: A review," J. Funct. Morphol. Kinesiol. 6, 33 (2021).
  6. L. Shu, Y. Yu, W. Chen, H. Hua, Q. Li, J. Jin, and X. Xu, "Wearable emotion recognition using heart rate data from a smart bracelet," Sensors, 20, 718 (2020).
  7. J. Zhu, L. Ji, and C. Liu, "Heart rate variability monitoring for emotion and disorders of emotion," Physiol. Meas. 40, 064004 (2019).
  8. H. Shi, L. Yang, L. Zhao, Z. Su, X. Mao, L. Zhang, and C. Liu, "Differences of heart rate variability between happiness and sadness emotion states: a pilot study," J. Med. Biol. Eng. 37, 527-539 (2017).
  9. M. T. Valderas, J. Bolea, P. Laguna, M. Vallverdu, and R. Bailon, "Human emotion recognition using heart rate variability analysis with spectral bands based on respiration," Proc. 2015 37th Annu. Int. Conf. EMBC, 6134-6137 (2015).
  10. H. Mojtabavi, A. Saghazadeh, V. E. Valenti, and N. Rezaei, "Can music influence cardiac autonomic system? A systematic review and narrative synthesis to evaluate its impact on heart rate variability," Complement. Ther. Clin. Pract. 39, 101162 (2020).
  11. J. Kulinski, E. K. Ofori, A. Visotcky, A. Smith, R. Sparapani, and J. L. Fleg, "Effects of music on the cardiovascular system," Trends Cardiovasc. Med. 32, 390-398 (2022).
  12. P. G. Hunter and E. G. Schellenberg, "Music and Emotion," in Handbok of Sensory Physiology, edited by M. R. Jones, R. R. Fay, A. N. Popper (Springer-Verlag, California, 2010).
  13. J. Choi, N. Kaongoen, H. Choi, M. Kim, B. H. Kim, and S. Jo, "Decoding auditory-evoked response in affective states using wearable around-ear EEG system," Biomed. Phys. Eng. Express. 9, 055029 (2023).
  14. N. Fuentes-Sanchez, R. Pastor, T. Eerola, M. A. Escrig, and M. C. Pastor, "Musical preference but not familiarity influences subjective ratings and psychophysiological correlates of music-induced emotions," Pers. Individ. Differ. 198, 111828 (2022).
  15. E. L. Van den Broek, "Ubiquitous emotion-aware computing," Pers. Ubiquitous Comput. 17, 53-67 (2013).
  16. J. A. Russell, "A circumplex model of affect," J. Pers. Soc. Psychol. 39, 1161-1178 (1980).
  17. M. Iwanaga and Y. Moroki, "Subjective and physiological responses to music stimuli controlled over activity and preference," J. Music Ther. 36, 26-38 (1999).
  18. M. Iwanaga, M. Ikeda, and T. Iwaki, "The effects of repetitive exposure to music on subjective and physiological responses," J. Music Ther. 33, 219-230 (1996).
  19. F. A. Russo, N. N. Vempala, and G. M. Sandstrom, "Predicting musically induced emotions from physiological inputs: linear and neural network models," Front. Psychol. 4, 48485 (2013).
  20. I. Nyklicek, J. F. Thayer, and L. J. P. Van Doornen, "Cardiorespiratory differentiation of musically-induced emotions," J. Psychophysiol. 11, 304- 321 (1997).
  21. H. J. Chong, E. Jeong, and S. J. Kim, "Listeners' perception of intended emotions in music," Int. J. Contents, 9, 78-85 (2013).