International Journal of Advanced Culture Technology

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Effects of Emoji Approach-Avoidance Visual Experience on Valence Ratings via Mobile Interface

  • Eojin Kim (Dept. of Psychology, Yonsei Univ.) ;
  • Dahua Li (Dept. of Psychology, Yonsei Univ.) ;
  • Soojin Jun (Graduate School of Communication & Arts, Yonsei Univ.)
  • Received : 2024.03.13
  • Accepted : 2024.05.10
  • Published : 2024.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

We aimed to see if approach-avoidance visual experience would have different effects in the valence rating of emojis. Previous literature has shown that approach-avoidance tendencies have influences people's emotional perceptions. Up until now, research on emojis have been heavily focused on static emojis, which gives room for exploration whether if movement added on to emoji would elicit different emotional responses. In the study, we examined the impact of approach-avoidance visual experience of emojis via mobile interface, categorized into 4 experimental conditions (positive approach, negative approach, positive avoid, and negative avoid), and conducted semi-structured interviews to identify users' reasonings towards their valence ratings on specific emojis with approach or avoid movements. We found that positive approach emojis were the highest valence rating and preferred by the participants, while there were no differences between negative emoji approach or avoidance. Based on these findings, we conclude that positive emojis could be intensified to be more positive with approach motion, yet for negative emojis, individual differences or contextual differences may arise in its emotional ratings.

Keywords

References

  1. Aldunate, N., and Gonzalez-Ibanez, R., "An integrated review of emoticons in computer-mediated communication," Frontiers in Psychology, 7, 231860, 2017. https://doi.org/10.3389/fpsyg.2016.02061
  2. Bai, Q., Dan, Q., Mu, Z., and Yang, M, "A systematic review of emoji: Current research and future perspectives," Frontiers in psychology, 7, 2221, 2019. https://doi.org/10.3389/fpsyg.2019.02221
  3. Chafi, A., Schiaratura, L., and Rusinek, S., Three patterns of motion which change the perception of emotional faces, 2012. https://doi.org/10.4236/psych.2012.31014
  4. Derks, D., Bos, A. E., and Von Grumbkow, J., "Emoticons and social interaction on the Internet: the importance of social context," Computers in human behavior, 23.1, pp. 842-849, 2007. https://doi.org/10.1016/j.chb.2004.11.013
  5. Derks, D., Fischer, A. H., and Bos, A. E., "The role of emotion in computer-mediated communication: A review," Computers in human behavior, 24.3, 2008, 766-785. https://doi.org/10.1016/j.chb.2007.04.004
  6. Detenber, B. H., Simons, R. F., and Bennett Jr, G. G., "Roll 'em!: The effects of picture motion on emotional responses," Journal of Broadcasting & Electronic Media, 42.1, pp. 113-127, 1998. https://doi.org/10.1080/08838159809364437
  7. Eder, A. B., and Rothermund, K., "When do motor behaviors (mis) match affective stimuli? An evaluative coding view of approach and avoidance reactions," Journal of Experimental Psychology: General, 137.2, 262, 2008. https://doi.org/10.1037/0096-3445.137.2.262
  8. Elliot, A. J., "The hierarchical model of approach-avoidance motivation," Motivation and emotion, 30, pp. 111-116, 2006. https://doi.org/10.1007/s11031-006-9028-7
  9. Elliot, A. J., Eder, A. B., and Harmon-Jones, E., "Approach-avoidance motivation and emotion: Convergence and divergence," Emotion Review, 5.3, pp. 308-311, 2013. https://doi.org/10.1177/175 4073913477517
  10. Fischer, B., and Herbert, C., "Emoji as affective symbols: affective judgments of emoji, emoticons, and human faces varying in emotional content," Frontiers in psychology, 12, 645173, 2021. https://doi.org/10.3389/fpsyg.2021.645173
  11. Franco, C. L., and Fugate, J. M., "Emoji face renderings: Exploring the role emoji platform differences have on emotional interpretation," Journal of Nonverbal Behavior, 44.2, pp. 301-328, 2020. https://doi.org/10.1007/s11031-006-9028-7
  12. Fujita, K., Henderson, M. D., Eng, J., Trope, Y., and Liberman, N., "Spatial distance and mental construal of social events," Psychological science, 17.4, pp. 278-282, 2006. https://doi.org/10.1111/j.1467-9280.2006.01698.x
  13. Grant, C. B., Vincent, J., and Fortunati, L. (Eds.), Electronic emotion: The mediation of emotion via information and communication technologies, Vol. 3, No. 3. Peter Lang, 2009.
  14. Guntuku, S. C., Li, M., Tay, L., and Ungar, L. H., "Studying cultural differences in emoji usage across the east and the west," In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13, pp. 226-235, 2019, July. https://doi.org/10.1609/icwsm.v13i01.3224
  15. Hsee, C. K., Tu, Y., Lu, Z. Y., and Ruan, B., "Approach aversion: Negative hedonic reactions toward approaching stimuli," Journal of personality and social psychology, 106.5, 699, 2014. https://doi.org/10.1037/a0036332
  16. Jiang, J. A., Brubaker, J. R., and Fiesler, C., "Understanding diverse interpretations of animated gifs," In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1726-1732, 2017, May. https://doi.org/10.1145/3027063.3053139
  17. Jung, Y., Kang, H., Yun, M., and Han, K., "Get it closer: Effect of the approach-avoidance experience on attitude through a touchscreen device," Science of Emotion and Sensibility, 22.2, pp. 17-28, 2019. https://doi.org/10.14695/KJSOS.2018.22.2.17
  18. Kaye, L. K., Darker, G. M., Rodriguez-Cuadrado, S., Wall, H. J., and Malone, S. A., " The Emoji Spatial Stroop Task: Exploring the impact of vertical positioning of emoji on emotional processing," Computers in Human Behavior, 132, 107267, 2022. https://doi.org/10.1016/j.chb.2022.107267
  19. Kim, M. J., Kim, G. Y., Sim, J. M., and Ji, Y. G., "How motion graphics affect emotional quality: In the context of an in-vehicle information system," In Design, User Experience, and Usability. Interaction Design: 9th International Conference, DUXU 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, Proceedings, Part I 22, pp. 491-500, Springer International Publishing, July 19-24, 2020. https://doi.org/10.1007/978-3-030-49713-2
  20. Krieglmeyer, R., Deutsch, R., De Houwer, J., and De Raedt, R., "Being moved: Valence activates approach-avoidance behavior independently of evaluation and approach-avoidance intentions," Psychological Science, 21.4, pp. 607-613, 2010. https://doi.org/10.1177/0956797610365131
  21. Muhlberger, A., Neumann, R., Wieser, M. J., and Pauli, P., "The impact of changes in spatial distance on emotional responses," Emotion, 8.2, 192, 2008. https://doi.org/10.1037/1528-3542.8.2.192
  22. Lavender, T., and Hommel, B., "Affect and action: Towards an event-coding account," Cognition and Emotion, 21.6, pp. 1270-1296, 2007. https://doi.org/10.1080/02699930701438152
  23. Liberman, N., & Trope, Y., "The psychology of transcending the here and now," Science, 322(5905), pp. 1201-1205, 2008. https://doi.org/10.1126/science.1161958
  24. Lo, S. K., "The nonverbal communication functions of emoticons in computer-mediated communication," Cyberpsychology & behavior, 11(5), pp. 595-597, 2008. https://doi.org/10.1089/cpb.2007.0132
  25. Lu, X., Ai, W., Liu, X., Li, Q., Wang, N., Huang, G., and Mei, Q., "Learning from the ubiquitous language: an empirical analysis of emoji usage of smartphone users," In Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing, pp. 770-780, September, 2016. https://doi.org/10.1145/2971648.2971724
  26. Rodrigues, David, Marilia Prada, Rui Gaspar, Margarida V. Garrido, and Diniz Lopes, "Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions," Behavior research methods, 50, pp. 392-405, 2018. https://doi.org/ 10.3758/s13428-017-0878-6
  27. Simons, R. F., Detenber, B. H., Roedema, T. M., and Reiss, J. E., "Emotion processing in three systems: The medium and the message," Psychophysiology, 36(5), pp. 619-627, 1999. https://doi.org/10.1111/1469-8986.3650619
  28. Sundar, S. S., and Kalyanaraman, S., "Arousal, memory, and impression-formation effects of animation speed in web advertising," Journal of Advertising, 33(1), pp. 7-17, 2004. https://doi.org/10.1080/00913367.2004.10639152
  29. Priester, J. R., Cacioppo, J. T., and Petty, R. E., "The influence of motor processes on attitudes toward novel versus familiar semantic stimuli," Personality and Social Psychology Bulletin, 22(5), pp. 442-447. https://doi.org/10.1177/0146167296225002
  30. Tang, Y., and Hew, K. F., "Emoticon, emoji, and sticker use in computer-mediated communication: A review of theories and research findings," International Journal of Communication, 13, 27, 2019. http://dx.doi.org/10.1007/978-981-10-8896-4_16
  31. Tcherkassof, A., Bollon, T., Dubois, M., Pansu, P., and Adam, J. M., "Facial expressions of emotions: A methodological contribution to the study of spontaneous and dynamic emotional faces," European journal of social psychology, 37(6), pp. 1325-1345, 2007. https://doi.org/10.1002/ejsp.427
  32. Wang, Y., "Iteration-based naive Bayes sentiment classification of microblog multimedia posts considering emoticon attributes," Multimedia Tools and Applications, 79, pp. 19151-19166, 2020. https://doi.org/10.1007/s11042-020-08797-7
  33. Yang, D., Wang, M., Ren, Y., Dong, X., and Yang, T., "A study of dynamic emoji emotional responses based on rhythms and motion effects," Frontiers in Psychology, 14, 2023. https://doi.org/10.3389/fpsyg.2023.1247595
  34. Yoo, S. H., Park, Y. J., Kang, H. M., and Kim, S. T., "The Effect of Motivation for Emoticon Use on Behavior of Purchasing Paid Emoticon : Focused on Theory of Planned Behavior," The Journal of the Convergence on Culture Technology (JCCT), 7(2), 395-404, 2021. http://dx.doi.org/10.17703/JCCT.2021.7.2.395
  35. Zheng, X., Zhao, G., Zhu, L., and Qian, X. (2022, July). PERD: Personalized emoji recommendation with dynamic user preference. In Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval (pp. 1922-1926). https://doi.org/10.1145/3477495.3531779