Browse > Article
http://dx.doi.org/10.13088/jiis.2018.24.1.227

Emoticon by Emotions: The Development of an Emoticon Recommendation System Based on Consumer Emotions  

Kim, Keon-Woo (Graduate School of Business IT, Kookmin University)
Park, Do-Hyung (College of Business Administration / Graduate School of Business IT, Kookmin University)
Publication Information
Journal of Intelligence and Information Systems / v.24, no.1, 2018 , pp. 227-252 More about this Journal
Abstract
The evolution of instant communication has mirrored the development of the Internet and messenger applications are among the most representative manifestations of instant communication technologies. In messenger applications, senders use emoticons to supplement the emotions conveyed in the text of their messages. The fact that communication via messenger applications is not face-to-face makes it difficult for senders to communicate their emotions to message recipients. Emoticons have long been used as symbols that indicate the moods of speakers. However, at present, emoticon-use is evolving into a means of conveying the psychological states of consumers who want to express individual characteristics and personality quirks while communicating their emotions to others. The fact that companies like KakaoTalk, Line, Apple, etc. have begun conducting emoticon business and sales of related content are expected to gradually increase testifies to the significance of this phenomenon. Nevertheless, despite the development of emoticons themselves and the growth of the emoticon market, no suitable emoticon recommendation system has yet been developed. Even KakaoTalk, a messenger application that commands more than 90% of domestic market share in South Korea, just grouped in to popularity, most recent, or brief category. This means consumers face the inconvenience of constantly scrolling around to locate the emoticons they want. The creation of an emoticon recommendation system would improve consumer convenience and satisfaction and increase the sales revenue of companies the sell emoticons. To recommend appropriate emoticons, it is necessary to quantify the emotions that the consumer sees and emotions. Such quantification will enable us to analyze the characteristics and emotions felt by consumers who used similar emoticons, which, in turn, will facilitate our emoticon recommendations for consumers. One way to quantify emoticons use is metadata-ization. Metadata-ization is a means of structuring or organizing unstructured and semi-structured data to extract meaning. By structuring unstructured emoticon data through metadata-ization, we can easily classify emoticons based on the emotions consumers want to express. To determine emoticons' precise emotions, we had to consider sub-detail expressions-not only the seven common emotional adjectives but also the metaphorical expressions that appear only in South Korean proved by previous studies related to emotion focusing on the emoticon's characteristics. We therefore collected the sub-detail expressions of emotion based on the "Shape", "Color" and "Adumbration". Moreover, to design a highly accurate recommendation system, we considered both emotion-technical indexes and emoticon-emotional indexes. We then identified 14 features of emoticon-technical indexes and selected 36 emotional adjectives. The 36 emotional adjectives consisted of contrasting adjectives, which we reduced to 18, and we measured the 18 emotional adjectives using 40 emoticon sets randomly selected from the top-ranked emoticons in the KakaoTalk shop. We surveyed 277 consumers in their mid-twenties who had experience purchasing emoticons; we recruited them online and asked them to evaluate five different emoticon sets. After data acquisition, we conducted a factor analysis of emoticon-emotional factors. We extracted four factors that we named "Comic", Softness", "Modernity" and "Transparency". We analyzed both the relationship between indexes and consumer attitude and the relationship between emoticon-technical indexes and emoticon-emotional factors. Through this process, we confirmed that the emoticon-technical indexes did not directly affect consumer attitudes but had a mediating effect on consumer attitudes through emoticon-emotional factors. The results of the analysis revealed the mechanism consumers use to evaluate emoticons; the results also showed that consumers' emoticon-technical indexes affected emoticon-emotional factors and that the emoticon-emotional factors affected consumer satisfaction. We therefore designed the emoticon recommendation system using only four emoticon-emotional factors; we created a recommendation method to calculate the Euclidean distance from each factors' emotion. In an attempt to increase the accuracy of the emoticon recommendation system, we compared the emotional patterns of selected emoticons with the recommended emoticons. The emotional patterns corresponded in principle. We verified the emoticon recommendation system by testing prediction accuracy; the predictions were 81.02% accurate in the first result, 76.64% accurate in the second, and 81.63% accurate in the third. This study developed a methodology that can be used in various fields academically and practically. We expect that the novel emoticon recommendation system we designed will increase emoticon sales for companies who conduct business in this domain and make consumer experiences more convenient. In addition, this study served as an important first step in the development of an intelligent emoticon recommendation system. The emotional factors proposed in this study could be collected in an emotional library that could serve as an emotion index for evaluation when new emoticons are released. Moreover, by combining the accumulated emotional library with company sales data, sales information, and consumer data, companies could develop hybrid recommendation systems that would bolster convenience for consumers and serve as intellectual assets that companies could strategically deploy.
Keywords
Emoticon; Consumer Emotion; Consumer Sentiment; Metadata-ization; Recommendation System;
Citations & Related Records
Times Cited By KSCI : 9  (Citation Analysis)
연도 인용수 순위
1 Kang, T., D.-H. Park, and I. Han, "Beyond the numbers: The effect of 10-K tone on firms' performance predictions using text analytics," Telematics and Informatics, Vol. 35, No. 2 (2018), 370-381.   DOI
2 Balabanovic, M., and Y. Shoham, "Content-based, collaborative recommendation," Communications of the ACM, Vol. 40, No. 3 (1997), 66-72.   DOI
3 Beyer, M., Gartner says solving big data challenge involves more than just managing volumes of data, Gartner, 2011. Available at: http://www.gartner.com/it/page.jsp?id=1731916.
4 Kim, K.-W., and D.-H. Park, "Design evaluation model based on consumer values: Three-step approach from product attributes, perceived attributes, to consumer values," Journal of Intelligence and Information Systems, Vol. 23, No. 4 (2017), 57-76.   DOI
5 Kim, S., "The comparative study on the characteristics of emoticons used in mobile messengers - mainly on Korean and foreign mobile messengers," Journal of Digital Design, Vol. 14, No. 1 (2014), 87-96.   DOI
6 Kim, S., "A Study on the expression aspect in emoticon," Korean Semantics, Vo. 38(2012), 1-25.
7 Kim, Y., "Typography media (emoticon) for the public service and communication," The Journal of the Korea Contents Association, Vol. 11, No. 6 (2011), 197-204.   DOI
8 Kim, Y., and D.-H. Park, "A study on the consumers' knowledge structure of innovative products through product category concept map: Focusing on 3D and smart TV," Entrue Journal of Information Technology, Vol. 12, No. 3 (2013), 181-197.
9 Kim, W., "Descartes, the origin of cognitivist theory of emotions and its limit," CHEOLHAK: Korean Journal of Philosophy, Vol. 114 (2013), 1-25.
10 Laney, D., 3D data management: Controlling data volume, velocity and variety, META Group Research Note, 6, 2001, Available at : http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf
11 Lee, D., T. Kang, and D.-H. Park, "The research on pc-based versus mobile device-based shopping behavior depending on consumer purchase decision process: Focusing on task-technology fit theory," Entrue Journal of Information Technology, Vol. 13, No. 3 (2014), 107-122.
12 Lee, S., "The study of emoticon as a nonverbal symbolic representation of CMC," Journal of the Korean Society of Design Culture, Vol. 7, No. 2 (2001), 99-111.
13 Cho, K., and K. Kim, "Study of emoticon as an emotional sign under the digital communication environment," Journal of Korean Society of Design Science, Vol. 55 (2004), 319-328.
14 Lee, E., "Motivations for the using emoticon: Exploring the effect of motivations and intimacies between users on the attitude and behaviors of using emoticon," Journal of the HCI Society of Korea, Vol. 12, No. 2 (2017), 5-12.
15 Lee, K., M. Choi, and C. Kim, "Study on laughter-arousing factors of character designs of KakaoTalk emoticons," Journal of Multimedia Society, Vol. 18, No. 2 (2015), 253-259.   DOI
16 Lee, J., Mobile media and mobile society, 33, Communication Books, 2004.
17 Lee, M., and H. Lee, "The structural analysis of adjective meanings: Related to affective vocabulary," Korean Journal of Cognitive and Biological Psychology, Vol. 2 (1990), 118-138.
18 Lim, J., "Linguistically encoding aspects of physiological effects of emotions," Discourse and cognition, Vol. 6, No. 2 (1999), 89-117.
19 Lim, J., "A study on the metaphorical aspects of basic emotional expressions in Korean," Korean Linguistics, Vol. 17 (2002), 135-162.
20 Na, J., H. Jun., Y. Chen., H. Choi., and D.-H. Park, "The Development and practice of design thinking methodology based on gamification: Focusing on university loyalty program," Journal of Information Technology Services, Vol. 15, No. 2 (2016), 65-80.
21 Park, D.-H., "The process of user experience quality evaluation and product improvement based on consumer needs: focusing on mobile phone camera experience," Entrue Journal of Information Technology, Vol. 12, No. 1 (2013), 165-175.
22 Park, J., V. Barash, C. Fink and M. Cha, "Emoticon style: Interpreting differences in emoticons across cultures". In Proceedings of the International AAAI Conference on Web and Social Media (ICWSM), 2013, 466-475.
23 Park, D.-H., "A study on the success factors and strategy of information technology investment based on intelligent economic simulation modeling," Journal of Intelligence and Information Systems, Vol. 19, No. 1 (2013), 35-55.   DOI
24 Park, D.-H., "Virtuality as a psychological distance: The strategy for advertisement message appeal depending on virtuality," Journal of Information Technology Applications & Management, Vol. 24, No. 2 (2017b), 39-54.
25 Park, D.-H., "Virtuality as a psychological distance and temporal distance: Focusing on the effect of product information type on product attitude," Knowledge Management Research, Vol. 18, No. 3 (2017c), 163-178.
26 Park, D.-H., and J. Chung, "The effect of regulatory fit on consumer product attitude: advertisement fit vs. consumer reviews fit," The e-Business Studies, Vol. 15, No. 4 (2014), 127-148.   DOI
27 Park, H., "Relationship between emoticons and nonverbal behaviors in online chatting system: Emoticons as relational control mechanism," Journal of Communication Science, Vol. 5, No. 3 (2005), 273-302.
28 Park, Y., and D.-H. Park, "S/W developer's IT project participation: Focusing on the moderating role of regulatory focus on the effect of technology recency on participation intention," Knowledge Management Research, Vol. 18, No. 2 (2017), 45-63.
29 Pazzani, M. J., "A framework for collaborative, content-based and demographic filtering," Artificial intelligence review, Vol. 13, No. 5 (1999), 393-408.   DOI
30 Sarwar, B., G. Karypis, J. Konstan, and J. Riedl, "Item-based collaborative filtering recommendation algorithms," In Proceedings of the 10th international conference on World Wide Web, 2001, 285-295.
31 Park, D.-H., "The development of travel demand nowcasting model based on travelers' attention: focusing on web search traffic information," The Journal of Information Systems, Vol. 26, No. 3 (2017a), 171-185.   DOI
32 Hong, J., and J. Lee, "A study on KakaoTalk emoticons through self-representation and symbol characteristic,", Journal of Basic Design & Art, Vol. 15, No. 4 (2014), 495-505.
33 Semeraro, G., P. Lops, P. Basile, and M. de Gemmis, "Knowledge infusion into content-based recommender systems," In Proceedings of the third ACM conference on Recommender systems, 2009, 301-304.
34 Wolf, A., "Emotional expression online: Gender differences in emoticon use," Cyber Psychology & Behavior, Vol. 3, No. 5 (2000), 827-833.   DOI
35 Yang, K., N. Kim, and E. Jung, "A study on the user evaluation for design of game characters about traditional culture: Focused on preference of domestic and foreign game character design," Journal of the Korean Society of Design Culture, Vol. 20, No. 3 (2014), 333-342.
36 Choi, H., J., Lee, M. Kim, J. Kim, H. Cho, H. Lee and K. Yoon, "Music recommendation system based on user emotion and music mood," Summer Conference of Korea Society Broadcast Engineers Magazine, (2011), 142-145.
37 Choi, Y., and D.-H. Park, "Development of Youke mining system with Youke's travel demand and insight based on web search traffic information," Journal of Intelligence and Information Systems, Vol. 23, No. 3 (2017), 155-175.   DOI
38 Coyle, K., "Understanding metadata and its Purpose," The Journal of Academic Librarianship, Vol. 31, No. 2 (2005), 160-163.   DOI
39 Crystal, D., Language and the internet, 45, Cambridge University Press, 2001.
40 Halvorsen, A., "Patterns of emoticon usage in ESL students' Discussion Forum Writing," CALICO Journal, Vol. 29, No. 4 (2012), 694-717   DOI
41 Jack, R. E., O. G. Garrod, H. Yu, R. Caldara, and P. G. Schyns, "Facial expressions of emotion are not culturally universal,". Proceedings of the National Academy of Sciences, Vol. 109, No. 19 (2012), 7241-7244.   DOI
42 Jeon, K., "Analysis of the feature of the emotion expressional communication derived from comical texts: Focusing on cartooncon and character emoticon in MIM," Journal of Digital Design, Vol. 15, No. 4 (2015), 173-182.
43 Johnston, F. E., V. B. Van Hasselt and M. Hersen, "Rapport, empathy, and reflection," Basic interviewing: A practical guide for counselors and clinicians, 1998, 41-55.
44 Kang, H., "An analysis on synonymic relations of psychological adjectives," Korean Semantics, Vol. 17 (2005), 43-64.