Browse > Article
http://dx.doi.org/10.9717/kmms.2014.17.9.1125

A User Emotion Information Measurement Using Image and Text on Instagram-Based  

Nam, Minji (Dept. of SW Convergence Engineering, Graduate School of Industrial Technology Convergence, Chosun University)
Kim, Jeongin (Dept. of Computer Engineering, Chosun University)
Shin, Juhyun (Dept. of Control and Measuring Robot Engineering, Chosun University)
Publication Information
Abstract
Recently, there are many researches have been studying for analyzing user interests and emotions based on users profiles and diverse information from Social Network Services (SNSs) due to their popularities. However, most of traditional researches are focusing on their researches based on single resource such as text, image, hash tag, and more, in order to obtain what user emotions are. Hence, this paper propose a method for obtaining user emotional information by analyzing texts and images both from Instagram which is one of the well-known image based SNSs. In order to extract emotional information from given images, we firstly apply GRAB-CUT algorithm to retrieve objects from given images. These retrieved objects will be regenerated by their representative colors, and compared with emotional vocabulary table for extracting which vocabularies are the most appropriate for the given images. Afterward, we will extract emotional vocabularies from text information in the comments for the given images, based on frequencies of adjective words. Finally, we will measure WUP similarities between adjective words and emotional words which extracted from the previous step. We believe that it is possible to obtain more precise user emotional information if we analyzed images and texts both time.
Keywords
Social Networking Services; Instagram; User Emotion Information; Emotion analysis;
Citations & Related Records
Times Cited By KSCI : 8  (Citation Analysis)
연도 인용수 순위
1 Q. Xu and Y.H. Pan, "Development of User-defined Weight List for Increasing the Usability of News Feed in Social Networking Services: based on Sina Weibo in China," The Human Computer Interaction Society of Korea, Vol. 2014, No. 2, pp. 707-711, 2014.
2 J.I. Kim, D.J. Choi, B.K. Ko, E.J. Lee, and P.K. Kim, "Extracting User Interests on Facebook," International Journal of Distributed Sensor Networks, Vol. 2014, No. 2014, pp. 1-5, 2014.
3 E.K. Chung and J.W. Yoon, "An Analysis of Image Use in Twitter Message," Korean Biblia Society for Library and Information Science, Vol. 24, No. 4, pp. 75-90, 2013.   과학기술학회마을   DOI
4 D.H. Kim and K.H. Seo, "Applying Emotional Information Retrieval Method to Information Appliances Design-The Use of Color Information for Mobile Emotion Retrieval System," Korean Journal of the Science of Emotion & Sensibility, Vol. 13, No. 3, pp. 501-510, 2010.   과학기술학회마을
5 N. Gunawardena, J. Plumb, N. Xiao, and H. Zhang, "Instagram Hashtag Sentiment Analysis," 2013.
6 I.S. Kang, "A Comparative Study on Using SentiWordNet for English Twitter sentiment Analysis," Journal of Korean Institute of Intelligent Systems, Vol. 23, No. 4, pp. 317-324, 2013.   과학기술학회마을   DOI   ScienceOn
7 J.S. Lim and J.M. Kim, "An Empirical Comparison of Machine Learning Models for Classifying Emotions in Korean Twitter," Journal of Korea Multimedia Society, Vol. 17, No. 2, pp. 232-239, 2014.   과학기술학회마을   DOI
8 C. Rother, V. Kolmogorov, and A. Blake, ""GrabCut"-Interactive Foreground Extraction using Iterated Graph Cuts," Association for Computing Machinery Transactions on Graphics, Vol. 23, Issue 3, pp. 309-314, 2004.
9 Understanding the Meaning of Colors in Color Psychology(2009) http://www.empower-yourself-with-color-psychology.com/. (accessed April, 1. 2014)
10 Vertical Social Networking Service(2014). http:// terms.naver.com/entry.nhn?doc Id=2073602 &cid=390&categoryId=390. (accessed April, 1. 2014)
11 G.A. Miller, "WordNet: A Lexical Database for English," Communications of the Association for Computing Machinery, Vol. 38, Issue 11, pp. 39-41, 1995.
12 J.G. Cho, "A New Word Semantic Similarity Measure Method based on WordNet," The Journal of Korean Institute of Information Technology, Vol. 11, Issue 7, pp. 121-129, 2013.
13 Z. Wu and M. Palmer, "Verb Semantics and Lexical Selection," Proceedings of the 3 2nd Annual Meetings on Associations for Computational Linguistics, pp. 133-138, 1994.
14 E.G. Kwon, J.W. Kim, N.J. Heo, and S.G. Kang, "Personalized Recommendation System using Level of Cosine Similarity of Emotion Word from Social Network," Journal of Information Technology and Architecture, Vol. 9, No. 3, pp. 333-344, 2012.
15 H.Y. Lee, E.Y. Lee, E.H. Gu, I. Choi, B.J. Choi, G.S. Ryu, et al., "IR Image Segmentation using GrabCut," Journal of Korean Institute of Intelligent Systems, Vol. 21, No. 2, pp. 260-267, 2011.   과학기술학회마을   DOI
16 M.J. Nam, J.I. Kim, and J.H. Shin, "A Method for User Emotion Information Measuring on Instagram-Based," Proceedings of the Korea Multimedia Society Conference, Vol. 17, No. 1, pp. 112-115, 2014.
17 B.H. Back, I.K. Ha, and B.C. Ahn, "An Extraction Method of Sentiment Information from Unstructed Big Data on SNS," Journal of Korea Multimedia Society, Vol. 17, No. 6, pp. 671-680, 2014.   DOI
18 J.H. Cho, "Psychology Analysis using Color Histogram Clustering," The Journal of The Korea Institute of Electronic Communication Science, Vol. 8, No. 3, pp. 415-420, 2013.   과학기술학회마을   DOI   ScienceOn
19 H.S. Song, "A Study on Emotional Color for Relaxation and Distress in Visual Media," The Treatise on The Plastic Media, Vol. 15, No. 1, pp. 93-102, 2012.