Browse > Article
http://dx.doi.org/10.3837/tiis.2015.08.025

Comparing Machine Learning Classifiers for Movie WOM Opinion Mining  

Kim, Yoosin (Department of Management Information System, Chungbuk National University)
Kwon, Do Young (Graduate School of Business IT, Kookmin University)
Jeong, Seung Ryul (Graduate School of Business IT, Kookmin University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.9, no.8, 2015 , pp. 3169-3181 More about this Journal
Abstract
Nowadays, online word-of-mouth has become a powerful influencer to marketing and sales in business. Opinion mining and sentiment analysis is frequently adopted at market research and business analytics field for analyzing word-of-mouth content. However, there still remain several challengeable areas for 1) sentiment analysis aiming for Korean word-of-mouth content in film market, 2) availability of machine learning models only using linguistic features, 3) effect of the size of the feature set. This study took a sample of 10,000 movie reviews which had posted extremely negative/positive rating in a movie portal site, and conducted sentiment analysis with four machine learning algorithms: naïve Bayesian, decision tree, neural network, and support vector machines. We found neural network and support vector machine produced better accuracy than naïve Bayesian and decision tree on every size of the feature set. Besides, the performance of them was boosting with increasing of the feature set size.
Keywords
WOM; Opinion Mining; Machine Learning; NLP; Film Market;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 L. Garcia-Moya, H. Anaya-Sanchez, and R. Berlanga-Llavori, “Retrieving Product Features and Opinions from Customer Reviews,” IEEE Intell. Syst, vol. 28, no. 3, pp. 19–27, May 2013. Article (CrossRef Link).   DOI
2 E. Cambria, B. Schuller, Y. Xia, and C. Havasi, “New Avenues in Opinion Mining and Sentiment Analysis,” IEEE Intell. Syst., vol. 28, no. 2, pp. 15–21, Mar 2013. Article (CrossRef Link).   DOI
3 Y. Kim, S. R. Jeong, and I. Ghani, “Text Opinion Mining to Analyze News for Stock Market Prediction,” Int. J. Adv. Soft Comput. Its Appl., vol. 6, no. 1, 2014. Article (CrossRef Link).
4 H. Chen, “Business and Market Intelligence 2.0, Part 2,” IEEE Intell. Syst., vol. 25, no. 2, pp. 2–5, Mar 2010. Article (CrossRef Link).   DOI
5 Y. Wu, F. Wei, S. Liu, N. Au, W. Cui, H. Zhou, and H. Qu, “OpinionSeer: interactive visualization of hotel customer feedback,” IEEE Trans. Vis. Comput. Graph, vol. 16, no. 6, pp. 1109–18, 2010. Article (CrossRef Link).   DOI
6 H. Chen and D. Zimbra, “AI and Opinion Mining,” IEEE Intell. Syst., vol. 25, no. 3, pp. 74–76, May 2010. Article (CrossRef Link).   DOI
7 J. Lim and J. Kim, “An Empirical Comparison of Machine Learning Models for Classifying Emotions in Korean Twitter,” J. Korea Multimed. Soc, vol. 17, no. 2, pp. 232–239, 2014. Article (CrossRef Link)   DOI
8 Y. Liu, “Word of Mouth for Movies: Its Dynamics and Impact on Box Office Revenue,” J. Mark., vol. 70, no. 3, pp. 74–89, Jul 2006. Article (CrossRef Link).   DOI
9 H. Rui, Y. Liu, and A. Whinston, “Whose and what chatter matters? The effect of tweets on movie sales,” Decis. Support Syst., vol. 55, no. 4, pp. 863–870, Nov 2013. Article (CrossRef Link).   DOI
10 F. V. Wangenheim and T. Bayón, “The effect of word of mouth on services switching: Measurement and moderating variables,” Eur. J. Mark, vol. 38, no. 9/10, pp. 1173–1185, 2004. Article (CrossRef Link).   DOI
11 B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs up? Sentiment Classification using Machine Learning Techniques," in Proc. of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 79 - 86, 2002. Article (CrossRef Link).
12 Z. Zhang, Q. Ye, R. Law, and Y. Li, “The impact of e-word-of-mouth on the online popularity of restaurants: A comparison of consumer reviews and editor reviews,” Int. J. Hosp. Manag, vol. 29, no. 4, pp. 694–700, Dec 2010. Article (CrossRef Link).   DOI
13 S. Melian-Gonzalez, J. Bulchand-Gidumal, and B. Gonzalez Lopez-Valcarcel, “Online Customer Reviews of Hotels: As Participation Increases, Better Evaluation Is Obtained,” Cornell Hosp. Q., vol. 54, no. 3, pp. 274–283, Mar 2013. Article (CrossRef Link).   DOI
14 X. Lu, S. Ba, L. Huang, and Y. Feng, "Promotional Marketing or Word-of-Mouth? Evidence from Online Restaurant Reviews," Inf. Syst. Res., vol. 24, no.3, September 2013, pp. 596-612, Jan 2013. Article (CrossRef Link).   DOI
15 J. A. Chevalier and D. Mayzlin, “The Effect of Word of Mouth on Sales: Online Book Reviews,” J. Mark. Res, vol. 43, no. 3, pp. 345–354, Aug 2006. Article (CrossRef Link).   DOI
16 W. Duan, B. Gu, and A. B. Whinston, “Do online reviews matter? — An empirical investigation of panel data,” Decis. Support Syst, vol. 45, no. 4, pp. 1007–1016, Nov 2008. Article (CrossRef Link).   DOI
17 M. Mittermayer and G. Knolmayer, “NewsCATS: A News Categorization and Trading System,” Sixth Int. Conf. Data Min, pp. 1002–1007, Dec 2006. Article (CrossRef Link).
18 G. P. Sonnier, L. McAlister, and O. J. Rutz, “A Dynamic Model of the Effect of Online Communications on Firm Sales,” Mark. Sci, vol. 30, no. 4, pp. 702–716, Jul. 2011. Article (CrossRef Link).   DOI
19 Q. Ye, R. Law, B. Gu, and W. Chen, “The influence of user-generated content on traveler behavior: An empirical investigation on the effects of e-word-of-mouth to hotel online bookings,” Comput. Human Behav., vol. 27, no. 2, pp. 634–639, Mar 2011. Article (CrossRef Link).   DOI
20 V. Dhar and E. a. Chang, “Does Chatter Matter? The Impact of User-Generated Content on Music Sales,” J. Interact. Mark., vol. 23, no. 4, pp. 300–307, Nov 2009. Article (CrossRef Link).   DOI
21 J. Lee, I. Son, and D. Lee, “Does Online Social Network Contribute to WOM Effect on Product Sales ?,” J. Intell. Inforamtion Syst, vol. 18, no. 2, pp. 85–105, 2012. Article (CrossRef Link).
22 Y. Liu, Y. Chen, R. F. Lusch, H. Chen, D. Zimbra, and S. Zeng, “User-Generated Content on Social Media: Predicting Market Success with Online Word-on-Mouth,” IEEE Intell. Syst, vol. 25, no. 1, pp. 8–12, 2010. Article (CrossRef Link).   DOI
23 K. Floyd, R. Freling, S. Alhoqail, H. Y. Cho, and T. Freling, “How Online Product Reviews Affect Retail Sales: A Meta-analysis,” J. Retail., vol. 90, no. 2, pp. 217–232, Jun 2014. Article (CrossRef Link).   DOI
24 B. Pang and L. Lee, Opinion Mining and Sentiment Analysis. 2008. Article (CrossRef Link).
25 C. Hung and H.-K. Lin, “Using Objective Words in SentiWordNet to Improve Word-of-Mouth Sentiment Classification,” IEEE Intell. Syst, vol. 28, no. 2, pp. 47–54, Mar, 2013. Article (CrossRef Link).   DOI
26 J. Bollen, H. Mao, and X. Zeng, “Twitter mood predicts the stock market,” J. Comput. Sci, vol. 2, no. 1, pp. 1–8, Mar. 2011. Article (CrossRef Link).   DOI
27 Y. Yu, Y. Kim, N. Kim, and S. R. Jeong, “Predicting the Direction of the Stock Index by Using a Domain-Specific Sentiment Dictionary,” J. Intell. Inforamtion Syst, vol. 19, no. 1, pp. 95–110, 2013. Article (CrossRef Link).
28 Y. Rao, J. Lei, L. Wenyin, Q. Li, and M. Chen, "Building emotional dictionary for sentiment analysis of online news," in World Wide Web, 2013. Article (CrossRef Link).
29 R. P. Schumaker and H. Chen, “Textual analysis of stock market prediction using breaking financial news,” ACM Trans. Inf. Syst, vol. 27, no. 2, pp. 1–19, Feb, 2009. Article (CrossRef Link).   DOI
30 R. Schumaker and H. Chen, “A discrete stock price prediction engine based on financial news,” Computer (Long. Beach. Calif), no. January, pp. 51–56, 2010. Article (CrossRef Link).
31 B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs up? sentiment classification using machine learning techniques," in Proc. of 2002 Conf. Empir. Methods Nat. Lang. Process, pp. 79 - 86, 2002. Article (CrossRef Link).
32 W. Paik, M. H. Kyung, K. S. Min, H. R. Oh, C. Lim, and M. S. Shin, “Multi-stage News Classification System for Predicting Stock Price Changes,” J. Korean Soc. Inf. Manag, vol. 24, no. 2, pp. 123–141, 2007. Article (CrossRef Link).   DOI
33 J. H. Kietzmann, K. Hermkens, I. P. McCarthy, and B. S. Silvestre, “Social media? Get serious! Understanding the functional building blocks of social media,” Bus. Horiz., vol. 54, no. 3, pp. 241–251, May 2011. Article (CrossRef Link).   DOI