Browse > Article
http://dx.doi.org/10.13088/jiis.2017.23.3.029

Impact of Semantic Characteristics on Perceived Helpfulness of Online Reviews  

Park, Yoon-Joo (Department of Business Administration, Seoul National University of Science and Technology)
Kim, Kyoung-jae (Department of MIS, Dongguk University_Seoul)
Publication Information
Journal of Intelligence and Information Systems / v.23, no.3, 2017 , pp. 29-44 More about this Journal
Abstract
In Internet commerce, consumers are heavily influenced by product reviews written by other users who have already purchased the product. However, as the product reviews accumulate, it takes a lot of time and effort for consumers to individually check the massive number of product reviews. Moreover, product reviews that are written carelessly actually inconvenience consumers. Thus many online vendors provide mechanisms to identify reviews that customers perceive as most helpful (Cao et al. 2011; Mudambi and Schuff 2010). For example, some online retailers, such as Amazon.com and TripAdvisor, allow users to rate the helpfulness of each review, and use this feedback information to rank and re-order them. However, many reviews have only a few feedbacks or no feedback at all, thus making it hard to identify their helpfulness. Also, it takes time to accumulate feedbacks, thus the newly authored reviews do not have enough ones. For example, only 20% of the reviews in Amazon Review Dataset (Mcauley and Leskovec, 2013) have more than 5 reviews (Yan et al, 2014). The purpose of this study is to analyze the factors affecting the usefulness of online product reviews and to derive a forecasting model that selectively provides product reviews that can be helpful to consumers. In order to do this, we extracted the various linguistic, psychological, and perceptual elements included in product reviews by using text-mining techniques and identifying the determinants among these elements that affect the usability of product reviews. In particular, considering that the characteristics of the product reviews and determinants of usability for apparel products (which are experiential products) and electronic products (which are search goods) can differ, the characteristics of the product reviews were compared within each product group and the determinants were established for each. This study used 7,498 apparel product reviews and 106,962 electronic product reviews from Amazon.com. In order to understand a review text, we first extract linguistic and psychological characteristics from review texts such as a word count, the level of emotional tone and analytical thinking embedded in review text using widely adopted text analysis software LIWC (Linguistic Inquiry and Word Count). After then, we explore the descriptive statistics of review text for each category and statistically compare their differences using t-test. Lastly, we regression analysis using the data mining software RapidMiner to find out determinant factors. As a result of comparing and analyzing product review characteristics of electronic products and apparel products, it was found that reviewers used more words as well as longer sentences when writing product reviews for electronic products. As for the content characteristics of the product reviews, it was found that these reviews included many analytic words, carried more clout, and related to the cognitive processes (CogProc) more so than the apparel product reviews, in addition to including many words expressing negative emotions (NegEmo). On the other hand, the apparel product reviews included more personal, authentic, positive emotions (PosEmo) and perceptual processes (Percept) compared to the electronic product reviews. Next, we analyzed the determinants toward the usefulness of the product reviews between the two product groups. As a result, it was found that product reviews with high product ratings from reviewers in both product groups that were perceived as being useful contained a larger number of total words, many expressions involving perceptual processes, and fewer negative emotions. In addition, apparel product reviews with a large number of comparative expressions, a low expertise index, and concise content with fewer words in each sentence were perceived to be useful. In the case of electronic product reviews, those that were analytical with a high expertise index, along with containing many authentic expressions, cognitive processes, and positive emotions (PosEmo) were perceived to be useful. These findings are expected to help consumers effectively identify useful product reviews in the future.
Keywords
review text; helpfulness; text mining; LIWC; prediction model;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 McAuley, J., R. Pandey, and J. Leskovec (2015), "Inferring Networks of Substitutable and Complementary Products", In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.785-794.
2 Mudambi, S.M. and D. Schuff (2010), "What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.com", MIS Quarterly, vol.34(1), pp.185-200.   DOI
3 Pan, Y., and J. Q. Zhang (2011) "Born unequal: a study of the helpfulness of user-generated product reviews", Journal of Retailing, vol.87(4), pp.598-612.   DOI
4 Wan, Y. (2015), The Matthew Effect in Social Commerce, Electronic Markets, pp.1-12.
5 Yin, G., L. Wei, W. Xu, and M. Chen (2014), "Exploring Heuristic Cues for Consumer Perceptions of Online Reviews Helpfulness: The Case of Yelp. com.", PACIS 2014 Proceedings, 52.
6 Baek, H., J. Ahn, and Y. Choi (2012), "Helpfulness of Online Consumer Revers: Reader's Objectives and Review Cues", International Journal of Electronic Commerce, vol.17 (2), pp.99-126.   DOI
7 Choi, J.-W., and H.-J. Lee, "The Effects of Customer Product Review on Social Presence in Personalized Recommender Systems", Journal of Intelligence and Information Systems, Vol. 17, No. 3 (2011), 115-130.
8 Cao, Q., D., W. J., and Gan, Q. W (2011). "Exploring Determinants of Voting for the 'Helpfulness' of Online User Reviews: A Text Mining Approach," Decision Support Systems, vol.50 (2), pp.511-521.   DOI
9 Chevalier, J. A. & D. Mayzlin, (2003), "The Effect of Word of Mouth on Sales: Online Book Reviews", Journal of Marketing Research, vol.43(3), pp.345-354.   DOI
10 Cho, S.-H., M.Y. Yi (2014), "Business Implications of the Factors that Determine Online Review Helpfulness", Entrue Journal of Information Technology, vol.13(1), pp.29-40.
11 Forman, C., A. Ghose, B. Wiesenfeld (2008), "Examining the Relationship between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets", Information Systems Research, vol.19(3), pp.291-313.   DOI
12 Kim, Y., and M. Song, "A Study on Analyzing Sentiments on Movie Reviews by Multi-Level Sentiment Classifier", Journal of Intelligence and Information Systems, Vol. 22, No. 3 (2016), 71-89.   DOI
13 Ghose, A. and P.G. Ipeirotis (2011), "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics", IEEE Transactions on Knowledge and Data Engineering, vol.23 (10), pp.1498-1512.   DOI
14 Hong, Won Eui, M.Y. Yi (2015), "Helpfulness in Unhelpfulness: A Study of the Flip Side of the Coin on Review Helpfulness", KAIST MS. thesis
15 Hyunmi Baek, J. H. Ahn, S. W. Ha (2011), "Identifying Factors Affecting Helpfulness of Online Reviews: The Moderating Role of Product Price", The Journal of Society for e-Business Studies, vol.16(3), pp.93-112.
16 Lee, S.J. Lee, J. Y. Choeh, J. H. Choi (2014), "The Determinant Factors Affecting Economic Impact, Helpfulness, and Helpfulness Votes of Online", Journal of IT Service, vol.13(1), pp.43-55.   DOI
17 Korfiatis, N., E. Garcia-Bariocanal, and S. Sanchez-Alonso (2012), "Evaluating Content Quality and Helpfulness of Online Product Reviews: The Interplay of Review Helpfulness vs. Review Content", Electronic Commerce Research and Applications, vol.11(3), pp.205-217.   DOI
18 Lee, G.N, Y.J. Won, C.H. Cho, G.H Lee, E.A. Na, H.S. Hwang and M.J. Shin, 2010 Survey on the Internet Usage, Seoul: Korea Internet & Security Agency, 2010.
19 Lee, H. G., H. Kwak (2013), "Investigation of Factors Affecting the Effects of Online Consumer Reviews", Informatization Policy, vol.20(3), pp.3-17.
20 Lee, M., and H. J. Lee, "Increasing Accuracy of Classifying Useful Reviews by Removing Neutral Terms", Journal of Intelligence and Information Systems, Vol. 22, No. 3 (2016), 129-142.   DOI
21 Mahony, M. P., & B. B. Smyth (2010), A Classification-Based Review Recommender", Knowledge-Based Systems, vol.23(4), pp.323 -329.   DOI
22 McAuley and Leskovec2013] Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: Understanding rating dimensions with review text. In Proceedings of the 7th ACM Conference on Recommender Systems, RecSys' 13, pp.165-172.