• Journal of Intelligence and Information Systems
• /
• v.28 no.2
• /
• pp.171-189
• /
• 2022

Online reviews play an essential role in the consumer's purchasing decision-making process, and thus, providing helpful and reliable reviews is essential to consumers. Previous online review helpfulness prediction studies mainly predicted review helpfulness based on the consistency of text and rating information of online reviews. However, there is a limitation in that representation capacity or review text and rating interaction. We propose a CNN-RHP model that effectively learns the interaction between review text and rating information to improve the limitations of previous studies. Multi-channel CNNs were applied to extract the semantic representation of the review text. We also converted rating into independent high-dimensional embedding vectors representing the same dimension as the text vector. The consistency between the review text and the rating information is learned based on element-wise operations between the review text and the star rating vector. To evaluate the performance of the proposed CNN-RHP model in this study, we used online reviews collected from Amazom.com. Experimental results show that the CNN-RHP model indicates excellent performance compared to several benchmark models. The results of this study can provide practical implications when providing services related to review helpfulness on online e-commerce platforms.

• Journal of Intelligence and Information Systems
• /
• v.29 no.2
• /
• pp.35-56
• /
• 2023

With the development of information and communication technology, numerous reviews are continuously posted on websites, which causes information overload problems. Therefore, users face difficulty in exploring reviews for their decision-making. To solve such a problem, many studies on review helpfulness prediction have been actively conducted to provide users with helpful and reliable reviews. Existing studies predict review helpfulness mainly based on the features included in the review. However, such studies disable providing the reason why predicted reviews are helpful. Therefore, this study aims to propose a methodology for applying eXplainable Artificial Intelligence (XAI) techniques in review helpfulness prediction to address such a limitation. This study uses restaurant reviews collected from Yelp.com to compare the prediction performance of six models widely used in previous studies. Next, we propose an explainable review helpfulness prediction model by applying the XAI technique to the model with the best prediction performance. Therefore, the methodology proposed in this study can recommend helpful reviews in the user's purchasing decision-making process and provide the interpretation of why such predicted reviews are helpful.

• The Journal of Information Systems
• /
• v.32 no.3
• /
• pp.133-150
• /
• 2023

Purpose This study aims to develop classification models using a decision tree algorithm to identify core keywords and rules influencing online consumer review evaluations for the robot vacuum cleaner on Amazon.com. The difference from previous studies is that we analyze core keywords that affect the evaluation results by dividing the subjects that evaluate online consumer reviews into self-evaluation (star ratings) and peer evaluation (helpfulness votes). We investigate whether the core keywords influencing star ratings and helpfulness votes vary across different products and whether there is a similarity in the core keywords related to star ratings or helpfulness votes across all products. Design/methodology/approach We used random under-sampling to balance the dataset. We progressively removed independent variables based on decreasing importance through backwards elimination to evaluate the classification model's performance. As a result, we identified classification models that best predict star ratings and helpfulness votes for each product's online consumer reviews. Findings We have identified that the core keywords influencing self-evaluation and peer evaluation vary across different products, and even for the same model or features, the core keywords are not consistent. Therefore, companies' producers and marketing managers need to analyze the core keywords of each product to highlight the advantages and prepare customized strategies that compensate for the shortcomings.

• Journal of KIISE
• /
• v.43 no.9
• /
• pp.983-997
• /
• 2016

Many available online product reviews for any given product makes it difficult for a consumer to locate the helpful reviews. The purpose of this study was to investigate automatic helpfulness evaluation of online product reviews according to review information types based on the target of information. The underlying assumption was that consumers find reviews containing specific information related to the product itself or the reliability of reviewers more helpful than peripheral information, such as shipping or customer service. Therefore, each sentence was categorized by given information types, which reduced the semantic space of review sentences. Subsequently, we extracted specific information from sentences by using a topic-based representation of the sentences and a clustering algorithm. Review ranking experiments indicated more effective results than other comparable approaches.

• Journal of Information Technology Services
• /
• v.14 no.4
• /
• pp.159-169
• /
• 2015

Customer reviews are one of the important sources for purchase decision makings in online stores. Online stores have tried to provide useful reviews in product pages to customers. To assess the usefulness of customer reviews before other users have voted enough on the reviews, diverse aspects of reviews were utilized in prevous studies. Style and semantic information were utilized in many studies. This study aims to test diverse alogrithms and datasets for identifying a proper classification method and threshold to classify useful reviews. In particular, most researches utilized ratio type helpfulness index as Amazon.com used. However, there is another type of usefulness index utilized in TripAdviser.com or Yelp.com, count type helpfulness index. There was no proper threshold to classify useful reviews yet for count type helpfulness index. This study used reivews and their usefulness votes on restaurnats from Yelp.com to devise diverse datasets and applied text mining approaches to classify useful reviews. Random Forest, SVM, and GLMNET showed the greater values of accuracy than other approaches.

• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.33-44
• /
• 2017

With the development of the Internet environment, various types of online reviews are being generated and exchanged among consumers to share their opinions. In line with this trend, companies are making efforts to analyze online reviews and use the results in various business activities such as marketing, sales, and product development. However, research on online review in industry related to 'Video Game' which is representative experience goods has not been performed enough. Therefore, this study analyzed STEAM community review data using machine learning techniques. We analyzed the factors affecting the opinion of other users' game review. We also propose managerial implications to incease user loyalty and usability.

• The Journal of Information Systems
• /
• v.29 no.2
• /
• pp.173-195
• /
• 2020

Purpose The purpose of this study is to verify the effect of reviewer's attributes on review usefulness while exploring the variables that can moderate the relationship between reviewer's attributes and review usefulness through empirical analysis. Design/methodology/approach To understand the impact of online reviewer profiles on review usefulness and how these impacts change, this study collected more than 30,000 online reviews of restaurants through TripAdvisor.com, that is a representative OTA shares tourism information. We analyze the moderating effects of four variables such as review length, review equivocality, review uncertainty, and review readability. Findings According to the empirical analysis result, this study reveals that the reviewer's profile attribute can significantly improve the review usefulness of the reviewer, and confirmed the moderating effect of the review's attribute(Review length, Equivocality, Uncertainty, Readability).

• Korean Medical Education Review
• /
• v.13 no.1
• /
• pp.35-43
• /
• 2011

Purpose: Communication skills are considered as one of the essential requirements in medical education, and the training often involves exercising medical interviews with standardized patients(SP) or role play. This study investigated the helpfulness of the communication skills training programs for students' performance on the clinical performance examination (CPX). Methods: Fourth-year students who have taken one of two communication skills programs(exercising communication skills with SP or elective communication skill course with role play) completed a questionnaire on their evaluation of the helpfulness of communication skills programs immediately after finishing the CPX. Then, the programs were objectively assessed by comparing all fourth-year students' CPX scores between program participants and non-participants. Results: About 70% of participants answered that the programs were helpful to perform clinical clerkship and CPX. However, there was no difference in either the total CPX score or 2 categorical scores(integrated clinical encounter, communication and interpersonal skill) between program participants and non-participants. Conclusion: Although the students felt that the communication skills programs were helpful to their clinical activities, this study failed to find objective evidence of any effect of the programs on the CPX results. Communication skills training should be continued during clinical clerkship to maintain or enhance the skills, and it is necessary to introduce more effective methods for precise evaluation of students' communication skills.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.5
• /
• pp.1702-1716
• /
• 2015

Customer product reviews have become great influencers of purchase decision making. To assist potential customers, online stores provide various ways to sort customer reviews. Different methods have been developed to identify and recommend useful reviews to customers, primarily using feedback provided by customers about the helpfulness of reviews. Most of the methods consider the preferences of all users to determine whether reviews are helpful, and all users receive the same recommendations.

• Journal of Intelligence and Information Systems
• /
• v.23 no.3
• /
• pp.29-44
• /
• 2017

In Internet commerce, consumers are heavily influenced by product reviews written by other users who have already purchased the product. However, as the product reviews accumulate, it takes a lot of time and effort for consumers to individually check the massive number of product reviews. Moreover, product reviews that are written carelessly actually inconvenience consumers. Thus many online vendors provide mechanisms to identify reviews that customers perceive as most helpful (Cao et al. 2011; Mudambi and Schuff 2010). For example, some online retailers, such as Amazon.com and TripAdvisor, allow users to rate the helpfulness of each review, and use this feedback information to rank and re-order them. However, many reviews have only a few feedbacks or no feedback at all, thus making it hard to identify their helpfulness. Also, it takes time to accumulate feedbacks, thus the newly authored reviews do not have enough ones. For example, only 20% of the reviews in Amazon Review Dataset (Mcauley and Leskovec, 2013) have more than 5 reviews (Yan et al, 2014). The purpose of this study is to analyze the factors affecting the usefulness of online product reviews and to derive a forecasting model that selectively provides product reviews that can be helpful to consumers. In order to do this, we extracted the various linguistic, psychological, and perceptual elements included in product reviews by using text-mining techniques and identifying the determinants among these elements that affect the usability of product reviews. In particular, considering that the characteristics of the product reviews and determinants of usability for apparel products (which are experiential products) and electronic products (which are search goods) can differ, the characteristics of the product reviews were compared within each product group and the determinants were established for each. This study used 7,498 apparel product reviews and 106,962 electronic product reviews from Amazon.com. In order to understand a review text, we first extract linguistic and psychological characteristics from review texts such as a word count, the level of emotional tone and analytical thinking embedded in review text using widely adopted text analysis software LIWC (Linguistic Inquiry and Word Count). After then, we explore the descriptive statistics of review text for each category and statistically compare their differences using t-test. Lastly, we regression analysis using the data mining software RapidMiner to find out determinant factors. As a result of comparing and analyzing product review characteristics of electronic products and apparel products, it was found that reviewers used more words as well as longer sentences when writing product reviews for electronic products. As for the content characteristics of the product reviews, it was found that these reviews included many analytic words, carried more clout, and related to the cognitive processes (CogProc) more so than the apparel product reviews, in addition to including many words expressing negative emotions (NegEmo). On the other hand, the apparel product reviews included more personal, authentic, positive emotions (PosEmo) and perceptual processes (Percept) compared to the electronic product reviews. Next, we analyzed the determinants toward the usefulness of the product reviews between the two product groups. As a result, it was found that product reviews with high product ratings from reviewers in both product groups that were perceived as being useful contained a larger number of total words, many expressions involving perceptual processes, and fewer negative emotions. In addition, apparel product reviews with a large number of comparative expressions, a low expertise index, and concise content with fewer words in each sentence were perceived to be useful. In the case of electronic product reviews, those that were analytical with a high expertise index, along with containing many authentic expressions, cognitive processes, and positive emotions (PosEmo) were perceived to be useful. These findings are expected to help consumers effectively identify useful product reviews in the future.