• Journal of Service Research and Studies
• /
• v.13 no.4
• /
• pp.191-205
• /
• 2023

Artificial Intelligence (AI), especially in the domain of text-generative services, has witnessed a significant surge, with forecasts indicating the AI-as-a-Service (AIaaS) market reaching a valuation of $55.0 Billion by 2028. This research set out to explore the quality dimensions characterizing synthetic text media software, with a focus on four key players in the industry: ChatGPT, Writesonic, Jasper, and Anyword. Drawing from a comprehensive dataset of over 4,000 reviews sourced from a software evaluation platform, the study employed the Latent Dirichlet Allocation (LDA) topic modeling technique using the Gensim library. This process resulted the data into 11 distinct topics. Subsequent analysis involved comparing these topics against established AI service quality dimensions, specifically AICSQ and AISAQUAL. Notably, the reviews predominantly emphasized dimensions like availability and efficiency, while others, such as anthropomorphism, which have been underscored in prior literature, were absent. This observation is attributed to the inherent nature of the reviews of AI services examined, which lean more towards semantic understanding rather than direct user interaction. The study acknowledges inherent limitations, mainly potential biases stemming from the singular review source and the specific nature of the reviewer demographic. Possible future research includes gauging the real-world implications of these quality dimensions on user satisfaction and to discuss deeper into how individual dimensions might impact overall ratings.

• Journal of the Korean Data and Information Science Society
• /
• v.26 no.6
• /
• pp.1259-1269
• /
• 2015

Recently, big data is positioning as a keyword in the academic circles. And usefulness of big data is carried into government, a local public body and enterprise as well as academic circles. Also they are endeavoring to obtain useful information in big data. This research mainly deals with analyses of box office success or failure of films using text mining. For data, it used a portal site 'D' and film review data, grade point average and the number of screens gained from the Korean Film Commission. The purpose of this paper is to propose a model to predict whether a film is success or not using these data. As a result of analysis, the correct classification rate by the prediction model method proposed in this paper is obtained 95.74%.

• Journal of Intelligence and Information Systems
• /
• v.27 no.3
• /
• pp.29-56
• /
• 2021

Recently, various types of products have been launched with the rapid growth of the e-commerce market. As a result, many users face information overload problems, which is time-consuming in the purchasing decision-making process. Therefore, the importance of a personalized recommendation service that can provide customized products and services to users is emerging. For example, global companies such as Netflix, Amazon, and Google have introduced personalized recommendation services to support users' purchasing decisions. Accordingly, the user's information search cost can reduce which can positively affect the company's sales increase. The existing personalized recommendation service research applied Collaborative Filtering (CF) technique predicts user preference mainly use quantified information. However, the recommendation performance may have decreased if only use quantitative information. To improve the problems of such existing studies, many studies using reviews to enhance recommendation performance. However, reviews contain factors that hinder purchasing decisions, such as advertising content, false comments, meaningless or irrelevant content. When providing recommendation service uses a review that includes these factors can lead to decrease recommendation performance. Therefore, we proposed a novel recommendation methodology through CNN-based review usefulness score prediction to improve these problems. The results show that the proposed methodology has better prediction performance than the recommendation method considering all existing preference ratings. In addition, the results suggest that can enhance the performance of traditional CF when the information on review usefulness reflects in the personalized recommendation service.

• Journal of Information Technology Services
• /
• v.16 no.4
• /
• pp.161-176
• /
• 2017

Recently, most of the users can easily get access to a variety of information sources about companies, products, and services through online channels. Therefore, the online user evaluations are becoming the most powerful tool to generate word of mouth. The user's evaluation is provided in two forms, quantitative rating and review text. The rating is then divided into an overall rating and a detailed rating according to various evaluation criteria. However, since it is a burden for the reviewer to complete all required ratings for each evaluation criteria, so most of the sites requested only mandatory inputs for overall rating and optional inputs for other evaluation criteria. In fact, many users input only the ratings for some of the evaluation criteria and the percentage of missed ratings for each criteria is about 40%. As these missed ratings are the missing values in each criteria, the simple average calculation by ignoring the average 40% of the missed ratings can sufficiently distort the actual phenomenon. Therefore, in this study, we propose a methodology to predict the rating for the missed values of each criteria by analyzing user's evaluation information included the overall rating and text review for each criteria. The experiments were conducted on 207,968 evaluations collected from the actual hotel evaluation site. As a result, it was confirmed that the prediction accuracy of the detailed criteria ratings by the proposed methodology was much higher than the existing average-based method.

• Asia-Pacific Journal of Business
• /
• v.15 no.1
• /
• pp.273-287
• /
• 2024

Purpose - This study conducts the co-occurrence analysis, one of the social network analysis using global OTA's online reviews and grades in order to understand the experience structure of foreign tourists visiting cutural tourism resources in Jeju, Korea. Design/methodology/approach - For this purpose, this study selects 6 cultural tourism resources in Jeju as the study sites, and collects qualitative review data (noun, adjectives, and verb) and quantitative grade data. Findings - The co-occurrence network analysis between words and grade of market and street shows that the grade of 5 appears the most simultaneous with pork, buy, lot, try, fresh, black, food, price, seafood, local, market, good, street, etc. and the grade of 1 connects with small, dish, better, taste, etc. And the co-occurrence network analysis between words and grade of tradition and folklore shows that the grade of 5 appears the most simultaneous with village, place, museum, visit, time, life, culture, women, diver, use, lot, etc. and the grade of 1 connects with minute, spend, room, recommend, honey, etc. Research implications or originality - The above research results are relevant in order to find out the core experience of foreign tourists using online review and grade generated by foreign tourists and use as the important information to develop the strategies related to the planning and management of cultural tourism resources.

• Journal of Intelligence and Information Systems
• /
• v.21 no.2
• /
• pp.1-18
• /
• 2015

Collaborative filtering(CF) algorithm has been popularly used for recommender systems in both academic and practical applications. A general CF system compares users based on how similar they are, and creates recommendation results with the items favored by other people with similar tastes. Thus, it is very important for CF to measure the similarities between users because the recommendation quality depends on it. In most cases, users' explicit numeric ratings of items(i.e. quantitative information) have only been used to calculate the similarities between users in CF. However, several studies indicated that qualitative information such as user's reviews on the items may contribute to measure these similarities more accurately. Considering that a lot of people are likely to share their honest opinion on the items they purchased recently due to the advent of the Web 2.0, user's reviews can be regarded as the informative source for identifying user's preference with accuracy. Under this background, this study proposes a new hybrid recommender system that combines with users' review mining. Our proposed system is based on conventional memory-based CF, but it is designed to use both user's numeric ratings and his/her text reviews on the items when calculating similarities between users. In specific, our system creates not only user-item rating matrix, but also user-item review term matrix. Then, it calculates rating similarity and review similarity from each matrix, and calculates the final user-to-user similarity based on these two similarities(i.e. rating and review similarities). As the methods for calculating review similarity between users, we proposed two alternatives - one is to use the frequency of the commonly used terms, and the other one is to use the sum of the importance weights of the commonly used terms in users' review. In the case of the importance weights of terms, we proposed the use of average TF-IDF(Term Frequency - Inverse Document Frequency) weights. To validate the applicability of the proposed system, we applied it to the implementation of a recommender system for smartphone applications (hereafter, app). At present, over a million apps are offered in each app stores operated by Google and Apple. Due to this information overload, users have difficulty in selecting proper apps that they really want. Furthermore, app store operators like Google and Apple have cumulated huge amount of users' reviews on apps until now. Thus, we chose smartphone app stores as the application domain of our system. In order to collect the experimental data set, we built and operated a Web-based data collection system for about two weeks. As a result, we could obtain 1,246 valid responses(ratings and reviews) from 78 users. The experimental system was implemented using Microsoft Visual Basic for Applications(VBA) and SAS Text Miner. And, to avoid distortion due to human intervention, we did not adopt any refining works by human during the user's review mining process. To examine the effectiveness of the proposed system, we compared its performance to the performance of conventional CF system. The performances of recommender systems were evaluated by using average MAE(mean absolute error). The experimental results showed that our proposed system(MAE = 0.7867 ~ 0.7881) slightly outperformed a conventional CF system(MAE = 0.7939). Also, they showed that the calculation of review similarity between users based on the TF-IDF weights(MAE = 0.7867) leaded to better recommendation accuracy than the calculation based on the frequency of the commonly used terms in reviews(MAE = 0.7881). The results from paired samples t-test presented that our proposed system with review similarity calculation using the frequency of the commonly used terms outperformed conventional CF system with 10% statistical significance level. Our study sheds a light on the application of users' review information for facilitating electronic commerce by recommending proper items to users.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.1
• /
• pp.265-274
• /
• 2021

In this paper, we propose a novel recommendation model based on Doc2vec using search keywords and product details. Until now, a lot of prior studies on recommender systems have proposed collaborative filtering (CF) as the main algorithm for recommendation, which uses only structured input data such as customers' purchase history or ratings. However, the use of unstructured data like online customer review in CF may lead to better recommendation. Under this background, we propose to use search keyword data and product detail information, which are seldom used in previous studies, for product recommendation. The proposed model makes recommendation by using CF which simultaneously considers ratings, search keywords and detailed information of the products purchased by customers. To extract quantitative patterns from these unstructured data, Doc2vec is applied. As a result of the experiment, the proposed model was found to outperform the conventional recommendation model. In addition, it was confirmed that search keywords and product details had a significant effect on recommendation. This study has academic significance in that it tries to apply the customers' online behavior information to the recommendation system and that it mitigates the cold start problem, which is one of the critical limitations of CF.

• Journal of Digital Convergence
• /
• v.16 no.3
• /
• pp.145-156
• /
• 2018

Unlike the past, when distributors distributed games through retail stores, they are now selling digital content, which is based on online distribution channels. This study analyzes the effects of eWOM (electronic Word of Mouth) on sales volume of game sold on Steam, an online digital content distribution channel. Recently, data mining techniques based on Big Data have been studied. In this study, emotion index of eWOM is derived by emotional analysis which is a text mining technique that can analyze the emotion of each review among factors of eWOM. Emotional analysis utilizes Naive Bayes and SVM classifier and calculates the emotion index through the SVM classifier with high accuracy. Regression analysis is performed on the dependent variable, sales variation, using the emotion index, the number of reviews of each game, the size of eWOM, and the user score of each game, which is a rating of eWOM. Regression analysis revealed that the size of the independent variable eWOM and the emotion index of the eWOM were influential on the dependent variable, sales variation. This study suggests the factors of eWOM that affect the sales volume when Korean game companies enter overseas markets based on steam.

• Knowledge Management Research
• /
• v.24 no.3
• /
• pp.95-125
• /
• 2023

As the aviation industry has rapidly been grown, there are more factors for customers to consider when choosing an airline. In response, airlines are trying to increase customer value by providing high-quality services and differentiated experiential value. While early customer value research centered on utilitarian value, which is the trade-off between cost and benefit in terms of utility for products and services, the importance of experiential value has recently been emphasized. However, experiential value needs to be studied in a specific context that fully represents customer preferences because what constitutes customer value changes depending on the product or service context. In addition, customer value has an important influence on customers' decision-making, so it is necessary for airlines to accurately understand what constitutes customer value. In this study, we collected customer reviews and ratings from Skytrax, a website specializing in airlines, and utilized the BERTopic technique to derive factors of customer value. The results revealed nine factors that constitute customer value in airlines, and six of them are related to customer satisfaction. This study proposes a new methodology that enables a granular understanding of customer value and provides airlines with specific directions for improving service quality.

• Journal of Korea Multimedia Society
• /
• v.13 no.3
• /
• pp.475-486
• /
• 2010

Contents Recommender System predicts user's preferences towards contents, and then recommends highly-predicted contents to user. Digital Identifier plays its part in identifying abstract works or digital contents in digital network environment. Digital Identifier could be effectively used in content-based filtering and collaborative filtering that are mainly used in Contents Recommender Systems. Therefore, this paper proposes an improvement of UCI metadata and resolution service for effective use of UCI in massive contents recommender systems. UCI metadata is expanded by adding elements such as abstract, keyword, genre, age, rate and review. Resolution service allows the operation systems to collect user preference for content by including input part of preference in a result page. This paper also designs and implements an improved UCI operation system and shows that the proposed improvement of UCI metadata and resolution service could be used for massive contents recommendation.