A Study on Market Size Estimation Method by Product Group Using Word2Vec Algorithm (Word2Vec을 활용한 제품군별 시장규모 추정 방법에 관한 연구)
-
- Journal of Intelligence and Information Systems
- /
- v.26 no.1
- /
- pp.1-21
- /
- 2020
With the rapid development of artificial intelligence technology, various techniques have been developed to extract meaningful information from unstructured text data which constitutes a large portion of big data. Over the past decades, text mining technologies have been utilized in various industries for practical applications. In the field of business intelligence, it has been employed to discover new market and/or technology opportunities and support rational decision making of business participants. The market information such as market size, market growth rate, and market share is essential for setting companies' business strategies. There has been a continuous demand in various fields for specific product level-market information. However, the information has been generally provided at industry level or broad categories based on classification standards, making it difficult to obtain specific and proper information. In this regard, we propose a new methodology that can estimate the market sizes of product groups at more detailed levels than that of previously offered. We applied Word2Vec algorithm, a neural network based semantic word embedding model, to enable automatic market size estimation from individual companies' product information in a bottom-up manner. The overall process is as follows: First, the data related to product information is collected, refined, and restructured into suitable form for applying Word2Vec model. Next, the preprocessed data is embedded into vector space by Word2Vec and then the product groups are derived by extracting similar products names based on cosine similarity calculation. Finally, the sales data on the extracted products is summated to estimate the market size of the product groups. As an experimental data, text data of product names from Statistics Korea's microdata (345,103 cases) were mapped in multidimensional vector space by Word2Vec training. We performed parameters optimization for training and then applied vector dimension of 300 and window size of 15 as optimized parameters for further experiments. We employed index words of Korean Standard Industry Classification (KSIC) as a product name dataset to more efficiently cluster product groups. The product names which are similar to KSIC indexes were extracted based on cosine similarity. The market size of extracted products as one product category was calculated from individual companies' sales data. The market sizes of 11,654 specific product lines were automatically estimated by the proposed model. For the performance verification, the results were compared with actual market size of some items. The Pearson's correlation coefficient was 0.513. Our approach has several advantages differing from the previous studies. First, text mining and machine learning techniques were applied for the first time on market size estimation, overcoming the limitations of traditional sampling based- or multiple assumption required-methods. In addition, the level of market category can be easily and efficiently adjusted according to the purpose of information use by changing cosine similarity threshold. Furthermore, it has a high potential of practical applications since it can resolve unmet needs for detailed market size information in public and private sectors. Specifically, it can be utilized in technology evaluation and technology commercialization support program conducted by governmental institutions, as well as business strategies consulting and market analysis report publishing by private firms. The limitation of our study is that the presented model needs to be improved in terms of accuracy and reliability. The semantic-based word embedding module can be advanced by giving a proper order in the preprocessed dataset or by combining another algorithm such as Jaccard similarity with Word2Vec. Also, the methods of product group clustering can be changed to other types of unsupervised machine learning algorithm. Our group is currently working on subsequent studies and we expect that it can further improve the performance of the conceptually proposed basic model in this study.
Thanks to the rapid development of information technologies, the data available on Internet have grown rapidly. In this era of big data, many studies have attempted to offer insights and express the effects of data analysis. In the tourism and hospitality industry, many firms and studies in the era of big data have paid attention to online reviews on social media because of their large influence over customers. As tourism is an information-intensive industry, the effect of these information networks on social media platforms is more remarkable compared to any other types of media. However, there are some limitations to the improvements in service quality that can be made based on opinions on social media platforms. Users on social media platforms represent their opinions as text, images, and so on. Raw data sets from these reviews are unstructured. Moreover, these data sets are too big to extract new information and hidden knowledge by human competences. To use them for business intelligence and analytics applications, proper big data techniques like Natural Language Processing and data mining techniques are needed. This study suggests an analytical approach to directly yield insights from these reviews to improve the service quality of hotels. Our proposed approach consists of topic mining to extract topics contained in the reviews and the decision tree modeling to explain the relationship between topics and ratings. Topic mining refers to a method for finding a group of words from a collection of documents that represents a document. Among several topic mining methods, we adopted the Latent Dirichlet Allocation algorithm, which is considered as the most universal algorithm. However, LDA is not enough to find insights that can improve service quality because it cannot find the relationship between topics and ratings. To overcome this limitation, we also use the Classification and Regression Tree method, which is a kind of decision tree technique. Through the CART method, we can find what topics are related to positive or negative ratings of a hotel and visualize the results. Therefore, this study aims to investigate the representation of an analytical approach for the improvement of hotel service quality from unstructured review data sets. Through experiments for four hotels in Hong Kong, we can find the strengths and weaknesses of services for each hotel and suggest improvements to aid in customer satisfaction. Especially from positive reviews, we find what these hotels should maintain for service quality. For example, compared with the other hotels, a hotel has a good location and room condition which are extracted from positive reviews for it. In contrast, we also find what they should modify in their services from negative reviews. For example, a hotel should improve room condition related to soundproof. These results mean that our approach is useful in finding some insights for the service quality of hotels. That is, from the enormous size of review data, our approach can provide practical suggestions for hotel managers to improve their service quality. In the past, studies for improving service quality relied on surveys or interviews of customers. However, these methods are often costly and time consuming and the results may be biased by biased sampling or untrustworthy answers. The proposed approach directly obtains honest feedback from customers' online reviews and draws some insights through a type of big data analysis. So it will be a more useful tool to overcome the limitations of surveys or interviews. Moreover, our approach easily obtains the service quality information of other hotels or services in the tourism industry because it needs only open online reviews and ratings as input data. Furthermore, the performance of our approach will be better if other structured and unstructured data sources are added.
As relationship between buyer and seller has been brought closer and long-term relationship has been more important in B2B markets, the importance of service and service convenience increases as well as product. In homogeneous markets, where service offerings are similar and therefore not key competitive differentiator, providing greater convenience may enable a competitive advantage. Service convenience, as conceptualized by Berry et al. (2002), is defined as the consumers' time and effort perceptions related to buying or using a service. For this reason, B2B customers are interested in how fast the service is provided and how much save non-monetary cost like time or effort by the service convenience along with service quality. Therefore, this study attempts to investigate the impact of service convenience on relationship factors such as relationship satisfaction, relationship commitment, and relationship performance. The purpose of this study is to find out whether service convenience can be a new antecedent of relationship quality and relationship performance. In addition, this study tries to examine how five-dimensional service convenience constructs (decision convenience, access convenience, transaction convenience, benefit convenience, post-benefit convenience) affect customers' relationship satisfaction, relationship commitment, and relationship performance. The service convenience comprises five fundamental components - decision convenience (the perceived time and effort costs associated with service purchase or use decisions), access convenience(the perceived time and effort costs associated with initiating service delivery), transaction convenience(the perceived time and effort costs associated with finalizing the transaction), benefit convenience(the perceived time and effort costs associated with experiencing the core benefits of the offering) and post-benefit convenience (the perceived time and effort costs associated with reestablishing subsequent contact with the firm). Earlier studies of perceived service convenience in the industrial market are none. The conventional studies that have dealt with service convenience have usually been made in the consumer market, or they have dealt with convenience aspects in the service process. This service convenience measure for consumer market can be useful tool to estimate service quality in B2B market. The conceptualization developed by Berry et al. (2002) reflects a multistage, experiential consumption process in which evaluations of convenience vary at each stage. For this reason, the service convenience measure is good for B2B service environment which has complex processes and various types. Especially when categorizing B2B service as sequential stage of service delivery like Kumar and Kumar (2004), the Berry's service convenience measure which reflect sequential flow of service deliveries suitable to establish B2B service convenience. For this study, data were gathered from respondents who often buy business service and analyzed by structural equation modeling. The sample size in the present study is 119. Composite reliability values and average variance extracted values were examined for each variable to have reliability. We determine whether the measurement model supports the convergent validity by CFA, and discriminant validity was assessed by examining the correlation matrix of the constructs. For each pair of constructs, the square root of the average variance extracted exceeded their correlations, thus supporting the discriminant validity of the constructs. Hypotheses were tested using the Smart PLS 2.0 and we calculated the PLS path values and followed with a bootstrap re-sampling method to test the hypotheses. Among the five dimensional service convenience constructs, four constructs (decision convenience, transaction convenience, benefit convenience, post-benefit convenience) affected customers' positive relationship satisfaction, relationship commitment, and relationship performance. This result means that service convenience is important cue to improve relationship between buyer and seller. One of the five service convenience dimensions, access convenience, does not affect relationship quality and performance, which implies that the dimension of service convenience is not important factor of cumulative satisfaction. The Cumulative satisfaction can be distinguished from transaction-specific customer satisfaction, which is an immediate post-purchase evaluative judgment or an affective reaction to the most recent transactional experience with the firm. Because access convenience minimizes the physical effort associated with initiating an exchange, the effect on relationship satisfaction similar to cumulative satisfaction may be relatively low in terms of importance than transaction-specific customer satisfaction. Also, B2B firms focus on service quality, price, benefit, follow-up service and so on than convenience of time or place in service because it is relatively difficult to change existing transaction partners in B2B market compared to consumer market. In addition, this study using partial least squares methods reveals that customers' satisfaction and commitment toward relationship has mediating role between the service convenience and relationship performance. The result shows that management and investment to improve service convenience make customers' positive relationship satisfaction, and then the positive relationship satisfaction can enhance the relationship commitment and relationship performance. And to conclude, service convenience management is an important part of successful relationship performance management, and the service convenience is an important antecedent of relationship between buyer and seller such as the relationship commitment and relationship performance. Therefore, it has more important to improve relationship performance that service providers enhance service convenience although competitive service development or service quality improvement is important. Given the pressure to provide increased convenience, it is not surprising that organizations have made significant investments in enhancing the convenience aspect of their product and service offering.