How to improve the accuracy of recommendation systems: Combining ratings and review texts sentiment scores (평점과 리뷰 텍스트 감성분석을 결합한 추천시스템 향상 방안 연구)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.219-239
- /
- 2019
As the importance of providing customized services to individuals becomes important, researches on personalized recommendation systems are constantly being carried out. Collaborative filtering is one of the most popular systems in academia and industry. However, there exists limitation in a sense that recommendations were mostly based on quantitative information such as users' ratings, which made the accuracy be lowered. To solve these problems, many studies have been actively attempted to improve the performance of the recommendation system by using other information besides the quantitative information. Good examples are the usages of the sentiment analysis on customer review text data. Nevertheless, the existing research has not directly combined the results of the sentiment analysis and quantitative rating scores in the recommendation system. Therefore, this study aims to reflect the sentiments shown in the reviews into the rating scores. In other words, we propose a new algorithm that can directly convert the user 's own review into the empirically quantitative information and reflect it directly to the recommendation system. To do this, we needed to quantify users' reviews, which were originally qualitative information. In this study, sentiment score was calculated through sentiment analysis technique of text mining. The data was targeted for movie review. Based on the data, a domain specific sentiment dictionary is constructed for the movie reviews. Regression analysis was used as a method to construct sentiment dictionary. Each positive / negative dictionary was constructed using Lasso regression, Ridge regression, and ElasticNet methods. Based on this constructed sentiment dictionary, the accuracy was verified through confusion matrix. The accuracy of the Lasso based dictionary was 70%, the accuracy of the Ridge based dictionary was 79%, and that of the ElasticNet (
Brown and Dacin (1997) have investigated the relationship between corporate associations and product evaluations. Their study focused on the effects of associations with a company's corporate ability (CA) and its corporate social responsibility (CSR) on consumers' product evaluations. Their study has found that both of CA and CSR influenced product evaluation but CA association has a stronger effect than CSR associations. Brown and Dacin (1997) have, however, claimed that there are few researches on how corporate association impacts product responses. Accordingly, some of researchers have found the variables to moderate or to mediate the relationship between the corporate association and the product responses. In particular, there has been existed a few of studies that tested the influence of the reputation on the product-relevant perceived risk, but the effects of two types of the corporate association on the product-relevant perceived risk were not identified so far. The primary goal of this article is to identify and empirically examine some variables to moderate the effects of CA association and CSR association on the perceived risk of the product. In this articles, we take the concept of the corporate associations that Brown and Dacin (1997) had proposed. CA association is those association related to the company's expertise in producing and delivering its outputs and CSR association reflected the organization's status and activities with respect to its perceived societal obligations. Also, this study defines the risk, which is the uncertainty or loss of the product and corporate that consumers have taken in a particular purchase decision or after having purchased. The risk is classified into product-relevant performance risk and financial risk. Performance risk is the possibility or the consequence of a product not functioning at some expected level and financial risk is the monetary loss one perceives to be incurring if a product does not function at some expected level. In relation to consumer's knowledge, expert consumers have much of the experiences or knowledge of the product in consumer position and novice consumers does not. The model tested in this article are shown in Figure 1. The model indicates that both of CA association and CSR association influence on performance risk and financial risk. In addition, the effects of CA and CSR are moderated by product category knowledge (product knowledge) and product category involvement (product involvement). In this study, the relationships between the corporate association and product-relevant perceived risk are hypothesized as the following form. For example, Hypothesis 1a(
The endeavors enhancing the grain quality of high-yielding japonica rice were steadily continued during 1980s-1990s along with the self-sufficiency of rice production and the increasing demands of high-quality rices. During this time, considerably great progress and success was obtained in development of high-quality japonica cultivars and quality evaluation techniques including the elucidation of interrelationship between the physicochemical properties of rice grain and the physical or palatability components of cooked rice. In 1990s, some high-quality japonica rice cultivars and special rices adaptable for food processing such as large kernel, chalky endosperm, aromatic and colored rices were developed and its objective preference and utility was also examined by a palatability meter, rapid-visco analyzer and texture analyzer, Recently, new special rices such as extremely low-amylose dull or opaque non-glutinous endosperm mutants were developed. Also, a high-lysine rice variety was developed for higher nutritional utility. The water uptake rate and the maximum water absorption ratio showed significantly negative correlations with the K/Mg ratio and alkali digestion value(ADV) of milled rice. The rice materials showing the higher amount of hot water absorption exhibited the larger volume expansion of cooked rice. The harder rices with lower moisture content revealed the higher rate of water uptake at twenty minutes after soaking and the higher ratio of maximum water uptake under the room temperature condition. These water uptake characteristics were not associated with the protein and amylose contents of milled rice and the palatability of cooked rice. The water/rice ratio (in w/w basis) for optimum cooking was averaged to 1.52 in dry milled rices (12% wet basis) with varietal range from 1.45 to 1.61 and the expansion ratio of milled rice after proper boiling was average to 2.63(in v/v basis). The major physicochemical components of rice grain associated with the palatability of cooked rice were examined using japonica rice materials showing narrow varietal variation in grain size and shape, alkali digestibility, gel consistency, amylose and protein contents, but considerable difference in appearance and texture of cooked rice. The glossiness or gross palatability score of cooked rice were closely associated with the peak, hot paste and consistency viscosities of viscosities with year difference. The high-quality rice variety "IIpumbyeo" showed less portion of amylose on the outer layer of milled rice grain and less and slower change in iodine blue value of extracted paste during twenty minutes of boiling. This highly palatable rice also exhibited very fine net structure in outer layer and fine-spongy and well-swollen shape of gelatinized starch granules in inner layer and core of cooked rice kernel compared with the poor palatable rice through image of scanning electronic microscope. Gross sensory score of cooked rice could be estimated by multiple linear regression formula, deduced from relationship between rice quality components mentioned above and eating quality of cooked rice, with high probability of determination. The
As business incubation centers (BICs) have been operating for more than 10 years in Korea, many early stage startups tend to use the services provided by the incubating centers. BICs in Korea have accumulated the knowledge and experience in the past ten years and their services have been considerably improved. The business incubating service has three facets : (1) business infrastructure service, (2) direct service, and (3) indirect service. The mission of BICs is to provide the early stage entrepreneurs with the incubating service in a limited period time to help them grow strong enough to survive the fierce competition after graduating from the incubation. However, the incubating services sometimes fail to foster the independence of new startup companies, and raise the dependence of many companies on BICs. Thus, the dependence on BICs is a very important factor to understand the survival of the incubated startup companies after graduation from BICs. The purpose of this study is to identify the main factors that influence the firm's dependence on BICs and to characterize the relationships among the identified factors. The business incubating service is a core construct of this study. It includes various activities and resources, such as offering the physical facilities, legal service, and connecting them with outside organizations. These services are extensive and take various forms. They are provided by BICs directly or indirectly. Past studies have identified various incubating services and classify them in different ways. Based on the past studies, we classify the business incubating service into three categories as mentioned above : (1) business infrastructure support, (2) direct support, and (3) networking support. The business infrastructure support is to provide the essential resources to start the business, such as physical facilities. The direct support is to offer the business resources available in the BICs, such as human, technical, and administrational resources. Finally, the indirect service was to support the resource in the outside of business incubation center. Dependence is generally defined as the degree to which a client firm needs the resources provided by the service provider in order to achieve its goals. Dependence is generated when a firm recognizes the benefits of interacting with its counterpart. Hence, the more positive outcomes a firm derives from its relationship with the partner, the more dependent on the partner the firm must inevitably become. In business incubating, as a resident firm is incubated in longer period, we can predict that her dependence on BICs would be stronger. In order to foster the independence of the incubated firms, BICs have to be able to manipulate the provision of their services to control the firms' dependence on BICs. Based on the above discussion, the research model for relationships between dependence and its affecting factors was developed. We surveyed the companies residing in BICs to test our research model. The instrument of our study was modified, in part, on the basis of previous relevant studies. For the purposes of testing reliability and validity, preliminary testing was conducted with firms that were residing in BICs and incubated by the BICs in the region of Gwangju and Jeonnam. The questionnaire was modified in accordance with the pre-test feedback. We mailed to all of the firms that had been incubated by the BICs with the help of business incubating managers of each BIC. The survey was conducted over a three week period. Gifts (of approximately ₩10,000 value) were offered to all actively participating respondents. The incubating period was reported by the business incubating managers, and it was transformed using natural logarithms. A total of 180 firms participated in the survey. However, we excluded 4 cases due to a lack of consistency using reversed items in the answers of the companies, and 176 cases were used for the analysis. We acknowledge that 176 samples may not be sufficient to conduct regression analyses with 5 research variables in our study. Each variable was measured through multiple items. We conducted an exploratory factor analysis to assess their unidimensionality. In an effort to test the construct validity of the instruments, a principal component factor analysis was conducted with Varimax rotation. The items correspond well to each singular factor, demonstrating a high degree of convergent validity. As the factor loadings for a variable (or factor) are higher than the factor loadings for the other variables, the instrument's discriminant validity is shown to be clear. Each factor was extracted as expected, which explained 70.97, 66.321, and 52.97 percent, respectively, of the total variance each with eigen values greater than 1.000. The internal consistency reliability of the variables was evaluated by computing Cronbach's alphas. The Cronbach's alpha values of the variables, which ranged from 0.717 to 0.950, were all securely over 0.700, which is satisfactory. The reliability and validity of the research variables are all, therefore, considered acceptable. The effects of dependence were assessed using a regression analysis. The Pearson correlations were calculated for the variables, measured by interval or ratio scales. Potential multicollinearity among the antecedents was evaluated prior to the multiple regression analysis, as some of the variables were significantly correlated with others (e.g., direct service and indirect service). Although several variables show the evidence of significant correlations, their tolerance values range between 0.334 and 0.613, thereby demonstrating that multicollinearity is not a likely threat to the parameter estimates. Checking some basic assumptions for the regression analyses, we decided to conduct multiple regression analyses and moderated regression analyses to test the given hypotheses. The results of the regression analyses indicate that the regression model is significant at p < 0.001 (F = 44.260), and that the predictors of the research model explain 42.6 percent of the total variance. Hypotheses 1, 2, and 3 address the relationships between the dependence of the incubated firms and the business incubating services. Business infrastructure service, direct service, and indirect service are all significantly related with dependence (β = 0.300, p < 0.001; β = 0.230, p < 0.001; β = 0.226, p < 0.001), thus supporting Hypotheses 1, 2, and 3. When the incubating period is the moderator and dependence is the dependent variable, the addition of the interaction terms with the antecedents to the regression equation yielded a significant increase in R2 (F change = 2.789, p < 0.05). In particular, direct service and indirect service exert different effects on dependence. Hence, the results support Hypotheses 5 and 6. This study provides several strategies and specific calls to action for BICs, based on our empirical findings. Business infrastructure service has more effect on the firm's dependence than the other two services. The introduction of an additional high charge rate for a graduated but allowed to stay in the BIC is a basic and legitimate condition for the BIC to control the firm's dependence. We detected the differential effects of direct and indirect services on the firm's dependence. The firms with long incubating period are more sensitive to indirect service positively, and more sensitive to direct service negatively, when assessing their levels of dependence. This implies that BICs must develop a strategy on the basis of a firm's incubating period. Last but not least, it would be valuable to discover other important variables that influence the firm's dependence in the future studies. Moreover, future studies to explain the independence of startup companies in BICs would also be valuable.
Since the implementation of economic reforms in 1978, the Chinese economy grows rapidly at an average annul growth rate of 9% over the post two decades. Franchising has been widely recognized as an important source of entrepreneurial activity. Trust is important in that it facilitates relational exchanges by permits partners to transcend short-run inequities or risks to concentrate on long-term profits or gains. In the relationship between the franchisors and franchisees, trust has been described as an important source of competitive advantage. However, little research has been done on the factors affecting trust in Chinese franchisor-franchisee relationships. The purpose of this study is to investigate what factors affect the trust in the franchise system in China, and to provide guidelines and insights to franchisors which enter Chinese market. In this study, according to Morgan and Hunt (1994), trust is defined as the extending when one party has confidence in an exchange partner's reliability and integrity. We offered a conceptual model of the empirical study. The model shows that the factors affecting the trust include franchisor's supports, communication, satisfaction with previous outcome and conflict. We also suggested the franchisor's supports and communication like to enhance the franchisee's satisfaction with previous outcome, and the franchisor's supports, communication and he franchisee's satisfaction with previous outcome tend to decrease conflict. Before the formal study, a pretest involving exploratory interviews with owners from three franchisees was conducted to make sure the questionnaire was relevant and clear to the respondents. The data were collected using trained interviewers to carry out personal interviews with the aid of an unidentified, muti-page, structured questionnaire. The respondents comprised of owners, managers, and owner managers of franchisee-owned food service franchises located in Beijing, China. Even though a total of 256 potential franchises were initially contacted, the finally usable sample consisted of 125 respondents. As expected, the sampling method was successful in soliciting respondents with waried personal and firm characteristics. Self-administrated questionnaires were used for all measures. And established scales were used to measure the latent constructs in this study. The measures tapped the franchisees' perceptions of the relationship with the referent franchisor. Five-point Likert-type scales ranging from "strongly disagree" (=1) to "strongly agree" (=7) were used throughout the constructs (trust, eight items; support, five items; communication, four items; satisfaction, six items; conflict, three items). The reliability measurements traditionally employed, such as the Cronbach's alpha, were used. All the reliabilities were greater than.80. The proposed measurement model was estimated using SPSS 12.0 and AMOS 5.0 analysis package. We conducted A series of exploratory factor analyses and confirmatory factor analyses to assess the convergent validity, discriminant validity, and reliability. The results indicate reasonable overall fits between the model and the observed data. The overall fit of measurement model were
It is not new that today's business organizations are expected to exhibit ethical and moral management and to carry out social responsibility as a good corporate citizen. Since South Korea emerged as a newly industrialized country during the 1980s, Korean corporations have become active in carrying out their social responsibility as a good corporate citizen to society. In spite of the short history of corporate social responsibility, Korean companies have actively participated in corporate philanthropy. Corporations' significant donations to various social causes, no-lay-off policies, corporate volunteerism and green marketing are evidences of their commitment to corporate citizenship. Corporate social responsibility is now an essential management practice whereby corporation can strengthen its sustainable value creation processes by enhancing the trust assets underlying the relationships between the business and the stakeholders. Much of the conceptual work in the area of corporate social responsibility(CSR) has originated from researches conducted in the management field. Carroll(1979) proposed that corporations have four types of social responsibilities: economic, legal, ethical and philanthropic responsibility. Most past research has investigated CSR and its impact on consumers' attitudes toward the corporations and corporate performances. Although there exists a large body of literature on how consumers perceive and respond to CSR, the majority of past studies were conducted in the United States. The stability and applicability of past findings need to be tested across different national/cultural settings, especially since corporate social responsibility is a reflection of implicit conformation with the expectations and criticism that society may have toward a corporation(Matten and Moon, 2004). In this study, we explored whether people in Korea perceive CSR of Korean corporations in the same four dimensions as done in the United States and what were the measurement items tapping each of these four dimensions. In order to investigate the dimensions of CSR and the measurement items for CSR perceived by Korean people, nine focus group interviews were conducted with several stakeholder groups(two with undergraduate students, two with graduate students, three with general consumers, and two with NGO groups). Scripts from the interviews revealed that the Korean stakeholders perceived four types of CSR which are the same as those proposed by Carroll(1979). However we found CSR issues unique to Korean corporations. For example for the economic responsibility, Korean people mentioned that the corporation needed to contribute to the economic development of the country by generating corporate profits. For the legal responsibility, Koreans included the "corporation need to follow the consumer protection law." For the ethical responsibility, they considered that the corporation needed to not promote false advertisement. In addition, Koreans thought that an ethical company should do transparent management. For the philanthropic responsibility, people in Korea thought that a corporation needed to return parts of its profits to the society for the betterment of society. The 28 items were developed based on the results of the nine focus group interviews, while considering the scale developed by Maignan and Ferrell(2001). Following the procedure proposed by Churchill(1979), we started by developing an item poll consisting of 28 items and purified the initial pool of items through exploratory, confirmatory factor analyses. 176 samples were sued for this analysis. Confirmatory factor analysis was performed on the 28 items in order to verify the underlying four factor structure. Study 1 provided new measurement items for tapping the Korean CSR dimensions, which can be useful for the future studies exploring the effects of CSR on Korean consumers' attitudes toward the corporations and corporate performances. And we found the CSR scale(17 items) has good reliability, discriminant validity and nomological validity. Economic Responsibility: "XYZ company continuously improves the quality of our products", "XYZ company has a procedure in place to respond to customer complaint", "XYZ company contributes to the economic development of our country by generating profits", "XYZ company is eager to hire people". Legal Responsibility: "XYZ company's products meet legal standards", "XYZ company seeks to comply with all laws regulating hiring and employee benefits", "XYZ company honors contractual obligations to its suppliers", "XYZ company's managers try to comply with the law related to the business operation". Ethical Responsibility: "XYZ company has a comprehensive code of conduct", "XYZ company does not promote a false or misleading advertisement", "XYZ company seems to conduct a transparent business", "XYZ company does a fair business with its suppliers or sub-contractors". Philanthropic Responsibility: "XYZ company encourages partnerships with local businesses and schools", "XYZ company supports sports and cultural activities", "XYZ company gives adequate contributions to charities considering its business size", "XYZ company encourages employees to support our community". Study 2 was condusted for comprehensive validity. 655 samples were used for this anlysis. Collected samples were tested by factor analysis and Crnbach's Alpha coefficiednts and were found to be satisfactory in terms of validity and reliability. Furthermore, fitness of the measurement model was tested by using conformatory factor analysis. χ2=880.73(df=160), GFI=0.891, AGFI=0.854, NFI=0.908, NNFI=0.913, RMR=0.059, RMESA=0.070. We hope that CSR scale could greatly facilitate research on Corporate social resposibility, it is by no means the final answer.
Researches about the relationship between SST(Self Service Technology) and TRI(Technology Readiness Index) have been carried out after TRI was developed by Parasuraman and his colleagues(2000). We hypothesize Consumer Readiness can also influence consumer's motivation, attitude, and intent to use SST. Currently, there has been no research on this subject. In this study, we investigated the relationship between TR, Consumer Readiness and SST Core Attitudinal Model which Dabholkar & Bagozzi(1994) proposed. The researchers also investigated moderating effects of consumer traits and situational factors to verify the acceptance of such forms of service delivery by all kinds of consumers and under different situational contexts. Self consciousness, the need for interaction with an employee, and the technology anxiety were used as consumer trait variables. Perceived waiting time and perceived crowding were used as situational variables. 380 questionnaires were distributed to a sample group of people in their 20's and 30's, and the data were analyzed with structural equation model using AMOS 18.0 program. All of Cronbach's alpha values representing reliabilities were satisfactory. The values of Composite Reliability(CR) and Average Variance Extracted(AVE) also showed the above criteria, thus providing evidence of convergent validity. To confirm discriminant validity among the constructs, confirmatory factor analysis and correlations among all the variables were examined. The results were satisfactory. The results of this study are summarized as follows. 1. Optimism and innovativeness of TR partially influenced the motivation to use SST. People who tend to be optimistic use SST because of ease of use and fun. The innovative however, usually use SST due to its performance. However, consumer readiness of role clarity, ability and self-efficacy influence all the components of motivation to use SST, ease of use, performance and fun. The relative effect of consumer readiness on the motivation to use SST was much stronger and more significant than that of TR. No other previous studies have examined the effects of Consumer Readiness on SST usage motivation, attitude and intention. It is academically meaningful that the researchers verified that Consumer Readiness is the important precedent construct influencing the self service technology core Attitudinal Model. Our findings suggest that marketers should consider fun and ease of use attributes to promote the use of self service technology. In addition, the SST usage frequency will rise rapidly when role clarity, ability, and self-efficacy which anybody can easily handle SST is assured. If the SST usage rate is increased, waiting times for customers could be decreased. Shorter waiting time could lead to higher customer satisfaction. It may also result in making a long-term profit owing to the reduced number of employees. Thus, presentation of using SST by employees or videos showing how to use it will promote the usage attitude and intent. 2. In SST core attitudinal model, performance and fun factors among SST usage motivation affected attitudes of using SST. The attitude of using SST highly influenced intent to use SST. This result is consistent with previous researches that dealt with the relationship between motivation, attitude and intention. Expectation of using SST could result in good performance just like the effect of ordering menu to service employees and to have fun since fun during its use could promote more SST usage rate. 3. In the relationship among motivation, attitude and intent in SST core attitudinal model, the moderating effect of consumer traits(self-consciousness, need for interaction with service employees and technology anxiety) and situational factors(perceived crowding and perceived waiting time) were tested. The results also supported the hypothesized moderating effects except perceived crowding. The highly self-conscious tended to form attitudes to use SST because of its fun compared to those who were less self-conscious because of its performance. People who had a high need for interaction with service employees tended to use SST for its performance. This result indicates that if ordering results are assured, SST is easily accessible to even consumers who have a high need for interaction with a service employee. When SST is easy to use, attitudes strengthen intent among people who had a high level of anxiety of technology. People who had low technology anxiety formed attitudes to use SST because of its performance. Service firms must ensure their self service technology is designed to be easy to use for those who have a high level of technology anxiety. Shorter perceived waiting times strengthened the attitude to use self service technology because of its fun. If the fun aspect is assured, people willing to use self service technology even perceive waiting time to be shorter than it actually is. Greater perceived waiting times form higher level of intent to use self service technology than those of shorter perceived waiting times. This implies that people view self service technology as a faster alternative to ordering service employees. The fun aspect of self service technology will attract a higher rate of usage for self service technology. 4. It has been proven that ease of use, performance and fun aspects are very important factors in motivation to form attitudes and intent to use self service technology regardless of the amount of perceived waiting time, self-consciousness, need for interaction with service employees, and technology anxiety. Service firms must consider these motivation aspects(ease of use, performance and fun)strongly in their promotion to use self service technology. Ease of use, assuring absolute performance compared to interaction with service employees', and adding a fun aspect will positively strengthen consumers' attitudes and intent to use self service technology. Summarizing the moderating effects, fun is the most valuable factor triggering SST usage attitude and intention. Therefore, designing self service technology to be fun will be the key to its success. This study focused on the touch screen self service technology in fast food restaurant. Although it has its limits due to the fact that it is hard to generalize the results to any other self service technology, the conceptual framework of this study can be applied to future research of any other service site.
The flow theory becomes one of the most important frameworks in the internet research arena. Hoffman and Novak proposed a hierarchical flow model showing the antecedents and outcomes of flow and the relationship among these variables in the hyper-media computer circumstances (Hoffman and Novak 1996). This model was further tested after their initial research (Novak, Hoffman, and Yung 2000). At their paper, Hoffman and Novak explained that the balance of challenge and skill leads to flow which means the positive optimal state of mind (Hoffman and Novak 1996). An imbalance between challenge and skill, leads to negative states of mind like anxiety, boredom, apathy (Csikszentmihalyi and Csikszentmihalyi 1988). Almost all research on the flow 4-channel model have been focusingon flow, the positive state of mind (Ellis, Voelkl, and Morris 1994 Mathwick and Rigdon 2004). However, it also needs to examine the formation of the negative states of minds and their outcomes. Flow researchers explain play or playfulness as antecedents or the early state of flow. However, play has been regarded as a distinct concept from flow in the flow literatures (Hoffman and Novak 1996; Novak, Hoffman, and Yung 2000). Mathwick and Rigdon discovered the influences of challenge and skill on play; they also observed the influence of play on web-loyalty and brand loyalty (Mathwick and Rigdon 2004). Unfortunately, they did not go so far as to test the influences of play on state of mind. This study focuses on the relationships between state of mind in the flow 4-channel model and play. Early research has attempted to hypothetically explain state of mind in flow theory, but has not been tested except flow until now. Also the importance of play has been emphasized in the flow theory, but has not been tested in the flow 4-channel model context. This researcher attempts to analyze the relationships among state of mind, skill of play, challenge, state of mind and web loyalty. For this objective, I developed a measure for state of mind and defined the concept of play as a trait. Then, the influences of challenge and skill on the state of mind and play under on-line shopping conditions were tested. Also the influences of play on state of mind were tested and those of flow and play on web loyalty were highlighted. 294 undergraduate students participated in this research survey. They were asked to respond about their perceptions of challenge, skill, state of mind, play, and web-loyalty to on-line shopping mall. Respondents were restricted to students who bought products on-line in a month. In case of buying products at two or more on-line shopping malls, they asked to respond about the shopping mall where they bought the most important one. Construct validity, discriminant validity, and convergent validity were used to check the measurement validations. Also, Cronbach's alpha was used to check scale reliability. A series of exploratory factor analyses was conducted. This researcher conducted confirmatory factor analyses to assess the validity of measurements. All items loaded significantly on their respective constructs. Also, all reliabilities were greater than.70. Chi-square difference tests and goodness of fit tests supported discriminant and convergent validity. The results of clustering and ANOVA showed that high challenge and high skill leaded to flow, low challenge and high skill leaded to boredom, and low challenge and low skill leaded to apathy. But, it was different from my expectation that high challenge and low skill didnot lead to anxiety but leaded to apathy. The results also showed that high challenge and high skill, and high challenge and low skill leaded to the highest play. Low challenge leaded to low play. 4 Structural Equation Models were built by flow, anxiety, boredom, apathy for analyzing not only the impact of play on state of mind and web-loyalty, but also that of state of mind on web-loyalty. According the analyses results of these models, play impacted flow and web-loyalty positively, but impacted anxiety, boredom, and apathy negatively. Results also showed that flow impacted web-loyalty positively, but anxiety, boredom, and apathy impacted web-loyalty negatively. The interpretations and implications of the test results of the hypotheses are as follows. First, respondents belonging to different clusters based on challenge and skill level experienced different states of mind such as flow, anxiety, boredom, apathy. The low challenge and low skill group felt the highest anxiety and apathy. It could be interpreted that this group feeling high anxiety or fear, then avoided attempts to shop on-line. Second, it was found that higher challenge leads to higher levels of play. Test results show that the play level of the high challenge and low skill group (anxiety group) was higher than that of the high challenge and high skill group (flow group). However, this was not significant. Third, play positively impacted flow and negatively impacted boredom. The negative impacts on anxiety and apathy were not significant. This means that the combination of challenge and skill creates different results. Forth, play and flow positively impacted web-loyalty, but anxiety, boredom, apathy had negative impacts. The effect of play on web-loyalty was stronger in case of anxiety, boredom, apathy group than fl ow group. These results show that challenge and skill influences state of mind and play. Results also demonstrate how play and flow influence web-loyalty. It implies that state of mind and play should be the core marketing variables in internet marketing. The flow theory has been focusing on flow and on the positive outcomes of flow experiences. But, this research shows that lots of consumers experience the negative state of mind rather than flow state in the internet shopping circumstance. Results show that the negative state of mind leads to low or negative web-loyalty. Play can have an important role with the web-loyalty when consumers have the negative state of mind. Results of structural equation model analyses show that play influences web-loyalty positively, even though consumers may be in the negative state of mind. This research found the impacts of challenge and skill on state of mind in the flow 4-channel model, not only flow but also anxiety, boredom, apathy. Also, it highlighted the role of play in the flow 4-channel model context and impacts on web-loyalty. However, tests show a few different results from hypothetical expectations such as the highest anxiety level of apathy group and insignificant impacts of play on anxiety and apathy. Further research needs to replicate this research and/or to compare 3-channel model with 4-channel model.