The Audience Behavior-based Emotion Prediction Model for Personalized Service (고객 맞춤형 서비스를 위한 관객 행동 기반 감정예측모형)
-
- Journal of Intelligence and Information Systems
- /
- v.19 no.2
- /
- pp.73-85
- /
- 2013
Nowadays, in today's information society, the importance of the knowledge service using the information to creative value is getting higher day by day. In addition, depending on the development of IT technology, it is ease to collect and use information. Also, many companies actively use customer information to marketing in a variety of industries. Into the 21st century, companies have been actively using the culture arts to manage corporate image and marketing closely linked to their commercial interests. But, it is difficult that companies attract or maintain consumer's interest through their technology. For that reason, it is trend to perform cultural activities for tool of differentiation over many firms. Many firms used the customer's experience to new marketing strategy in order to effectively respond to competitive market. Accordingly, it is emerging rapidly that the necessity of personalized service to provide a new experience for people based on the personal profile information that contains the characteristics of the individual. Like this, personalized service using customer's individual profile information such as language, symbols, behavior, and emotions is very important today. Through this, we will be able to judge interaction between people and content and to maximize customer's experience and satisfaction. There are various relative works provide customer-centered service. Specially, emotion recognition research is emerging recently. Existing researches experienced emotion recognition using mostly bio-signal. Most of researches are voice and face studies that have great emotional changes. However, there are several difficulties to predict people's emotion caused by limitation of equipment and service environments. So, in this paper, we develop emotion prediction model based on vision-based interface to overcome existing limitations. Emotion recognition research based on people's gesture and posture has been processed by several researchers. This paper developed a model that recognizes people's emotional states through body gesture and posture using difference image method. And we found optimization validation model for four kinds of emotions' prediction. A proposed model purposed to automatically determine and predict 4 human emotions (Sadness, Surprise, Joy, and Disgust). To build up the model, event booth was installed in the KOCCA's lobby and we provided some proper stimulative movie to collect their body gesture and posture as the change of emotions. And then, we extracted body movements using difference image method. And we revised people data to build proposed model through neural network. The proposed model for emotion prediction used 3 type time-frame sets (20 frames, 30 frames, and 40 frames). And then, we adopted the model which has best performance compared with other models.' Before build three kinds of models, the entire 97 data set were divided into three data sets of learning, test, and validation set. The proposed model for emotion prediction was constructed using artificial neural network. In this paper, we used the back-propagation algorithm as a learning method, and set learning rate to 10%, momentum rate to 10%. The sigmoid function was used as the transform function. And we designed a three-layer perceptron neural network with one hidden layer and four output nodes. Based on the test data set, the learning for this research model was stopped when it reaches 50000 after reaching the minimum error in order to explore the point of learning. We finally processed each model's accuracy and found best model to predict each emotions. The result showed prediction accuracy 100% from sadness, and 96% from joy prediction in 20 frames set model. And 88% from surprise, and 98% from disgust in 30 frames set model. The findings of our research are expected to be useful to provide effective algorithm for personalized service in various industries such as advertisement, exhibition, performance, etc.
It is a rising trend that the number of users using one of the social media channels, the Social Network Service, so called the SNS, is getting increased. As per to this social trend, more companies have interest in this networking platform and start to invest their funds in it. It has received much attention as a tool spreading and expanding the message that a company wants to deliver to its customers and has been recognized as an important channel in terms of the relationship marketing with them. The environment of media that is radically changing these days makes possible for companies to approach their customers in various ways. Particularly, the social network service, which has been developed rapidly, provides the environment that customers can freely talk about products. For companies, it also works as a channel that gives customized information to customers. To succeed in the online environment, companies need to not only build the relationship between companies and customers but focus on the relationship between customers as well. In response to the online environment with the continuous development of technology, companies have tirelessly made the novel marketing strategy. Especially, as the one-to-one marketing to customers become available, it is more important for companies to maintain the relationship marketing with their customers. Among many SNS, Facebook, which many companies use as a communication channel, provides a fan page service for each company that supports its business. Facebook fan page is the platform that the event, information and announcement can be shared with customers using texts, videos, and pictures. Companies open their own fan pages in order to inform their companies and businesses. Such page functions as the websites of companies and has a characteristic of their brand communities such as blogs as well. As Facebook has become the major communication medium with customers, companies recognize its importance as the effective marketing channel, but they still need to investigate their business performances by using Facebook. Although there are infinite potentials in Facebook fan page that even has a function as a community between users, which other platforms do not, it is incomplete to regard companies' Facebook fan pages as communities and analyze them. In this study, it explores the relationship among customers through the network of the Facebook fan page users. The previous studies on a company's Facebook fan page were focused on finding out the effective operational direction by analyzing the use state of the company. However, in this study, it draws out the structural variable of the network, which customer committment can be measured by applying the social network analysis methodology and investigates the influence of the structural characteristics of network on the business performance of companies in an empirical way. Through each company's Facebook fan page, the network of users who engaged in the communication with each company is exploited and it is the one-mode undirected binary network that respectively regards users and the relationship of them in terms of their marketing activities as the node and link. In this network, it draws out the structural variable of network that can explain the customer commitment, who pressed "like," made comments and shared the Facebook marketing message, of each company by calculating density, global clustering coefficient, mean geodesic distance, diameter. By exploiting companies' historical performance such as net income and Tobin's Q indicator as the result variables, this study investigates influence on companies' business performances. For this purpose, it collects the network data on the subjects of 54 companies among KOSPI-listed companies, which have posted more than 100 articles on their Facebook fan pages during the data collection period. Then it draws out the network indicator of each company. The indicator related to companies' performances is calculated, based on the posted value on DART website of the Financial Supervisory Service. From the academic perspective, this study suggests a new approach through the social network analysis methodology to researchers who attempt to study the business-purpose utilization of the social media channel. From the practical perspective, this study proposes the more substantive marketing performance measurements to companies performing marketing activities through the social media and it is expected that it will bring a foundation of establishing smart business strategies by using the network indicators.
Sentiment Analysis (SA) is a Natural Language Processing (NLP) task that analyzes the sentiments consumers or the public feel about an arbitrary object from written texts. Furthermore, Aspect-Based Sentiment Analysis (ABSA) is a fine-grained analysis of the sentiments towards each aspect of an object. Since having a more practical value in terms of business, ABSA is drawing attention from both academic and industrial organizations. When there is a review that says "The restaurant is expensive but the food is really fantastic", for example, the general SA evaluates the overall sentiment towards the 'restaurant' as 'positive', while ABSA identifies the restaurant's aspect 'price' as 'negative' and 'food' aspect as 'positive'. Thus, ABSA enables a more specific and effective marketing strategy. In order to perform ABSA, it is necessary to identify what are the aspect terms or aspect categories included in the text, and judge the sentiments towards them. Accordingly, there exist four main areas in ABSA; aspect term extraction, aspect category detection, Aspect Term Sentiment Classification (ATSC), and Aspect Category Sentiment Classification (ACSC). It is usually conducted by extracting aspect terms and then performing ATSC to analyze sentiments for the given aspect terms, or by extracting aspect categories and then performing ACSC to analyze sentiments for the given aspect category. Here, an aspect category is expressed in one or more aspect terms, or indirectly inferred by other words. In the preceding example sentence, 'price' and 'food' are both aspect categories, and the aspect category 'food' is expressed by the aspect term 'food' included in the review. If the review sentence includes 'pasta', 'steak', or 'grilled chicken special', these can all be aspect terms for the aspect category 'food'. As such, an aspect category referred to by one or more specific aspect terms is called an explicit aspect. On the other hand, the aspect category like 'price', which does not have any specific aspect terms but can be indirectly guessed with an emotional word 'expensive,' is called an implicit aspect. So far, the 'aspect category' has been used to avoid confusion about 'aspect term'. From now on, we will consider 'aspect category' and 'aspect' as the same concept and use the word 'aspect' more for convenience. And one thing to note is that ATSC analyzes the sentiment towards given aspect terms, so it deals only with explicit aspects, and ACSC treats not only explicit aspects but also implicit aspects. This study seeks to find answers to the following issues ignored in the previous studies when applying the BERT pre-trained language model to ACSC and derives superior ACSC models. First, is it more effective to reflect the output vector of tokens for aspect categories than to use only the final output vector of [CLS] token as a classification vector? Second, is there any performance difference between QA (Question Answering) and NLI (Natural Language Inference) types in the sentence-pair configuration of input data? Third, is there any performance difference according to the order of sentence including aspect category in the QA or NLI type sentence-pair configuration of input data? To achieve these research objectives, we implemented 12 ACSC models and conducted experiments on 4 English benchmark datasets. As a result, ACSC models that provide performance beyond the existing studies without expanding the training dataset were derived. In addition, it was found that it is more effective to reflect the output vector of the aspect category token than to use only the output vector for the [CLS] token as a classification vector. It was also found that QA type input generally provides better performance than NLI, and the order of the sentence with the aspect category in QA type is irrelevant with performance. There may be some differences depending on the characteristics of the dataset, but when using NLI type sentence-pair input, placing the sentence containing the aspect category second seems to provide better performance. The new methodology for designing the ACSC model used in this study could be similarly applied to other studies such as ATSC.
Recently, global business environment is changing dramatically along with the acceleration of technological innovation amid the war, climatic change, and geopolitical instability. Accordingly, it is difficult to predict or plan for the future as the volatility, complexity, ambiguity, and uncertainty of the industrial ecosystem continue to increase. Therefore, organizations are undergoing inevitable restructuring in accordance with their survival strategy, for instance, removing marginal businesses or firing. Accordingly, office workers are seeking a startup as an alternative for their continuous economic activity amid rising anxiety factors that make them think they would lose their jobs unintentionally. Here, this study is aimed to verify through what paths office workers' self-determination influences the process of converting to a startup. For this study, an online survey was carried out, and 310 respondents' valid data were analyzed through SPSS and AMOS. To sum up the results, first, office workers' self-determination did not have significant effects on entrepreneurial intention. However, it was confirmed that self-determination had positive (+) effects on innovativeness and perception of the startup support system. This result shows that their psychology works to prepare step by step by accumulating innovative experiences and increasing perception of the startup support system from a long-term life path perspective rather than challenging startups right way. Second, innovativeness is found to have positive (+) effects on entrepreneurial intention. Also, perception of the startup support system had positive (+) effects on entrepreneurial intention. This implies that when considering startups, they are highly aware of the government's various startup support systems. Third, innovativeness is found to have positive (+) effects on perception of the startup support system. It is judged that perception of the startup support system is valid for prospective founders to exhibit their innovativeness and realize new ideas. Fourth, it was confirmed that innovativeness and perception of the startup support system mediated correlation between self-determination and entrepreneurial intention, and perception of the startup support system mediated correlation between innovativeness and entrepreneurial intention, which shows that it is a crucial factor in entrepreneurial intention. Although previous studies related to startups deal with students mostly, this study targets office workers who form a great part in economic activities, which makes it academically valuable in terms of being differentiated from others and extending the scope of research. Also, when we consider the fact that the motivation for self-determination alone fails to stimulate entrepreneurial intention and the complete mediation of innovativeness and the startup support system, it has great implications in practical aspects such as the government's human and material support systems. In the selection and analysis of samples, this study exhibits a limitation that the problem of common method bias is not completely resolved. Also, additional definitive research is needed on whether entrepreneurial intention is formed and converted into startup behavior. Academically and practically, this study deals with the relationship between humans' psychological motives and startups which has not been handled sufficiently in previous studies. The conversion of office workers to startups is expected to have effects on individuals' economic stability and the state's job creation; therefore, it needs to be investigated continuously for its great value.
As business incubation centers (BICs) have been operating for more than 10 years in Korea, many early stage startups tend to use the services provided by the incubating centers. BICs in Korea have accumulated the knowledge and experience in the past ten years and their services have been considerably improved. The business incubating service has three facets : (1) business infrastructure service, (2) direct service, and (3) indirect service. The mission of BICs is to provide the early stage entrepreneurs with the incubating service in a limited period time to help them grow strong enough to survive the fierce competition after graduating from the incubation. However, the incubating services sometimes fail to foster the independence of new startup companies, and raise the dependence of many companies on BICs. Thus, the dependence on BICs is a very important factor to understand the survival of the incubated startup companies after graduation from BICs. The purpose of this study is to identify the main factors that influence the firm's dependence on BICs and to characterize the relationships among the identified factors. The business incubating service is a core construct of this study. It includes various activities and resources, such as offering the physical facilities, legal service, and connecting them with outside organizations. These services are extensive and take various forms. They are provided by BICs directly or indirectly. Past studies have identified various incubating services and classify them in different ways. Based on the past studies, we classify the business incubating service into three categories as mentioned above : (1) business infrastructure support, (2) direct support, and (3) networking support. The business infrastructure support is to provide the essential resources to start the business, such as physical facilities. The direct support is to offer the business resources available in the BICs, such as human, technical, and administrational resources. Finally, the indirect service was to support the resource in the outside of business incubation center. Dependence is generally defined as the degree to which a client firm needs the resources provided by the service provider in order to achieve its goals. Dependence is generated when a firm recognizes the benefits of interacting with its counterpart. Hence, the more positive outcomes a firm derives from its relationship with the partner, the more dependent on the partner the firm must inevitably become. In business incubating, as a resident firm is incubated in longer period, we can predict that her dependence on BICs would be stronger. In order to foster the independence of the incubated firms, BICs have to be able to manipulate the provision of their services to control the firms' dependence on BICs. Based on the above discussion, the research model for relationships between dependence and its affecting factors was developed. We surveyed the companies residing in BICs to test our research model. The instrument of our study was modified, in part, on the basis of previous relevant studies. For the purposes of testing reliability and validity, preliminary testing was conducted with firms that were residing in BICs and incubated by the BICs in the region of Gwangju and Jeonnam. The questionnaire was modified in accordance with the pre-test feedback. We mailed to all of the firms that had been incubated by the BICs with the help of business incubating managers of each BIC. The survey was conducted over a three week period. Gifts (of approximately ₩10,000 value) were offered to all actively participating respondents. The incubating period was reported by the business incubating managers, and it was transformed using natural logarithms. A total of 180 firms participated in the survey. However, we excluded 4 cases due to a lack of consistency using reversed items in the answers of the companies, and 176 cases were used for the analysis. We acknowledge that 176 samples may not be sufficient to conduct regression analyses with 5 research variables in our study. Each variable was measured through multiple items. We conducted an exploratory factor analysis to assess their unidimensionality. In an effort to test the construct validity of the instruments, a principal component factor analysis was conducted with Varimax rotation. The items correspond well to each singular factor, demonstrating a high degree of convergent validity. As the factor loadings for a variable (or factor) are higher than the factor loadings for the other variables, the instrument's discriminant validity is shown to be clear. Each factor was extracted as expected, which explained 70.97, 66.321, and 52.97 percent, respectively, of the total variance each with eigen values greater than 1.000. The internal consistency reliability of the variables was evaluated by computing Cronbach's alphas. The Cronbach's alpha values of the variables, which ranged from 0.717 to 0.950, were all securely over 0.700, which is satisfactory. The reliability and validity of the research variables are all, therefore, considered acceptable. The effects of dependence were assessed using a regression analysis. The Pearson correlations were calculated for the variables, measured by interval or ratio scales. Potential multicollinearity among the antecedents was evaluated prior to the multiple regression analysis, as some of the variables were significantly correlated with others (e.g., direct service and indirect service). Although several variables show the evidence of significant correlations, their tolerance values range between 0.334 and 0.613, thereby demonstrating that multicollinearity is not a likely threat to the parameter estimates. Checking some basic assumptions for the regression analyses, we decided to conduct multiple regression analyses and moderated regression analyses to test the given hypotheses. The results of the regression analyses indicate that the regression model is significant at p < 0.001 (F = 44.260), and that the predictors of the research model explain 42.6 percent of the total variance. Hypotheses 1, 2, and 3 address the relationships between the dependence of the incubated firms and the business incubating services. Business infrastructure service, direct service, and indirect service are all significantly related with dependence (β = 0.300, p < 0.001; β = 0.230, p < 0.001; β = 0.226, p < 0.001), thus supporting Hypotheses 1, 2, and 3. When the incubating period is the moderator and dependence is the dependent variable, the addition of the interaction terms with the antecedents to the regression equation yielded a significant increase in R2 (F change = 2.789, p < 0.05). In particular, direct service and indirect service exert different effects on dependence. Hence, the results support Hypotheses 5 and 6. This study provides several strategies and specific calls to action for BICs, based on our empirical findings. Business infrastructure service has more effect on the firm's dependence than the other two services. The introduction of an additional high charge rate for a graduated but allowed to stay in the BIC is a basic and legitimate condition for the BIC to control the firm's dependence. We detected the differential effects of direct and indirect services on the firm's dependence. The firms with long incubating period are more sensitive to indirect service positively, and more sensitive to direct service negatively, when assessing their levels of dependence. This implies that BICs must develop a strategy on the basis of a firm's incubating period. Last but not least, it would be valuable to discover other important variables that influence the firm's dependence in the future studies. Moreover, future studies to explain the independence of startup companies in BICs would also be valuable.
The study examines how the environmental factors of store influence service brand personality and repurchase intention in the service environment. The service industry has been experiencing the intensified competition with the industry's continuous growth and the influence from rapid technological advancement. Under the circumstances, it has become ever more important for the brand competitiveness to be distinctively recognized against competition. A brand needs to be distinguished and differentiated from competing companies because they are all engaged in the similar environment of the service industry. The differentiation of brand achievement has become increasingly important to highlight certain brand functions to include emotional, self-expressive, and symbolic functions since the importance of such functions has been further emphasized in promoting consumption activities. That is the recent role of brand personality that has been emphasized in the service industry. In other words, customers now freely and actively express their personalities or egos in consumption activities, taking an important role in construction of a brand asset. Hence, the study suggests that it is necessary to disperse the recognition and acknowledgement that the maintenance of the existing customers contributes more to boost repurchase intention when it is compared to the efforts to create new customers, particularly in the service industry. Meanwhile, the store itself can offer a unique environment that may influence the consumer's purchase decision. Consumers interact with store environments in the process of,virtually, all household purchase they make (Sarel 1981). Thus, store environments may encourage customers to purchase. The roles that store environments play are to provide informational cues to customers about the store and goods and communicate messages to stimulate consumers' emotions. The store environments differentiate the store from competing stores and build a unique service brand personality. However, the existing studies related to brand in the service industry mostly concentrated on the relationship between the quality of service and customer satisfaction, and they are mostly generalized while the connective studies focused on brand personality. Such approaches show limitations and are insufficient to investigate on the relationship between store environment and brand personality in the service industry. Accordingly, the study intends to identify the level of contribution to the establishment of brand personality made by the store's physical environments that influence on the specific brand characteristics depending on the type of service. The study also intends to identify what kind of relationships with brand personality exists with brand personality while being influenced by store environments. In addition, the study intends to make meaningful suggestions to better direct marketing efforts by identifying whether a brand personality makes a positive influence to induce an intention for repurchase. For this study, the service industry is classified into four categories based on to the characteristics of service: experimental-emotional service, emotional -credible service, credible-functional service, and functional-experimental service. The type of business with the most frequent customer contact is determined for each service type and the enterprise with the highest brand value in each service sector based on the report made by the Korea Management Association. They are designated as the representative of each category. The selected representatives are a fast-food store (experimental-emotional service), a cinema house (emotional-credible service), a bank (credible-functional service), and discount store (functional-experimental service). The survey was conducted for the four selected brands to represent each service category among consumers who are experienced users of the designated stores in Seoul Metropolitan City and Gyeonggi province via written questionnaires in order to verify the suggested assumptions in the study. In particular, the survey adopted 15 scales, which represent each characteristic factor, among the 42 unique characteristics developed by Jennifer Aaker(1997) to assess the brand personality of each service brand. SPSS for Windows Release 12.0 and LISREL were used in the analysis of data verification. The methodology of the structural equation model was used for the study and the pivotal findings are as follows. 1) The environmental factors ware classified as design factors, ambient factors, and social factors. Therefore, the validity of measurement scale of Baker et al. (1994) was proved. 2) The service brand personalities were subdivided as sincerity, excitement, competence, sophistication, and ruggedness, which makes the use of the brand personality scales by Jennifer Aaker(1997) appropriate in the service industry as well. 3) One-way ANOVA analysis on the scales of store environment and service brand personality showed that there exist statistically significant differences in each service category. For example, the social factors were highest in discount stores, while the ambient factors and design factors were highest in fast-food stores. The discount stores were highest in the sincerity and excitement, while the highest point for banks was in the competence and ruggedness, and the highest point for fast-food stores was in the sophistication, The consumers will make a different respond to the physical environment of stores and service brand personality that are inherent to the corresponding service interface. Hence, the customers will make a different decision-making when dealing with different service categories. In this aspect, the relationships of variables in the proposed hypothesis appear to work in a different way depending on the exposed service category. 4) The store environment factors influenced on service brand personalities differently by category of service. The factors of store's physical environment are transferred to a brand and were verified to strengthen service brand personalities. In particular, the level of influence on the service brand personality by physical environment differs depending on service category or dimension, which indicates that there is a need to apply a different style of management to a different service category or dimension. It signifies that there needs to be a brand strategy established in order to positively influence the relationship with consumers by utilizing an appropriate brand personality factor depending on different characteristics by service category or dimension. 5) The service brand personalities influenced on the repurchase intention. Especially, the largest influence was made in the sophistication dimension of service brand personality scale; the unique and characteristically appropriate arrangement of physical environment will make customers stay in the service environment for a long time and will lead to give a positive influence on the repurchase intention. 6) The store environment factors influenced on the repurchase intention. Particularly, the largest influence was made on the social factors of store environment. The most intriguing finding is that the service factor among all other environment factors gives the biggest influence to the repurchase intention in most of all service types except fast-food stores. Such result indicates that the customers pay attention to how much the employees try to provide a quality service when they make an evaluation on the service brand. At the same time, it also indicates that the personal factor is directly transmitted to the construction of brand personality. The employees' attitude and behavior are the determinants to establish a service brand personality in the process of enhancing service interface. Hence, there should be a reinforced search for a method to efficiently manage the service staff who has a direct contact with customers in order to make an affirmative improvement of the customers' brand evaluation at the service interface. The findings suggest several managerial implications. 1) Results from the empirical study indicated that store environment factors have a strong positive impact on a service brand personality. To increase customers' repurchase intention of a service brand, the management is required to effectively manage store environment factors and create a friendly brand personality based on the corresponding service environment. 2) Mangers and researchers must understand and recognize that the store environment elements are important marketing tools, and that brand personality influences on consumers' repurchase intention. Based on such result of the study, a service brand could be utilized as an efficient measure to achieve a differentiation by enforcing the elements that are most influential among all other store environments for each service category. Therefore, brand personality established involving various store environments will further reinforce the relationship with customers through the elevated brand identification of which utilization to induce repurchase decision can be used as an entry barrier. 3) The study identified the store environment as a component of service brand personality for the store's effective communication with consumers. For this, all communication channels should be maintained with consistency and an integrated marketing communication should be executed to efficiently approach to a larger number of customers. Mangers and researchers must find strategies for aligning decisions about store environment elements with the retailers' marketing and store personality objectives. All ambient, design, and social factors need to be orchestrated so that consumers can take an appropriate store personality. In this study, the induced results from the previous studies were extended to the service industry so as to identify the customers' decision making process that leads to repurchase intention and a result similar to those of the previous studies. The findings suggested several theoretical and managerial implications. However, the situation that only one service brand served as the subject of analysis for each service category, and the situation that correlations among store environment elements were not identified, as well as the problem of representation in selection of samples should be considered and supplemented in the future when further studies are conducted. In addition, various antecedents and consequences of brand personality must be looked at in the aspect of the service environment for further research.