• Title/Summary/Keyword: Evaluation Methodology

Search Result 2,433, Processing Time 0.024 seconds

Information Privacy Concern in Context-Aware Personalized Services: Results of a Delphi Study

  • Lee, Yon-Nim;Kwon, Oh-Byung
    • Asia pacific journal of information systems
    • /
    • v.20 no.2
    • /
    • pp.63-86
    • /
    • 2010
  • Personalized services directly and indirectly acquire personal data, in part, to provide customers with higher-value services that are specifically context-relevant (such as place and time). Information technologies continue to mature and develop, providing greatly improved performance. Sensory networks and intelligent software can now obtain context data, and that is the cornerstone for providing personalized, context-specific services. Yet, the danger of overflowing personal information is increasing because the data retrieved by the sensors usually contains privacy information. Various technical characteristics of context-aware applications have more troubling implications for information privacy. In parallel with increasing use of context for service personalization, information privacy concerns have also increased such as an unrestricted availability of context information. Those privacy concerns are consistently regarded as a critical issue facing context-aware personalized service success. The entire field of information privacy is growing as an important area of research, with many new definitions and terminologies, because of a need for a better understanding of information privacy concepts. Especially, it requires that the factors of information privacy should be revised according to the characteristics of new technologies. However, previous information privacy factors of context-aware applications have at least two shortcomings. First, there has been little overview of the technology characteristics of context-aware computing. Existing studies have only focused on a small subset of the technical characteristics of context-aware computing. Therefore, there has not been a mutually exclusive set of factors that uniquely and completely describe information privacy on context-aware applications. Second, user survey has been widely used to identify factors of information privacy in most studies despite the limitation of users' knowledge and experiences about context-aware computing technology. To date, since context-aware services have not been widely deployed on a commercial scale yet, only very few people have prior experiences with context-aware personalized services. It is difficult to build users' knowledge about context-aware technology even by increasing their understanding in various ways: scenarios, pictures, flash animation, etc. Nevertheless, conducting a survey, assuming that the participants have sufficient experience or understanding about the technologies shown in the survey, may not be absolutely valid. Moreover, some surveys are based solely on simplifying and hence unrealistic assumptions (e.g., they only consider location information as a context data). A better understanding of information privacy concern in context-aware personalized services is highly needed. Hence, the purpose of this paper is to identify a generic set of factors for elemental information privacy concern in context-aware personalized services and to develop a rank-order list of information privacy concern factors. We consider overall technology characteristics to establish a mutually exclusive set of factors. A Delphi survey, a rigorous data collection method, was deployed to obtain a reliable opinion from the experts and to produce a rank-order list. It, therefore, lends itself well to obtaining a set of universal factors of information privacy concern and its priority. An international panel of researchers and practitioners who have the expertise in privacy and context-aware system fields were involved in our research. Delphi rounds formatting will faithfully follow the procedure for the Delphi study proposed by Okoli and Pawlowski. This will involve three general rounds: (1) brainstorming for important factors; (2) narrowing down the original list to the most important ones; and (3) ranking the list of important factors. For this round only, experts were treated as individuals, not panels. Adapted from Okoli and Pawlowski, we outlined the process of administrating the study. We performed three rounds. In the first and second rounds of the Delphi questionnaire, we gathered a set of exclusive factors for information privacy concern in context-aware personalized services. The respondents were asked to provide at least five main factors for the most appropriate understanding of the information privacy concern in the first round. To do so, some of the main factors found in the literature were presented to the participants. The second round of the questionnaire discussed the main factor provided in the first round, fleshed out with relevant sub-factors. Respondents were then requested to evaluate each sub factor's suitability against the corresponding main factors to determine the final sub-factors from the candidate factors. The sub-factors were found from the literature survey. Final factors selected by over 50% of experts. In the third round, a list of factors with corresponding questions was provided, and the respondents were requested to assess the importance of each main factor and its corresponding sub factors. Finally, we calculated the mean rank of each item to make a final result. While analyzing the data, we focused on group consensus rather than individual insistence. To do so, a concordance analysis, which measures the consistency of the experts' responses over successive rounds of the Delphi, was adopted during the survey process. As a result, experts reported that context data collection and high identifiable level of identical data are the most important factor in the main factors and sub factors, respectively. Additional important sub-factors included diverse types of context data collected, tracking and recording functionalities, and embedded and disappeared sensor devices. The average score of each factor is very useful for future context-aware personalized service development in the view of the information privacy. The final factors have the following differences comparing to those proposed in other studies. First, the concern factors differ from existing studies, which are based on privacy issues that may occur during the lifecycle of acquired user information. However, our study helped to clarify these sometimes vague issues by determining which privacy concern issues are viable based on specific technical characteristics in context-aware personalized services. Since a context-aware service differs in its technical characteristics compared to other services, we selected specific characteristics that had a higher potential to increase user's privacy concerns. Secondly, this study considered privacy issues in terms of service delivery and display that were almost overlooked in existing studies by introducing IPOS as the factor division. Lastly, in each factor, it correlated the level of importance with professionals' opinions as to what extent users have privacy concerns. The reason that it did not select the traditional method questionnaire at that time is that context-aware personalized service considered the absolute lack in understanding and experience of users with new technology. For understanding users' privacy concerns, professionals in the Delphi questionnaire process selected context data collection, tracking and recording, and sensory network as the most important factors among technological characteristics of context-aware personalized services. In the creation of a context-aware personalized services, this study demonstrates the importance and relevance of determining an optimal methodology, and which technologies and in what sequence are needed, to acquire what types of users' context information. Most studies focus on which services and systems should be provided and developed by utilizing context information on the supposition, along with the development of context-aware technology. However, the results in this study show that, in terms of users' privacy, it is necessary to pay greater attention to the activities that acquire context information. To inspect the results in the evaluation of sub factor, additional studies would be necessary for approaches on reducing users' privacy concerns toward technological characteristics such as highly identifiable level of identical data, diverse types of context data collected, tracking and recording functionality, embedded and disappearing sensor devices. The factor ranked the next highest level of importance after input is a context-aware service delivery that is related to output. The results show that delivery and display showing services to users in a context-aware personalized services toward the anywhere-anytime-any device concept have been regarded as even more important than in previous computing environment. Considering the concern factors to develop context aware personalized services will help to increase service success rate and hopefully user acceptance for those services. Our future work will be to adopt these factors for qualifying context aware service development projects such as u-city development projects in terms of service quality and hence user acceptance.

Emoticon by Emotions: The Development of an Emoticon Recommendation System Based on Consumer Emotions (Emoticon by Emotions: 소비자 감성 기반 이모티콘 추천 시스템 개발)

  • Kim, Keon-Woo;Park, Do-Hyung
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.227-252
    • /
    • 2018
  • The evolution of instant communication has mirrored the development of the Internet and messenger applications are among the most representative manifestations of instant communication technologies. In messenger applications, senders use emoticons to supplement the emotions conveyed in the text of their messages. The fact that communication via messenger applications is not face-to-face makes it difficult for senders to communicate their emotions to message recipients. Emoticons have long been used as symbols that indicate the moods of speakers. However, at present, emoticon-use is evolving into a means of conveying the psychological states of consumers who want to express individual characteristics and personality quirks while communicating their emotions to others. The fact that companies like KakaoTalk, Line, Apple, etc. have begun conducting emoticon business and sales of related content are expected to gradually increase testifies to the significance of this phenomenon. Nevertheless, despite the development of emoticons themselves and the growth of the emoticon market, no suitable emoticon recommendation system has yet been developed. Even KakaoTalk, a messenger application that commands more than 90% of domestic market share in South Korea, just grouped in to popularity, most recent, or brief category. This means consumers face the inconvenience of constantly scrolling around to locate the emoticons they want. The creation of an emoticon recommendation system would improve consumer convenience and satisfaction and increase the sales revenue of companies the sell emoticons. To recommend appropriate emoticons, it is necessary to quantify the emotions that the consumer sees and emotions. Such quantification will enable us to analyze the characteristics and emotions felt by consumers who used similar emoticons, which, in turn, will facilitate our emoticon recommendations for consumers. One way to quantify emoticons use is metadata-ization. Metadata-ization is a means of structuring or organizing unstructured and semi-structured data to extract meaning. By structuring unstructured emoticon data through metadata-ization, we can easily classify emoticons based on the emotions consumers want to express. To determine emoticons' precise emotions, we had to consider sub-detail expressions-not only the seven common emotional adjectives but also the metaphorical expressions that appear only in South Korean proved by previous studies related to emotion focusing on the emoticon's characteristics. We therefore collected the sub-detail expressions of emotion based on the "Shape", "Color" and "Adumbration". Moreover, to design a highly accurate recommendation system, we considered both emotion-technical indexes and emoticon-emotional indexes. We then identified 14 features of emoticon-technical indexes and selected 36 emotional adjectives. The 36 emotional adjectives consisted of contrasting adjectives, which we reduced to 18, and we measured the 18 emotional adjectives using 40 emoticon sets randomly selected from the top-ranked emoticons in the KakaoTalk shop. We surveyed 277 consumers in their mid-twenties who had experience purchasing emoticons; we recruited them online and asked them to evaluate five different emoticon sets. After data acquisition, we conducted a factor analysis of emoticon-emotional factors. We extracted four factors that we named "Comic", Softness", "Modernity" and "Transparency". We analyzed both the relationship between indexes and consumer attitude and the relationship between emoticon-technical indexes and emoticon-emotional factors. Through this process, we confirmed that the emoticon-technical indexes did not directly affect consumer attitudes but had a mediating effect on consumer attitudes through emoticon-emotional factors. The results of the analysis revealed the mechanism consumers use to evaluate emoticons; the results also showed that consumers' emoticon-technical indexes affected emoticon-emotional factors and that the emoticon-emotional factors affected consumer satisfaction. We therefore designed the emoticon recommendation system using only four emoticon-emotional factors; we created a recommendation method to calculate the Euclidean distance from each factors' emotion. In an attempt to increase the accuracy of the emoticon recommendation system, we compared the emotional patterns of selected emoticons with the recommended emoticons. The emotional patterns corresponded in principle. We verified the emoticon recommendation system by testing prediction accuracy; the predictions were 81.02% accurate in the first result, 76.64% accurate in the second, and 81.63% accurate in the third. This study developed a methodology that can be used in various fields academically and practically. We expect that the novel emoticon recommendation system we designed will increase emoticon sales for companies who conduct business in this domain and make consumer experiences more convenient. In addition, this study served as an important first step in the development of an intelligent emoticon recommendation system. The emotional factors proposed in this study could be collected in an emotional library that could serve as an emotion index for evaluation when new emoticons are released. Moreover, by combining the accumulated emotional library with company sales data, sales information, and consumer data, companies could develop hybrid recommendation systems that would bolster convenience for consumers and serve as intellectual assets that companies could strategically deploy.

The Influence of Store Environment on Service Brand Personality and Repurchase Intention (점포의 물리적 환경이 서비스 브랜드 개성과 재구매의도에 미치는 영향)

  • Kim, Hyoung-Gil;Kim, Jung-Hee;Kim, Youn-Jeong
    • Journal of Global Scholars of Marketing Science
    • /
    • v.17 no.4
    • /
    • pp.141-173
    • /
    • 2007
  • The study examines how the environmental factors of store influence service brand personality and repurchase intention in the service environment. The service industry has been experiencing the intensified competition with the industry's continuous growth and the influence from rapid technological advancement. Under the circumstances, it has become ever more important for the brand competitiveness to be distinctively recognized against competition. A brand needs to be distinguished and differentiated from competing companies because they are all engaged in the similar environment of the service industry. The differentiation of brand achievement has become increasingly important to highlight certain brand functions to include emotional, self-expressive, and symbolic functions since the importance of such functions has been further emphasized in promoting consumption activities. That is the recent role of brand personality that has been emphasized in the service industry. In other words, customers now freely and actively express their personalities or egos in consumption activities, taking an important role in construction of a brand asset. Hence, the study suggests that it is necessary to disperse the recognition and acknowledgement that the maintenance of the existing customers contributes more to boost repurchase intention when it is compared to the efforts to create new customers, particularly in the service industry. Meanwhile, the store itself can offer a unique environment that may influence the consumer's purchase decision. Consumers interact with store environments in the process of,virtually, all household purchase they make (Sarel 1981). Thus, store environments may encourage customers to purchase. The roles that store environments play are to provide informational cues to customers about the store and goods and communicate messages to stimulate consumers' emotions. The store environments differentiate the store from competing stores and build a unique service brand personality. However, the existing studies related to brand in the service industry mostly concentrated on the relationship between the quality of service and customer satisfaction, and they are mostly generalized while the connective studies focused on brand personality. Such approaches show limitations and are insufficient to investigate on the relationship between store environment and brand personality in the service industry. Accordingly, the study intends to identify the level of contribution to the establishment of brand personality made by the store's physical environments that influence on the specific brand characteristics depending on the type of service. The study also intends to identify what kind of relationships with brand personality exists with brand personality while being influenced by store environments. In addition, the study intends to make meaningful suggestions to better direct marketing efforts by identifying whether a brand personality makes a positive influence to induce an intention for repurchase. For this study, the service industry is classified into four categories based on to the characteristics of service: experimental-emotional service, emotional -credible service, credible-functional service, and functional-experimental service. The type of business with the most frequent customer contact is determined for each service type and the enterprise with the highest brand value in each service sector based on the report made by the Korea Management Association. They are designated as the representative of each category. The selected representatives are a fast-food store (experimental-emotional service), a cinema house (emotional-credible service), a bank (credible-functional service), and discount store (functional-experimental service). The survey was conducted for the four selected brands to represent each service category among consumers who are experienced users of the designated stores in Seoul Metropolitan City and Gyeonggi province via written questionnaires in order to verify the suggested assumptions in the study. In particular, the survey adopted 15 scales, which represent each characteristic factor, among the 42 unique characteristics developed by Jennifer Aaker(1997) to assess the brand personality of each service brand. SPSS for Windows Release 12.0 and LISREL were used in the analysis of data verification. The methodology of the structural equation model was used for the study and the pivotal findings are as follows. 1) The environmental factors ware classified as design factors, ambient factors, and social factors. Therefore, the validity of measurement scale of Baker et al. (1994) was proved. 2) The service brand personalities were subdivided as sincerity, excitement, competence, sophistication, and ruggedness, which makes the use of the brand personality scales by Jennifer Aaker(1997) appropriate in the service industry as well. 3) One-way ANOVA analysis on the scales of store environment and service brand personality showed that there exist statistically significant differences in each service category. For example, the social factors were highest in discount stores, while the ambient factors and design factors were highest in fast-food stores. The discount stores were highest in the sincerity and excitement, while the highest point for banks was in the competence and ruggedness, and the highest point for fast-food stores was in the sophistication, The consumers will make a different respond to the physical environment of stores and service brand personality that are inherent to the corresponding service interface. Hence, the customers will make a different decision-making when dealing with different service categories. In this aspect, the relationships of variables in the proposed hypothesis appear to work in a different way depending on the exposed service category. 4) The store environment factors influenced on service brand personalities differently by category of service. The factors of store's physical environment are transferred to a brand and were verified to strengthen service brand personalities. In particular, the level of influence on the service brand personality by physical environment differs depending on service category or dimension, which indicates that there is a need to apply a different style of management to a different service category or dimension. It signifies that there needs to be a brand strategy established in order to positively influence the relationship with consumers by utilizing an appropriate brand personality factor depending on different characteristics by service category or dimension. 5) The service brand personalities influenced on the repurchase intention. Especially, the largest influence was made in the sophistication dimension of service brand personality scale; the unique and characteristically appropriate arrangement of physical environment will make customers stay in the service environment for a long time and will lead to give a positive influence on the repurchase intention. 6) The store environment factors influenced on the repurchase intention. Particularly, the largest influence was made on the social factors of store environment. The most intriguing finding is that the service factor among all other environment factors gives the biggest influence to the repurchase intention in most of all service types except fast-food stores. Such result indicates that the customers pay attention to how much the employees try to provide a quality service when they make an evaluation on the service brand. At the same time, it also indicates that the personal factor is directly transmitted to the construction of brand personality. The employees' attitude and behavior are the determinants to establish a service brand personality in the process of enhancing service interface. Hence, there should be a reinforced search for a method to efficiently manage the service staff who has a direct contact with customers in order to make an affirmative improvement of the customers' brand evaluation at the service interface. The findings suggest several managerial implications. 1) Results from the empirical study indicated that store environment factors have a strong positive impact on a service brand personality. To increase customers' repurchase intention of a service brand, the management is required to effectively manage store environment factors and create a friendly brand personality based on the corresponding service environment. 2) Mangers and researchers must understand and recognize that the store environment elements are important marketing tools, and that brand personality influences on consumers' repurchase intention. Based on such result of the study, a service brand could be utilized as an efficient measure to achieve a differentiation by enforcing the elements that are most influential among all other store environments for each service category. Therefore, brand personality established involving various store environments will further reinforce the relationship with customers through the elevated brand identification of which utilization to induce repurchase decision can be used as an entry barrier. 3) The study identified the store environment as a component of service brand personality for the store's effective communication with consumers. For this, all communication channels should be maintained with consistency and an integrated marketing communication should be executed to efficiently approach to a larger number of customers. Mangers and researchers must find strategies for aligning decisions about store environment elements with the retailers' marketing and store personality objectives. All ambient, design, and social factors need to be orchestrated so that consumers can take an appropriate store personality. In this study, the induced results from the previous studies were extended to the service industry so as to identify the customers' decision making process that leads to repurchase intention and a result similar to those of the previous studies. The findings suggested several theoretical and managerial implications. However, the situation that only one service brand served as the subject of analysis for each service category, and the situation that correlations among store environment elements were not identified, as well as the problem of representation in selection of samples should be considered and supplemented in the future when further studies are conducted. In addition, various antecedents and consequences of brand personality must be looked at in the aspect of the service environment for further research.

  • PDF