• Title/Summary/Keyword: User Experience Evaluation

Search Result 276, Processing Time 0.022 seconds

A study on perceived interactivity of Dance video contents and intention to use: Focused on YouTube (무용영상콘텐츠의 정보서비스 이용에 대한 상호작용성 인식과 이용지속의도에 관한 연구- 유투브를 중심으로)

  • Jung, Sae-Bom;Won, Do-Yeon;Jang, Young-Jin
    • 한국체육학회지인문사회과학편
    • /
    • v.55 no.3
    • /
    • pp.349-363
    • /
    • 2016
  • The purpose of this study was to perceived interactivity about experience of using dance video contents and intention to use. This study was examine an adaptive model of Technology Acceptance Model and focused on YouTube. In order to achieve the purpose of this study, total 350 questionnaires were surveyed and 311 data were finally analyzed. All data were processed through SPSS for Windows 20.0 version and AMOS 18.0. For the analysis of data, frequency analysis, reliability analysis, confirmatory factor analysis, correlation analysis, model evaluation, and structural equation modeling techniques. The results were as follows. first. Perceived Interactivity had not affect on perceived usefulness but two-way communication, user control among the sub-factor in perceived Interactivity had a positive effect on perceived ease of use. second, perceived ease of use had a positive effect on perceived usefulness. Lastly, Perceived usefulness had not affect intention to use, but perceived ease of use had a positive effect on intention use.

Information Privacy Concern in Context-Aware Personalized Services: Results of a Delphi Study

  • Lee, Yon-Nim;Kwon, Oh-Byung
    • Asia pacific journal of information systems
    • /
    • v.20 no.2
    • /
    • pp.63-86
    • /
    • 2010
  • Personalized services directly and indirectly acquire personal data, in part, to provide customers with higher-value services that are specifically context-relevant (such as place and time). Information technologies continue to mature and develop, providing greatly improved performance. Sensory networks and intelligent software can now obtain context data, and that is the cornerstone for providing personalized, context-specific services. Yet, the danger of overflowing personal information is increasing because the data retrieved by the sensors usually contains privacy information. Various technical characteristics of context-aware applications have more troubling implications for information privacy. In parallel with increasing use of context for service personalization, information privacy concerns have also increased such as an unrestricted availability of context information. Those privacy concerns are consistently regarded as a critical issue facing context-aware personalized service success. The entire field of information privacy is growing as an important area of research, with many new definitions and terminologies, because of a need for a better understanding of information privacy concepts. Especially, it requires that the factors of information privacy should be revised according to the characteristics of new technologies. However, previous information privacy factors of context-aware applications have at least two shortcomings. First, there has been little overview of the technology characteristics of context-aware computing. Existing studies have only focused on a small subset of the technical characteristics of context-aware computing. Therefore, there has not been a mutually exclusive set of factors that uniquely and completely describe information privacy on context-aware applications. Second, user survey has been widely used to identify factors of information privacy in most studies despite the limitation of users' knowledge and experiences about context-aware computing technology. To date, since context-aware services have not been widely deployed on a commercial scale yet, only very few people have prior experiences with context-aware personalized services. It is difficult to build users' knowledge about context-aware technology even by increasing their understanding in various ways: scenarios, pictures, flash animation, etc. Nevertheless, conducting a survey, assuming that the participants have sufficient experience or understanding about the technologies shown in the survey, may not be absolutely valid. Moreover, some surveys are based solely on simplifying and hence unrealistic assumptions (e.g., they only consider location information as a context data). A better understanding of information privacy concern in context-aware personalized services is highly needed. Hence, the purpose of this paper is to identify a generic set of factors for elemental information privacy concern in context-aware personalized services and to develop a rank-order list of information privacy concern factors. We consider overall technology characteristics to establish a mutually exclusive set of factors. A Delphi survey, a rigorous data collection method, was deployed to obtain a reliable opinion from the experts and to produce a rank-order list. It, therefore, lends itself well to obtaining a set of universal factors of information privacy concern and its priority. An international panel of researchers and practitioners who have the expertise in privacy and context-aware system fields were involved in our research. Delphi rounds formatting will faithfully follow the procedure for the Delphi study proposed by Okoli and Pawlowski. This will involve three general rounds: (1) brainstorming for important factors; (2) narrowing down the original list to the most important ones; and (3) ranking the list of important factors. For this round only, experts were treated as individuals, not panels. Adapted from Okoli and Pawlowski, we outlined the process of administrating the study. We performed three rounds. In the first and second rounds of the Delphi questionnaire, we gathered a set of exclusive factors for information privacy concern in context-aware personalized services. The respondents were asked to provide at least five main factors for the most appropriate understanding of the information privacy concern in the first round. To do so, some of the main factors found in the literature were presented to the participants. The second round of the questionnaire discussed the main factor provided in the first round, fleshed out with relevant sub-factors. Respondents were then requested to evaluate each sub factor's suitability against the corresponding main factors to determine the final sub-factors from the candidate factors. The sub-factors were found from the literature survey. Final factors selected by over 50% of experts. In the third round, a list of factors with corresponding questions was provided, and the respondents were requested to assess the importance of each main factor and its corresponding sub factors. Finally, we calculated the mean rank of each item to make a final result. While analyzing the data, we focused on group consensus rather than individual insistence. To do so, a concordance analysis, which measures the consistency of the experts' responses over successive rounds of the Delphi, was adopted during the survey process. As a result, experts reported that context data collection and high identifiable level of identical data are the most important factor in the main factors and sub factors, respectively. Additional important sub-factors included diverse types of context data collected, tracking and recording functionalities, and embedded and disappeared sensor devices. The average score of each factor is very useful for future context-aware personalized service development in the view of the information privacy. The final factors have the following differences comparing to those proposed in other studies. First, the concern factors differ from existing studies, which are based on privacy issues that may occur during the lifecycle of acquired user information. However, our study helped to clarify these sometimes vague issues by determining which privacy concern issues are viable based on specific technical characteristics in context-aware personalized services. Since a context-aware service differs in its technical characteristics compared to other services, we selected specific characteristics that had a higher potential to increase user's privacy concerns. Secondly, this study considered privacy issues in terms of service delivery and display that were almost overlooked in existing studies by introducing IPOS as the factor division. Lastly, in each factor, it correlated the level of importance with professionals' opinions as to what extent users have privacy concerns. The reason that it did not select the traditional method questionnaire at that time is that context-aware personalized service considered the absolute lack in understanding and experience of users with new technology. For understanding users' privacy concerns, professionals in the Delphi questionnaire process selected context data collection, tracking and recording, and sensory network as the most important factors among technological characteristics of context-aware personalized services. In the creation of a context-aware personalized services, this study demonstrates the importance and relevance of determining an optimal methodology, and which technologies and in what sequence are needed, to acquire what types of users' context information. Most studies focus on which services and systems should be provided and developed by utilizing context information on the supposition, along with the development of context-aware technology. However, the results in this study show that, in terms of users' privacy, it is necessary to pay greater attention to the activities that acquire context information. To inspect the results in the evaluation of sub factor, additional studies would be necessary for approaches on reducing users' privacy concerns toward technological characteristics such as highly identifiable level of identical data, diverse types of context data collected, tracking and recording functionality, embedded and disappearing sensor devices. The factor ranked the next highest level of importance after input is a context-aware service delivery that is related to output. The results show that delivery and display showing services to users in a context-aware personalized services toward the anywhere-anytime-any device concept have been regarded as even more important than in previous computing environment. Considering the concern factors to develop context aware personalized services will help to increase service success rate and hopefully user acceptance for those services. Our future work will be to adopt these factors for qualifying context aware service development projects such as u-city development projects in terms of service quality and hence user acceptance.

A Checklist to Improve the Fairness in AI Financial Service: Focused on the AI-based Credit Scoring Service (인공지능 기반 금융서비스의 공정성 확보를 위한 체크리스트 제안: 인공지능 기반 개인신용평가를 중심으로)

  • Kim, HaYeong;Heo, JeongYun;Kwon, Hochang
    • Journal of Intelligence and Information Systems
    • /
    • v.28 no.3
    • /
    • pp.259-278
    • /
    • 2022
  • With the spread of Artificial Intelligence (AI), various AI-based services are expanding in the financial sector such as service recommendation, automated customer response, fraud detection system(FDS), credit scoring services, etc. At the same time, problems related to reliability and unexpected social controversy are also occurring due to the nature of data-based machine learning. The need Based on this background, this study aimed to contribute to improving trust in AI-based financial services by proposing a checklist to secure fairness in AI-based credit scoring services which directly affects consumers' financial life. Among the key elements of trustworthy AI like transparency, safety, accountability, and fairness, fairness was selected as the subject of the study so that everyone could enjoy the benefits of automated algorithms from the perspective of inclusive finance without social discrimination. We divided the entire fairness related operation process into three areas like data, algorithms, and user areas through literature research. For each area, we constructed four detailed considerations for evaluation resulting in 12 checklists. The relative importance and priority of the categories were evaluated through the analytic hierarchy process (AHP). We use three different groups: financial field workers, artificial intelligence field workers, and general users which represent entire financial stakeholders. According to the importance of each stakeholder, three groups were classified and analyzed, and from a practical perspective, specific checks such as feasibility verification for using learning data and non-financial information and monitoring new inflow data were identified. Moreover, financial consumers in general were found to be highly considerate of the accuracy of result analysis and bias checks. We expect this result could contribute to the design and operation of fair AI-based financial services.

What Determines the Emotional Quality of Homepage\ulcorner - from the emotion, users and designers perspectives (무엇이 홈페이지의 감성 품질을 결정하는가\ulcorner -감성 측면과 디자이너의 측면 그리고 사용자 측면을 중심으로)

  • 박수이;최동성;김진우
    • Archives of design research
    • /
    • v.15 no.4
    • /
    • pp.97-110
    • /
    • 2002
  • As users environments change, users primary needs for homepages also change more complicatedly. Today, users do not only want usability for homepages, but also to feel appropriate emotional experiences. Despite users needs, users do not always experience appropriate emotions that are conveyed by designers through homepage. I In this research paper, we analyzed the related factors with the emotional quality, which means the degree that users feel target emotions intended by designers. For analyzing factors related with the emotional quality, three hypotheses were verified; the factor of an emotion, the factor of users and the factor of designers. As the factor of emotions, the first hypothesis is that unclear emotional dimensions in users minds are related with the emotional quality. The second hypothesis, as the factor of users, is that the diversity of users experiences by same homepage is related with the emotional quality. The third hypothesis, as the factor of designers, is that the appropriate selection of design elements is related with the emotional quality. In the previous research, we selected the basic 13 emotional dimensions and 30 representative emotional words based on the statistical results and evaluations by professional designers. For this research, we conducted an experiment and user survey. In the experiment, we asked 30 designers to design homepages focusing on the typical emotion that was presented by a researcher. Based on the designing process and user evaluation, we performed statistical analyses: ANOVA with Tukey post hoc method and Factor Analysis. We found the discrepancy between the emotions that designers intend and the actual emotions that users experienced from homepages. From the result of analysis, we know that the factor of users and the factor of designers related with the emotional qualities, but the factor of emotions did not. The definiteness of emotions did not relate with the emotional quality. However, the diversity of emotions that users feel seeing the same homepages and design elements that designers chose for conveying target emotion related with the emotional quality.

  • PDF

Export Control System based on Case Based Reasoning: Design and Evaluation (사례 기반 지능형 수출통제 시스템 : 설계와 평가)

  • Hong, Woneui;Kim, Uihyun;Cho, Sinhee;Kim, Sansung;Yi, Mun Yong;Shin, Donghoon
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.3
    • /
    • pp.109-131
    • /
    • 2014
  • As the demand of nuclear power plant equipment is continuously growing worldwide, the importance of handling nuclear strategic materials is also increasing. While the number of cases submitted for the exports of nuclear-power commodity and technology is dramatically increasing, preadjudication (or prescreening to be simple) of strategic materials has been done so far by experts of a long-time experience and extensive field knowledge. However, there is severe shortage of experts in this domain, not to mention that it takes a long time to develop an expert. Because human experts must manually evaluate all the documents submitted for export permission, the current practice of nuclear material export is neither time-efficient nor cost-effective. Toward alleviating the problem of relying on costly human experts only, our research proposes a new system designed to help field experts make their decisions more effectively and efficiently. The proposed system is built upon case-based reasoning, which in essence extracts key features from the existing cases, compares the features with the features of a new case, and derives a solution for the new case by referencing similar cases and their solutions. Our research proposes a framework of case-based reasoning system, designs a case-based reasoning system for the control of nuclear material exports, and evaluates the performance of alternative keyword extraction methods (full automatic, full manual, and semi-automatic). A keyword extraction method is an essential component of the case-based reasoning system as it is used to extract key features of the cases. The full automatic method was conducted using TF-IDF, which is a widely used de facto standard method for representative keyword extraction in text mining. TF (Term Frequency) is based on the frequency count of the term within a document, showing how important the term is within a document while IDF (Inverted Document Frequency) is based on the infrequency of the term within a document set, showing how uniquely the term represents the document. The results show that the semi-automatic approach, which is based on the collaboration of machine and human, is the most effective solution regardless of whether the human is a field expert or a student who majors in nuclear engineering. Moreover, we propose a new approach of computing nuclear document similarity along with a new framework of document analysis. The proposed algorithm of nuclear document similarity considers both document-to-document similarity (${\alpha}$) and document-to-nuclear system similarity (${\beta}$), in order to derive the final score (${\gamma}$) for the decision of whether the presented case is of strategic material or not. The final score (${\gamma}$) represents a document similarity between the past cases and the new case. The score is induced by not only exploiting conventional TF-IDF, but utilizing a nuclear system similarity score, which takes the context of nuclear system domain into account. Finally, the system retrieves top-3 documents stored in the case base that are considered as the most similar cases with regard to the new case, and provides them with the degree of credibility. With this final score and the credibility score, it becomes easier for a user to see which documents in the case base are more worthy of looking up so that the user can make a proper decision with relatively lower cost. The evaluation of the system has been conducted by developing a prototype and testing with field data. The system workflows and outcomes have been verified by the field experts. This research is expected to contribute the growth of knowledge service industry by proposing a new system that can effectively reduce the burden of relying on costly human experts for the export control of nuclear materials and that can be considered as a meaningful example of knowledge service application.

User Behavior and Improvement for Kumgang Pine Eco-Forest in Uljin (울진금강송 생태숲의 이용자 행태분석과 개선방안)

  • Oh, Nam-Hyun
    • Korean Journal of Environment and Ecology
    • /
    • v.22 no.3
    • /
    • pp.249-259
    • /
    • 2008
  • The purpose of this study was to analyze the users' behaviors and to suggest development strategies in Uljin Kumgang pine tree(Pinus densiflora for. erecta) eco-forest(UKPEF), which is located in Kyeongbuk. The data were collected by interviewing 122 visitors to september 3 from august 29, 2007 with a constructed questionnaire. The results of the analysis are as follows. 1. The major visitors of UKPEF are male and the age between 20 to 30, the residents of the Uljin county with relatively high academic background. 2. The motive of visiting UKPEF is mainly by the beauty and taste of Kumgang pine tree and the condition of the forest. The visitors are mainly composed of family, not big group. 3. The visitors of UKPEF have obtained information about the Kumgang fine tree forest mainly from friends, not from the internet or travel agency. 4. The visitors of UKPEF pointed out lack of convenient facilities such as toilets and water-supply facilities. However, visitors are satisfied by the condition of the forest. 5. The visitors of UKPEF set a high value on Kumgang fine tree, So, more active marketing strategy about Uljin Kumgang pine tree has to be established. 6. The visitors of UKPEF are more satisfied by the Uljin Kumgang pine tree forest than expected. The development strategies of UKPEF are suggest as follows. (1) Auto tram system has to be set up and new trail should be constructed to attract more visitors and people of other regions. (2) To attract group tourists, new program should be developed. (3) Advertisement through internet or travel agency has to be developed. (4) Government(local) should make a plan to register the forest as World natural heritage. (5) Monitoring and evaluation system has to be developed to satisfy tourists. In conclusion, the efforts of taking care of and preserving the UKPEF should be made at the national level. I hope that more Koreans can have chance to feel and experience the value and excellence ofthe Uljin Kumgang pine tree(Pinus densiflora for. erecta)