• Title/Summary/Keyword: evaluation of users

Search Result 2,096, Processing Time 0.035 seconds

Predicting Missing Ratings of Each Evaluation Criteria for Hotel by Analyzing User Reviews (사용자 리뷰 분석을 통한 호텔 평가 항목별 누락 평점 예측 방법론)

  • Lee, Donghoon;Boo, Hyunkyung;Kim, Namgyu
    • Journal of Information Technology Services
    • /
    • v.16 no.4
    • /
    • pp.161-176
    • /
    • 2017
  • Recently, most of the users can easily get access to a variety of information sources about companies, products, and services through online channels. Therefore, the online user evaluations are becoming the most powerful tool to generate word of mouth. The user's evaluation is provided in two forms, quantitative rating and review text. The rating is then divided into an overall rating and a detailed rating according to various evaluation criteria. However, since it is a burden for the reviewer to complete all required ratings for each evaluation criteria, so most of the sites requested only mandatory inputs for overall rating and optional inputs for other evaluation criteria. In fact, many users input only the ratings for some of the evaluation criteria and the percentage of missed ratings for each criteria is about 40%. As these missed ratings are the missing values in each criteria, the simple average calculation by ignoring the average 40% of the missed ratings can sufficiently distort the actual phenomenon. Therefore, in this study, we propose a methodology to predict the rating for the missed values of each criteria by analyzing user's evaluation information included the overall rating and text review for each criteria. The experiments were conducted on 207,968 evaluations collected from the actual hotel evaluation site. As a result, it was confirmed that the prediction accuracy of the detailed criteria ratings by the proposed methodology was much higher than the existing average-based method.

Usability Evaluation Scale for Product of Intelligent Homecare based on Retail Consumer

  • KWON, Jieun;LEE, Jin-Suk
    • Journal of Distribution Science
    • /
    • v.17 no.12
    • /
    • pp.55-62
    • /
    • 2019
  • Purpose: The number intelligent homecare products are focused on the development of technology, resulting in a lack of realistic environments or requirements for consumers. The purpose of this paper is to define the consumer and context for intelligent homecare products and to develop a usability evaluation scale. Research design, data and methodology: For this study, first, consumer and contexts related to intelligent homecare products were analyzed through literature review. Second, the primary usability evaluation factors were derived for intelligent homecare products by collecting the factors related to usability evaluation and conducting in-depth interviews with experts. Third, the second usability evaluation factors were derived through survey and statistical analysis based on the derived usability evaluation factors. Results: As a result, users of intelligent homecare products were classified as primary users and secondary consumers and six related contexts. The usability evaluation scale was established with four factors - Functionality, Error, Convenience, and Emotion - and 13 items. Conclusions: This study can be the basis for developing and distributing products that meet the consumer environment and requirements related to intelligent homecare products that will contribute to securing the competitiveness of companies and developing the technology and service value of related industries.

User Reputation Management Method Based on Analysis of User Activities on Social Media (소셜 미디어에서 사용자 행위 분석을 통한 사용자 평판 관리 기법)

  • Yun, Jinkyung;Jeong, Jiwon;Lee, Suji;Lim, Jongtae;Bok, Kyungsoo;Yoo, Jaesoo
    • Journal of KIISE
    • /
    • v.43 no.1
    • /
    • pp.96-105
    • /
    • 2016
  • Recently, social network services have changed by moving towards an open platform where, as well as simply allowing the building of relationships among users, various types of information can be generated and shared. Since existing user reputation management methods evaluate user reliability based on user profiles, explicit relations, and evaluation, they are not suitable for determining user reliability on social media due to few explicit evaluation. In this paper, we analyze social activities on social media and propose a new user reputation management method that considers implicit evaluation as well as explicit evaluation. The proposed method derives positive and negative implicit evaluation from social activities, and generates user reputation information by field in order to consider user expertise. It also considers the number of users that participate in evaluation in order to measure user influence. As a result, it generates the reputation information of users who have no explicit evaluation and creates user reputation information that is more suitable for social media.

A Evaluation method for the Color Preference of CRT Monitors (컬러모니터의 색상선호도 평가방법에 관한 연구)

  • 최재호;박승옥;김홍석
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 1998.04a
    • /
    • pp.141-146
    • /
    • 1998
  • This study investigated the evaluation method for the users' color preference of CRT monitors. And also the users' preference of the colors displayed on CRT monitor using the park's color reproduction system was evaluated. Subjects conducted a series of psychophysical experiments to compare the colors displayed on a CRT monitor using the park's system to the colors without the system, Three evaluation methods were investigated: comparing one colors of same hue with diverse luminance and saturation. the results showed that subjects preferred the colors reproduced using the park's system, and thd evaluation methods significantly affected thd color preference.

  • PDF

A Study on Software Quality Evaluation in Analysis Phase (분석단계에서의 소프트웨어 품질 평가에 관한 연구)

  • 장영숙;권영식
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.22 no.52
    • /
    • pp.261-273
    • /
    • 1999
  • It is booming to use computer and information owing to the information society. Therefore, software demand is increasing rapidly. Enhancing utility value depends upon software quality. Software quality measurement and evaluation are necessary to satisfy the users who are using computers. In the present time, ISO/IEC 9126 define 6 quality characteristics and 21 sub-characteristics including 40 inter quality characteristics. We developed software evaluation technique using the check list in accordance with the ISO/IEC 9126 in analysis phase. We evaluated the software quality in order to verify developing technique at S college. As a result of the evaluation, this college has found it necessary to maintain the software as soon as possible because academic systems are not adequate for users at this present time.

  • PDF

Analyses on Spatial Compositions and Furniture Characteristics of Children's Reading Rooms in Public Libraries (공공도서관 아동열람실의 공간구성 및 가구특성 분석)

  • Jeon, Se-Ran;Lee, Ji-Hyun;Kim, Soo-Young
    • Korean Journal of Air-Conditioning and Refrigeration Engineering
    • /
    • v.24 no.7
    • /
    • pp.567-577
    • /
    • 2012
  • This study examines the spatial compositions of children's reading rooms, furniture characteristics, and users' satisfaction levels for the furniture in public libraries. Field measurements and surveys were performed in 5 public libraries. Results imply that the spatial compositions of reading rooms in libraries were classified into three categories according to the locations of bookshelves and reading space. Management areas should not be located at the edge of reading rooms but be located at the center of reading rooms to avoid clerks' narrow viewing angle toward young kids and to ensure security for the kids. The evaluation for bookshelves according to evaluation checklists was acceptable, but users were not always satisfied with the bookshelves due to the inappropriate positions of books in shelves. The evaluation for desks was generally acceptable according to the checklists and users were satisfied with them. In general, the desk with higher scores by the checklist provided better satisfaction to users. However, the score by checklist for chair and user satisfaction were not always similar each other. Convenience areas in reading rooms were not enough compared to bookshelf, reading and management area. Computer tables that were designed in a way that users sit down and use the computers were highly preferred.

A Study on Transfer Convenience Evaluation Indicators for Urban Railway Stations (도시철도 역사의 환승 편의성 평가지표 연구)

  • Kim, Hwang Bae
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.43 no.6
    • /
    • pp.793-799
    • /
    • 2023
  • This study classifies the types of urban railway stations that reflect the location characteristics of urban railway stations, the structure and form of station taxes, and the number of users, and the level of inconvenience in the transfer movement line for users by station type, the number and connectivity of transfer information, and the level of transfer convenience facilities. The number of installations, conflicts between users, and transfer information signs were analyzed. As a result of data analysis, it was found that the factors that cause the most inconvenience to urban rail users when transferring are the length and curvature of the transfer line, pedestrian density and number of passengers in the transfer passage, presence or absence of transportation convenience facilities, and the size and height of transfer information letters. These transfer inconveniences were objectified, quantified, and presented as evaluation indicators that can measure the transfer convenience of urban railway stations. Additionally, an evaluation scale was developed to measure the service level for each evaluation indicator. The evaluation scale for each indicator presented six levels by applying linear interpolation based on the maximum and minimum values of data derived through field surveys. However, it is judged that a comprehensive evaluation of transfer convenience that combines the importance and weight of each convenience evaluation indicator should be established through future research.

Performance Evaluation of Recommendation Results through Optimization on Content Recommendation Algorithm Applying Personalization in Scientific Information Service Platform (과학 학술정보 서비스 플랫폼에서 개인화를 적용한 콘텐츠 추천 알고리즘 최적화를 통한 추천 결과의 성능 평가)

  • Park, Seong-Eun;Hwang, Yun-Young;Yoon, Jungsun
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.11
    • /
    • pp.183-191
    • /
    • 2017
  • In order to secure the convenience of information retrieval by users of scientific information service platforms and to reduce the time required to acquire the proper information, this study proposes an optimized content recommendation algorithm among the algorithms that currently provide service menus and content information for each service, and conducts comparative evaluation on the results. To enhance the recommendation accuracy, users' major items were added to the original algorithm, and performance evaluations on the recommendation results from the original and optimized algorithms were performed. As a result of this evaluation, we found that the relevance of the content provided to the users through the optimized algorithm was increased by 21.2%. This study proposes a method to shorten the information acquisition time and extend the life cycle of the results as valuable information by automatically computing and providing content suitable for users in the system for each service menu.

CLASSIFICATION FUNCTIONS FOR EVALUATING THE PREDICTION PERFORMANCE IN COLLABORATIVE FILTERING RECOMMENDER SYSTEM

  • Lee, Seok-Jun;Lee, Hee-Choon;Chung, Young-Jun
    • Journal of applied mathematics & informatics
    • /
    • v.28 no.1_2
    • /
    • pp.439-450
    • /
    • 2010
  • In this paper, we propose a new idea to evaluate the prediction accuracy of user's preference generated by memory-based collaborative filtering algorithm before prediction process in the recommender system. Our analysis results show the possibility of a pre-evaluation before the prediction process of users' preference of item's transaction on the web. Classification functions proposed in this study generate a user's rating pattern under certain conditions. In this research, we test whether classification functions select users who have lower prediction or higher prediction performance under collaborative filtering recommendation approach. The statistical test results will be based on the differences of the prediction accuracy of each user group which are classified by classification functions using the generative probability of specific rating. The characteristics of rating patterns of classified users will also be presented.

Correlations between Users' Characteristics and Preferred Features of Web-Based OPAC Evaluation

  • Kim, Hee-Sop;Chung, Hyun-Soo;Hong, Gi-Chai;Moon, Byung-Ju;Park, Chee-Hang
    • ETRI Journal
    • /
    • v.21 no.4
    • /
    • pp.83-93
    • /
    • 1999
  • This paper examines the correlations between user characteristics and their perferences for two selected features of Web-based OPAC systems. User characteristics identified in this study were age, gender, educational status, computer skills and OPAC experience. Usability features included interaction styles, character and image on screen, browsing and navigating style, screen layout, and ease of learning, whereas availability features attended to availability of information, quality of information and up-to-date information. Individual variables and features are described, and the correlation between the variables and the features are explored using Pearson's correlation coefficient(r). Although based on a small-scale sample survey, a considerably large number of statistically significant correlations were found between the users' characteristics and the selected evaluation features of interactive Web-based OPACs. From these observations, it seems to be suitable to recommend that system designers should make a more considered appraisal of the users' demographic characteristics in the design of the new generation of OPAC such as in user-tailored interactive Web-based OPAC systems.

  • PDF