• Title/Summary/Keyword: User Evaluation Score

Search Result 91, Processing Time 0.028 seconds

Detection of Similar Answers to Avoid Duplicate Question in Retrieval-based Automatic Question Generation (검색 기반의 질문생성에서 중복 방지를 위한 유사 응답 검출)

  • Choi, Yong-Seok;Lee, Kong Joo
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.8 no.1
    • /
    • pp.27-36
    • /
    • 2019
  • In this paper, we propose a method to find the most similar answer to the user's response from the question-answer database in order to avoid generating a redundant question in retrieval-based automatic question generation system. As a question of the most similar answer to user's response may already be known to the user, the question should be removed from a set of question candidates. A similarity detector calculates a similarity between two answers by utilizing the same words, paraphrases, and sentential meanings. Paraphrases can be acquired by building a phrase table used in a statistical machine translation. A sentential meaning's similarity of two answers is calculated by an attention-based convolutional neural network. We evaluate the accuracy of the similarity detector on an evaluation set with 100 answers, and can get the 71% Mean Reciprocal Rank (MRR) score.

Gesture Control Gaming for Motoric Post-Stroke Rehabilitation

  • Andi Bese Firdausiah Mansur
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.10
    • /
    • pp.37-43
    • /
    • 2023
  • The hospital situation, timing, and patient restrictions have become obstacles to an optimum therapy session. The crowdedness of the hospital might lead to a tight schedule and a shorter period of therapy. This condition might strike a post-stroke patient in a dilemma where they need regular treatment to recover their nervous system. In this work, we propose an in-house and uncomplex serious game system that can be used for physical therapy. The Kinect camera is used to capture the depth image stream of a human skeleton. Afterwards, the user might use their hand gesture to control the game. Voice recognition is deployed to ease them with play. Users must complete the given challenge to obtain a more significant outcome from this therapy system. Subjects will use their upper limb and hands to capture the 3D objects with different speeds and positions. The more substantial challenge, speed, and location will be increased and random. Each delegated entity will raise the scores. Afterwards, the scores will be further evaluated to correlate with therapy progress. Users are delighted with the system and eager to use it as their daily exercise. The experimental studies show a comparison between score and difficulty that represent characteristics of user and game. Users tend to quickly adapt to easy and medium levels, while high level requires better focus and proper synchronization between hand and eye to capture the 3D objects. The statistical analysis with a confidence rate(α:0.05) of the usability test shows that the proposed gaming is accessible, even without specialized training. It is not only for therapy but also for fitness because it can be used for body exercise. The result of the experiment is very satisfying. Most users enjoy and familiarize themselves quickly. The evaluation study demonstrates user satisfaction and perception during testing. Future work of the proposed serious game might involve haptic devices to stimulate their physical sensation.

A Content Analysis of Digital Audience Replies to Video Advertising Types: Focused on Viral Video and Cable Broadcasting Advertisement (영상광고 유형별 디지털 이용자의 댓글 내용분석에 관한 연구: 바이럴 동영상 광고와 케이블 방송광고를 중심으로)

  • Ji, Won-Bae;Kim, Woon-Han
    • Journal of Digital Contents Society
    • /
    • v.19 no.7
    • /
    • pp.1303-1312
    • /
    • 2018
  • The study analyzed the evaluation of the advertisement effect by the score and the method of the advertisement comments in ad evaluation in online site, 'TVCF'. The results are as follows. First, Internet viral advertisement showed higher number of ad comments and higher evaluation of advertisement effect than cable broadcasting advertisement. Second, the results of analysis of the difference of advertisement evaluation according to ad types and digital user characteristics showed that women are more positive than men toward both cable broadcasting and internet viral advertisement.

Design and Implementation of HoleInOne Metasearch System (HoleInOne 메타검색 시스템의 설계 및 구현)

  • 김현주;배종민
    • Journal of Korea Multimedia Society
    • /
    • v.6 no.2
    • /
    • pp.360-373
    • /
    • 2003
  • The Meta Search system proposed in this paper is operated based on relevance distribution Infer mation(RDI). It first evaluates the sources applicable to the search, and then selects the most appropriate source. According to the evaluation of the sources, it discreetly collects the documents from the concerned sources and classifies them into a useful order based on the RDI, which is an evaluation score of the sources. The documents are classified into order and presented to the user as a single search result. For this Purpose, this study presents evaluation factor models to present the RDI between the query, and source, and proposes a method for drawing out the RDI based on the evaluation factors. The system for selecting the most appropriate sources according to the query has been developed based on an algorithm that selects the best source. Finally, after searching the documents suitable for query from extracted sources, we present a Meta Search system, HoleInOne, that ranks and merges them.

  • PDF

Development and Evaluation of Smart Jacket for Women aged Fifties and Sixties (50, 60대 여성을 위한 스마트 재킷의 개발 및 평가)

  • Lee, Jeong-Ran;Paek, Kyung-Ja;Kim, Gu-Young
    • Fashion & Textile Research Journal
    • /
    • v.13 no.6
    • /
    • pp.926-933
    • /
    • 2011
  • The purpose of this research was to develop a smart wear equipped with wearable technologies for women in the age of 50's and 60's and confirm its acceptability. For this, we constructed a casual jacket that has the integration of heating and lighting function, and evaluated the user's satisfaction. The size of the heating device attached at the back of the jacket was 300 mm in width and 120 mm in length and the size of the one attached at the front abdomen was 180 mm in width and 120 mm in length. The power supplier was the unification of the battery and controller which have been waterproofed. The lighting device connected with LED was 26mm in width, 20 mm in length and 1.5 mm in thickness. It has been designed in a waterproofed rectangular shape and was attachable to the jacket. The satisfaction survey of a smart jacket has been conducted with three standards, which were convenience, appearance and practicality. Free physical movement among the standard of convenience had very high scores with the average of 4.7 on a five point-scale. The acceptability of the jacket was 4.6, which proved that it didn't have unique feelings compared to ordinary ones. The evaluation score of the appearance of the jacket was 4.5. Especially inside finishing of the jacket received the highest scores from all ages. According to the evaluation of practicality, there has been no change in the appearance of the jacket and the function of heating device after laundry.

Incorporating Social Relationship discovered from User's Behavior into Collaborative Filtering (사용자 행동 기반의 사회적 관계를 결합한 사용자 협업적 여과 방법)

  • Thay, Setha;Ha, Inay;Jo, Geun-Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.2
    • /
    • pp.1-20
    • /
    • 2013
  • Nowadays, social network is a huge communication platform for providing people to connect with one another and to bring users together to share common interests, experiences, and their daily activities. Users spend hours per day in maintaining personal information and interacting with other people via posting, commenting, messaging, games, social events, and applications. Due to the growth of user's distributed information in social network, there is a great potential to utilize the social data to enhance the quality of recommender system. There are some researches focusing on social network analysis that investigate how social network can be used in recommendation domain. Among these researches, we are interested in taking advantages of the interaction between a user and others in social network that can be determined and known as social relationship. Furthermore, mostly user's decisions before purchasing some products depend on suggestion of people who have either the same preferences or closer relationship. For this reason, we believe that user's relationship in social network can provide an effective way to increase the quality in prediction user's interests of recommender system. Therefore, social relationship between users encountered from social network is a common factor to improve the way of predicting user's preferences in the conventional approach. Recommender system is dramatically increasing in popularity and currently being used by many e-commerce sites such as Amazon.com, Last.fm, eBay.com, etc. Collaborative filtering (CF) method is one of the essential and powerful techniques in recommender system for suggesting the appropriate items to user by learning user's preferences. CF method focuses on user data and generates automatic prediction about user's interests by gathering information from users who share similar background and preferences. Specifically, the intension of CF method is to find users who have similar preferences and to suggest target user items that were mostly preferred by those nearest neighbor users. There are two basic units that need to be considered by CF method, the user and the item. Each user needs to provide his rating value on items i.e. movies, products, books, etc to indicate their interests on those items. In addition, CF uses the user-rating matrix to find a group of users who have similar rating with target user. Then, it predicts unknown rating value for items that target user has not rated. Currently, CF has been successfully implemented in both information filtering and e-commerce applications. However, it remains some important challenges such as cold start, data sparsity, and scalability reflected on quality and accuracy of prediction. In order to overcome these challenges, many researchers have proposed various kinds of CF method such as hybrid CF, trust-based CF, social network-based CF, etc. In the purpose of improving the recommendation performance and prediction accuracy of standard CF, in this paper we propose a method which integrates traditional CF technique with social relationship between users discovered from user's behavior in social network i.e. Facebook. We identify user's relationship from behavior of user such as posts and comments interacted with friends in Facebook. We believe that social relationship implicitly inferred from user's behavior can be likely applied to compensate the limitation of conventional approach. Therefore, we extract posts and comments of each user by using Facebook Graph API and calculate feature score among each term to obtain feature vector for computing similarity of user. Then, we combine the result with similarity value computed using traditional CF technique. Finally, our system provides a list of recommended items according to neighbor users who have the biggest total similarity value to the target user. In order to verify and evaluate our proposed method we have performed an experiment on data collected from our Movies Rating System. Prediction accuracy evaluation is conducted to demonstrate how much our algorithm gives the correctness of recommendation to user in terms of MAE. Then, the evaluation of performance is made to show the effectiveness of our method in terms of precision, recall, and F1-measure. Evaluation on coverage is also included in our experiment to see the ability of generating recommendation. The experimental results show that our proposed method outperform and more accurate in suggesting items to users with better performance. The effectiveness of user's behavior in social network particularly shows the significant improvement by up to 6% on recommendation accuracy. Moreover, experiment of recommendation performance shows that incorporating social relationship observed from user's behavior into CF is beneficial and useful to generate recommendation with 7% improvement of performance compared with benchmark methods. Finally, we confirm that interaction between users in social network is able to enhance the accuracy and give better recommendation in conventional approach.

The comparative study of user satisfaction on various implant engine system (다양한 임플란트 엔진 시스템에 대한 사용자 만족도 비교)

  • Lee, Du-Hyeong;Lee, Kyu-Bok
    • Journal of Dental Rehabilitation and Applied Science
    • /
    • v.30 no.1
    • /
    • pp.9-15
    • /
    • 2014
  • Purpose: Implant engine system is composed of the handpiece, micromotor, control box and foot switch. The aim of this study was to evaluate the satisfaction of the implant engine systems in terms of convenience-design and to examine the relation with the experience of implant surgery. Materials and Methods: Three implant systems were evaluated: SurgicXT/X-SG20L, INTRAsurg300/CL3-09, XIP10/CRB26LX. For this comparative study, 30 dentists were included and the satisfaction was measured using a structured questionnaire. One-way analysis of the variance (ANOVA) and multiple regression analysis were used within and between the groups. Results: Total satisfaction differed from each other (P < 0.05). The convenience score was more associated with the total satisfaction than design score. Moreover, the implant surgery experience affected several assessments. Conclusion: Collectively, in a cross-sectional study model, the design of implant system significantly affects its total satisfaction and the surgery experience can be influential factor in the evaluation of implant engine system.

Test Set Construction for Quality Evaluation of NAK Portal's Search Service and the Status Analysis (국가기록포털 검색서비스 품질 점검을 위한 평가셋 구축 및 현황 분석)

  • Jeong Ho, Na;Hyeon-Gi, So;Gyung Rok, Yeom;Jung-Ok, Lee;Hyo-Jung, Oh
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.22 no.4
    • /
    • pp.25-43
    • /
    • 2022
  • The ultimate record management's purpose is preservation and utilization. However, the National Archives of Korea (NAK)s Portal has problems such as search system aging and search tools dualization. As a result, the users' search satisfaction is not satisfied, and the improvement demand increases. This study aimed to evaluate the NAK's search quality as a preliminary study for NAK search system advancement. To this end, we analyzed the current status of CAMS and NAK's Portal. Then, we established the test sets and evaluated the NAK's Portal quality from the user's point of view. Evaluation results were analyzed using Precision, Recall, F-score, and MRR. The analysis results showed that the overall search performance was low, particularly in the "advanced subject search," which showed low performance in Precision, Recall, and MRR. Thus, improvement is urgently needed. The test sets established for this study are expected to be used as a basis for objectively measuring the improvement of the search performance after the NAK search system advancement.

Development of Bicycle Level of Service Model from the User's Perspective Using Ordered Probit Model (순서형 프로빗 모형을 이용한 이용자 중심의 자전거 서비스 수준 모형 개발)

  • Lee, Gyeo-Ra;Rho, Jong-Ki;Kang, Kyung-Woo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.8 no.2
    • /
    • pp.108-117
    • /
    • 2009
  • The South Korean government is looking for a solution to the ever-growing problems of traffic congestion, and surging international oil prices: the use of the humble bicycle to get to places. However, Many people feel inconvenient using bicycle because of the insufficient bicycle infrastructure and lack of the safety and connectivity between existing pathways. In this study, bicycle level of service model using ordered probit model is developed considering safety, convenience, connectivity, and factors that affect bicycle LOS. The ordered probit model would be recommended for the research which relates in choice, preference and strength etc. Bicycle level of service criteria is calculated by applying this model reflecting bicyclist's point of view. The model which develops from this research which accomplishes a bicycle level of service evaluation and represent alternative solution to encourage bicyclist. It is believed that the proposed model would be greatly utilized in bicycle network planning, bicycle road and facility alternatives testing, projects funding priority.

  • PDF

An Evaluation of the Suitability of Data Mining Algorithms for Smart-Home Intelligent-Service Platforms (스마트홈 지능형 서비스 플랫폼을 위한 데이터 마이닝 기법에 대한 적합도 평가)

  • Kim, Kilhwan;Keum, Changsup;Chung, Ki-Sook
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.40 no.2
    • /
    • pp.68-77
    • /
    • 2017
  • In order to implement the smart home environment, we need an intelligence service platform that learns the user's life style and behavioral patterns, and recommends appropriate services to the user. The intelligence service platform should embed a couple of effective and efficient data mining algorithms for learning from the data that is gathered from the smart home environment. In this study, we evaluate the suitability of data mining algorithms for smart home intelligent service platforms. In order to do this, we first develop an intelligent service scenario for smart home environment, which is utilized to derive functional and technical requirements for data mining algorithms that is equipped in the smart home intelligent service platform. We then evaluate the suitability of several data mining algorithms by employing the analytic hierarchy process technique. Applying the analytical hierarchy process technique, we first score the importance of functional and technical requirements through a hierarchical structure of pairwise comparisons made by experts, and then assess the suitability of data mining algorithms for each functional and technical requirements. There are several studies for smart home service and platforms, but most of the study have focused on a certain smart home service or a certain service platform implementation. In this study, we focus on the general requirements and suitability of data mining algorithms themselves that are equipped in smart home intelligent service platform. As a result, we provide a general guideline to choose appropriate data mining techniques when building a smart home intelligent service platform.