• Title/Summary/Keyword: Measure of evaluation

Search Result 3,413, Processing Time 0.032 seconds

Performance Evaluation Method of User Identification and User Tracking for Intelligent Robots Using Face Images (얼굴영상을 이용한 지능형 로봇의 개인식별 및사용자 추적 성능평가 방법)

  • Kim, Dae-Jin;Park, Kwang-Hyun;Hong, Ji-Man;Jeong, Young-Sook;Choi, Byoung-Wook
    • The Journal of Korea Robotics Society
    • /
    • v.4 no.3
    • /
    • pp.201-209
    • /
    • 2009
  • In this paper, we deal with the performance evaluation method of user identification and user tracking for intelligent robots using face images. This paper shows general approaches for standard evaluation methods to improve intelligent robot systems as well as their algorithms. The evaluation methods proposed in this paper can be combined with the evaluation methods for detection algorithms of face region and facial components to measure the overall performance of face recognition in intelligent robots.

  • PDF

An Exploration on Formative Evaluation Methods for Free Semester System in Middle School (중학교 자유학기제 형성평가 방안 탐색)

  • WON, Hyo-Heon
    • Journal of Fisheries and Marine Sciences Education
    • /
    • v.28 no.1
    • /
    • pp.289-299
    • /
    • 2016
  • The purpose of the study was to develop evaluation methods which would measure student achievement and progress without traditional paper-pencil tests such as mid-term and final examinations. More specifically, the main research focus were to establish general directions of student assessment during free semester, to build evaluation models supporting student's participation and learning, and to report and record various student evaluation results. As research results, we found that student evaluation of free semester should be organized to improve a) experience learning activity, self-regulatory and collaboratory study, b) high-order thinking ability and character-building, and c) teacher-student-parent cooperation. Since traditional paper-pencil tests were restricted in free semester, student achievement should be provided by a way of performance descriptions on transcripts rather than quantitative grade points. Student performance descriptions had to show not only subject knowledge but also students efforts, motivation, and participation. These multiple and educationally meaningful information would be collected by teacher-student-parent communication and collaboration.

Certifying the Quality of Electronic Commerce Services (전자상거래 서비스 품질 인증에 관한 연구)

  • Choi, Doug-W.
    • Journal of Korean Society for Quality Management
    • /
    • v.33 no.2
    • /
    • pp.1-12
    • /
    • 2005
  • An extensive literature review has been made in this paper to build the evaluation hierarchy structure for the certification of electronic commerce services. In building the evaluation hierarchy structure, major candidate evaluation factors are selected by bench marking the various certification practices, including the Malcolm Baldrige award, ISO9000, and BSC(balanced scorecard) techniques. This paper deployed principal component analysis and factor analysis techniques to develop a statistically solid and systematic evaluation model. The final evaluation model, as presented in this paper as a model for the certification of electronic commerce services, produces a numeric score on the 100% scale, which can be served as a metric for the certification decision. The AHP technique was used in converting the various qualitative and quantitative evaluation values into a single measure for the certification decision.

A New Similarity Measure using Fuzzy Logic for User-based Collaborative Filtering (사용자 기반의 협력필터링을 위한 퍼지 논리를 이용한 새로운 유사도 척도)

  • Lee, Soojung
    • The Journal of Korean Association of Computer Education
    • /
    • v.21 no.5
    • /
    • pp.61-68
    • /
    • 2018
  • Collaborative filtering is a fundamental technique implemented in many commercial recommender systems and provides a successful service to online users. This technique recommends items by referring to other users who have similar rating records to the current user. Hence, similarity measures critically affect the system performance. This study addresses problems of previous similarity measures and suggests a new similarity measure. The proposed measure reflects the subjectivity or vagueness of user ratings and the users' rating behavior by using fuzzy logic. We conduct experimental studies for performance evaluation, whose results show that the proposed measure demonstrates outstanding performance improvements in terms of prediction accuracy and recommendation accuracy.

A Quantative Evaluation Method of the Quality of Natural Language Sentences based on Genetic Algorithm (유전자 알고리즘에 기반한 자연언어 문장의 정량적 질 평가 방법)

  • Yang, Seung-Hyeon;Kim, Yeong-Seom
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.11
    • /
    • pp.1372-1380
    • /
    • 1999
  • 본 논문에서는 자연언어 문장의 객관적 정량적인 질 측정 방법의 구축에 대해 설명하고, 이를 문장 퇴고 시스템의 사례에 적용해 본다. 문장의 질을 평가한다는 것은 본질적으로 주관적이고 정량화가 어려운 작업이기 때문에, 이 과정에서 질의 객관적 계량화가 가능한지 여부가 가장 중요한 문제가 된다. 이 논문에서는 이러한 문제를 해결하기 위해 유전자 알고리즘을 이용한 진화적 접근 방법을 통해 객관적이고 정량적인 질의 측정 공식을 유도하는 방법론을 제시하였다. 이 논문에서 제시한 방법론의 핵심은 간단히 말해서 사람이 행하는 정성적인 판단을, 이에 가장 근접하는 정량적 측정 체계로 전환시키는 것이라고 보면 된다. 이것을 위해 정량화 문제를 문장의 단순 언어 특징들의 변화값을 이용한 최적화 문제로 환원시키고, 다시 이 최적화 문제를 유전자 알고리즘을 이용해 해결함으로써 문제를 효과적으로 해결할 수 있었다. 실험 결과를 보면, 본 논문에서 제시한 최적화 방법은 주어진 훈련용 예제와 검증용 예제 중 각각 99.84%, 99.88%를 만족시키는 해를 찾아내었으므로 정량적 질 평가 공식의 유도에 매우 효과적임을 알 수 있었다. 또한 도출된 측정 공식을 이용해서 실제 퇴고 시스템 평가에 적용한 결과 문장 질의 측정에 매우 유용하게 이용될 수 있음을 알 수 있었다. 이와 같이 질의 정량적 평가가 가능하다는 사실이 갖는 또 한가지 중요한 의미는 최종 사용자의 구매 의사나 개발자의 공학적 의사 결정을 위한 객관적 성능 평가 자료의 제공에 이 방법이 유용하게 사용될 수 있다는 점이다.Abstract This paper describes a method of building a quantitative measure of the quality of natural language sentences, particularly produced by document revision systems. Evaluating the quality of natural language sentences is intrinsically subjective, so what is most important as to the evaluation is whether the quality can be measured objectively. To solve such problem of objective measurability, genetic algorithm, an evolutionary learning method, is employed in this paper. The underlying standpoint of this approach is that building the quality measures is a task of constructing a formulae that produces as close results as can to the qualitative decisions made by humans. For doing this, the problem of measurability has been simply reduced to an optimization problem using the change of the values of simple linguistic parameters found in sentences, and the reduced problem has been solved effectively by the genetic algorithm. Experimental result shows that the optimization task satisfied 99.84% and 99.88% of the given objectives for training and validation samples, respectively, which means the method is quite effective in constructing the quantitative measure of the quality of natural language sentences. The actual evaluation result of a revision system shows that the measure is useful to quantize the quality of sentences. Another important contribution of this measure would be to provide an objective performance evaluation data of natural language systems on a basis of which end-users and developers can make their decision to fit their own needs.

A Study on the Fuzzy Evaluation Algorithm for Large Scale Hierarchical MADM Problem -Centering on the Identification of Fuzzy Measure- (대규모 다계층 MADM 문제의 퍼지평가 알고리즘에 관한 연구 - 퍼지측도의 동정을 중심으로 -)

  • Lim, B.T.;Yang, W.;Lee, C.Y.
    • Journal of Korean Port Research
    • /
    • v.12 no.1
    • /
    • pp.9-17
    • /
    • 1998
  • The evaluation structure of complex problems is composed of multi-attributes and hierarchy. A many studies were existed on this problems, but that based on the assumption that the evaluation elements were independent. The actual evaluation problems have the complexity, ambiguity and interlinkage among the elements. In this situation, the fuzzy evaluation process is very effective in settling the complex problems. For evaluation of large scale hierarchical MADM problem, the fuzzy evaluation algorithm is developed in this paper, and that is centering on the identification of fuzzy measures. In this study, we newly identified the weight and interaction among the evaluation attributes. The results of this study are as follows: we can identified the hierarchical structure of the evaluation problem which is composed of the evaluation structure, function and hierarchy; we improved the existed weighting method which could be accomplished by normalizing process, considering the uncertainty and new weight integrating method which come from Dempster-Shafer theory. And we take into account the interaction properties among more than 3 evaluation attributes, which can be compared with the existed studies in which only 2 evaluation attributes taked into account.

  • PDF

Speech Enhancement Based on Improved Minima Controlled Recursive Averaging Incorporating GSAP (전역 음성 부재 확률 기반의 향상된 최소값 제어 재귀평균기법을 이용한 음성 향상 기법)

  • Song, Ji-Hyun;Bang, Dong-Hyeouck;Lee, Sang-Min
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.49 no.1
    • /
    • pp.104-111
    • /
    • 2012
  • In this paper, we propose a novel method to improve the performance of the improved minima controlled recursive averaging (IMCRA). From an examination for various noise environment, it is shown that the IMCRA has a fundamental drawback for the noise power estimate at the offset region of continuity speech signals. Espectially, it is difficult to obtain the robust estimates of the noise power in non-stationary noisy environments that is rapidly changed the spectral characteristics such as babble noise. To overcome the drawback, we apply the global speech absence probability (GSAP) conditioned on both a priori SNR and a posteriori SNR to the speech detection algorithm of IMCRA. With the performance criteria of the ITU-T P.862 perceptual evaluation of speech quality (PESQ) and a composite measure test, we show that the proposed algorithm yields better results compared to the conventional IMCRA-based scheme under various noise environments. In particular, in the case of babble 5 dB, the proposed method produced a remarkable improvement compared to the IMCRA ( PESQ = 0.026, composite measure = 0.029 ).

Evaluation on validity of health literacy measurement scale (의료정보이해능력 측정도구 척도의 타당성 평가)

  • Choi, Kyounh-Ho;Lee, Jeong-Ok
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.2
    • /
    • pp.257-265
    • /
    • 2013
  • As evaluating the health literacy is getting important, various measures for evaluation are being developed. Nevertheless, discussions about developing proper measures in Korean are still inactive. Therefore in this paper, we proposed Korean REALM (rapid estimate of adult literacy in medicine) measure that is composed of five point scale and investigated about its validity. As a result, we could find that Korean REALM measure which is composed of five point scale has high reliability, and that it formed one dimension as a result of factor analysis. Positive responses were lower than two point scale and correlation coefficient with NVS (the newest vital sign) appeared statistically significant. Therefore, we could conclude that Korean REALM measure that is composed of five point scale is a valid measurement. Furthermore, there were statistically significant differences between general students and department of nursing students about health literacy.

Non-hierarchical Clustering based Hybrid Recommendation using Context Knowledge (상황 지식을 이용한 비계층적 군집 기반 하이브리드 추천)

  • Baek, Ji-Won;Kim, Min-Jeong;Park, Roy C.;Jung, Hoill;Chung, Kyungyong
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.20 no.3
    • /
    • pp.138-144
    • /
    • 2019
  • In a modern society, people are concerned seriously about their travel destinations depending on time, economic problem. In this paper, we propose an non-hierarchical clustering based hybrid recommendation using context knowledge. The proposed method is personalized way of recommended knowledge about preferred travel places according to the user's location, place, and weather. Based on 14 attributes from the data collected through the survey, users with similar characteristics are grouped using a non-hierarchical clustering based hybrid recommendation. This makes more accurate recommendation by weighting implicit and explicit data. The users can be recommended a preferred travel destination without spending unnecessary time. The performance evaluation uses accuracy, recall, F-measure. The evaluation result was shown 0.636 accuracy, 0.723 recall, and 0.676 F-measure.

The Student-Centered Educational Evaluation and Reporting on School Mathematics (수학교과에서 학습자 중심의 교육평가 결과보고 방안 논의)

  • Ko Hyoung-Jun;Won Seoung-Joun
    • The Mathematical Education
    • /
    • v.45 no.2 s.113
    • /
    • pp.205-215
    • /
    • 2006
  • One of the most important concepts in the 7th curriculum of Korea is the student-centered education. Since educational evaluation has significant influence on the whole curriculum, if we realize the importance of the student-center education on the curriculum we should establish the student-centered educational evaluation system. Educational evaluation is defined by the theory of information to permit information users to identify, to measure, to manipulate and to communicate useful educational information concerning an educational curriculum for making decisions. If we accept the above definitions, the demands of information users are significant in the light of conceptual framework of educational evaluation. The purpose of this study is to analyze the conceptual framework of educational evaluation from information users' perspectives and to investigate the qualitative characteristics which satisfy information users' need for making decisions. We also show that students aren't provided sufficient evaluation results information to decide for their study plans by analyzing an evaluation study of the 7th primary curriculum. Finally, this study suggests how to improve an evaluation system for students in mathematics.

  • PDF