• Title/Summary/Keyword: Evaluation-Methods

Search Result 15,672, Processing Time 0.044 seconds

An Analytical Study on the Quantitative and Qualitative Evaluation of Research Library Collection (연구도서관 장서의 양적 질적 평가에 관한 분석적 고찰)

  • Yoo Soyoung
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.8
    • /
    • pp.233-263
    • /
    • 1981
  • The purpose of this study is to bring out the most reasonable and feasible evaluation methods of research library collection in Korea. At the very outset, writer tried to define the purpose and the necessity of collection evaluation. Writer described a collection evaluation is to gain the data for decision making on selection policy, weeding and storage project, and explained it is one of the procedures of a collection development system operation of being explained as repeated three procedures through a collection development plan, an implimentation of the set plan(selection process) and a collection evaluation. Writer also pointed out the fact many libraries in Korea are apt to by pass or overlook this important process. Writer then defined the criteria of a collection evaluation as the measurement of the proportion of library holding's capability to meet users' demands and that of the degree of total collection's utilization. Writer introduced and analysed seven existing collection evaluation methods and concluded the method by a survey of users' needs and opinion and the method by a circulation survey are the most feasible and reasonable methods that can be applied. Writer also added that using above two evaluation methods together can enhance the effectiveness of collection evaluation.

  • PDF

Evaluation Method of Technology Development Project based on Decomposition Approach and Options Thinking (분해접근과 옵션사고에 기반한 기술개발 프로젝트의 평가방법)

  • Cho Kyu-Kab;Moon Byung-Keun
    • Journal of Korea Technology Innovation Society
    • /
    • v.8 no.3
    • /
    • pp.1117-1138
    • /
    • 2005
  • Due to the increasing importance of technology development project evaluation, many evaluation methods have been developed. However, most project evaluation methods are not directly applicable for evaluating performance improvement projects in a manufacturing system. It is due to the fact that the existing project evaluation methods do not deal with the performance evaluation of the system. This paper deals with performance measurement model of a manufacturing system based on decomposition method and evaluation method for technology development project based on options thinking. A case example is discussed to illustrate the process of the proposed evaluation method.

  • PDF

Comprehensive evaluation method for user interface design in nuclear power plant based on mental workload

  • Chen, Yu;Yan, Shengyuan;Tran, Cong Chi
    • Nuclear Engineering and Technology
    • /
    • v.51 no.2
    • /
    • pp.453-462
    • /
    • 2019
  • Mental workload (MWL) is a major consideration for the user interface design in nuclear power plants (NPPs). However, each MWL evaluation method has its advantages and limitations, thus the evaluation and control methods based on multi-index methods are needed. In this study, fuzzy comprehensive evaluation (FCE) theory was adopted for assessment of interface designs in NPP based on operators' MWL. An evaluation index system and membership functions were established, and the weights were given using the combination of the variation coefficient and the entropy method. The results showed that multi-index methods such as performance measures (speed of task and error rate), subjective rating (NASA-TLX) and physiological measure (eye response) can be successfully integrated in FCE for user interface design assessment. The FCE method has a correlation coefficient compared with most of the original evaluation indices. Thus, this method might be applied for developing the tool to quickly and accurately assess the different display interfaces when considering the aspect of the operators' MWL.

A Draft Korean Standards on the Evaluation Method of Airborne Sound Insulation in Building and Building Elements (공기음 차단성능 평가방법의 KS규격화 방안)

  • 양관섭;이태강;이근희;김선우
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2001.11a
    • /
    • pp.387-391
    • /
    • 2001
  • In evaluating sound performance of building, it is important to carry on tests and evaluations based upon residential sound performances. Korean Standards include test methods on sound performance, but don't include any code on evaluation methods. Therefore, evaluation methods from Japan or ISO have been used for evaluating sound performance in domestic so far. In this study, a draft of Korean Standards on a sound performance evaluation method in buildings is proposed.

  • PDF

A Comprehensive Review of Methods and Techniques to Evaluate Usability of Interactive IT Products

  • Lim, Chee-Hwan
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.24 no.64
    • /
    • pp.39-52
    • /
    • 2001
  • Usability is playing a more important, role in interactive products or systems (e. g,, information technology Products, computer software) development, and it has become a primary factor in determining the acceptability and consequent success of the products. This study investigates some different techniques and methods to evaluate the usability of the interactive products or system . Various evaluation methods have been tried ranging from formal to informal and empirical techniques. The classification of the usability evaluation methods(UEMs) and comparisons between these evaluation methods are presented. Some issues raised by the UEMs are also discussed. In addition, problems of selecting appropriate usability evaluation methods are discussed.

  • PDF

Developing the Evaluation System of ITS Device's Performance (ITS 장비 성능평가방법 및 성능평가시설 구축)

  • Baik, Nam Cheol;Lee, Sang Hyup;Oh, Seung Hoon
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.1D
    • /
    • pp.13-16
    • /
    • 2006
  • Recently, ITS has been deployed nationwide and at the same time, the demand for the better accuracy and higher quality of traffic information has been increased. Yet, there is no standard evaluation methods or evaluation equipments to verify ITS device's performance, being unable to secure reliable traffic data. In this study, the standard evaluation methods for ITS device's performance are studied by reviewing other nations' evaluation methods and the evaluation system is developed.

A Study on Teaching-Learning and Evaluation Methods of Environmental Studies in the Middle School (중학교 "환경" 교과의 교수.학습 및 평가 방법 연구)

  • 남상준
    • Hwankyungkyoyuk
    • /
    • v.7 no.1
    • /
    • pp.1-17
    • /
    • 1994
  • This study was performed to determine appropriate teaching-learning and evaluation methods for Environmental Studies. To promote the relevance of our study to the needs of the schools and concerned educational communities of environmental education, we reviewed related literature, conducted questionnaire surveys, interviewed related teachers and administrator, held meetings with experts, and field-tested our findings. For selecting and developing teaching-learning methods of Environmental Studies, findings of educational research in general are considered. moreover, principles of environmental education, general aim of environmental education, orientations of environmental education, and developmental stages of middle school students in educational psychology were attended. In addition, relevance to the purpose of the Environmental Studies curriculum, appropriateness for value inquiry as well as knowledge inquiry, small group centered class organization, social interaction centered teaching-learning process, regional environmental situation, significance of personal environment, evaluation methods of Environmental Studies, multi- and inter-disciplinary contents of the Environmental Studies textbook, suitability to the evaluation methods of Environmental Studies, and emphasis on the social interaction in teaching-learning process were regarded. It was learned the Environmental Studies can be taught most effectively in via of holding discussion sessions, conducting actual investigation, doing experiment-practice, doing games and plate, role-playing and carrying out simulation activities, and doing inquiry. These teaching-learning methods were field-tested and proved appropriate methods for the subject. For selecting and developing evaluation method of Environmental Studies, such principles and characteristics of Environmental Studies as objective domains stated in the Environmental Studies curriculum, diversity of teaching-learning organization, were appreciated. We categorized nine evaluation methods: the teacher may conduct questionnaire surveys, testings, interviews, non-participatory observations; they may evaluate student's experiment-practice performances, reports preparation ability, ability to establish a research project, the teacher may ask the students to conduct a self-evaluation, or reciprocal evaluation. To maximize the effect of these methods, we further developed an application system. It considered three variables, that is, evaluates, evaluation objectives domains, and evaluation agent, and showed how to choose the most appropriate methods and, when necessary, how to combine uses of different methods depending on these variables. A sample evaluation instrument made on the basis of this application system was developed and tested in the classes. The system proved effective. Pilot applications of the teaching-learning methods and evaluation method were made simultaneously; and the results and their implications are as follows. Discussion program was applied in a lesson dealing with the problems of waste disposal, in which students showed active participation and creative thinking. The evaluation method used in this lesson was a multiple-choice written test for knowledge and skills. It was shown that this evaluation method and device are effective in helping students' revision of the lesson and in stimulating their creative interpretations and responces. Pupils showed great interests in the actual investigation program, and this programme was proved to be effective in enhancing students' participation. However, it was also turned out that there must be pre-arranged plans for the objects, contents and procedures of survey if this program is to effective. In this lesson, non-participatory observation methods were used with a focus on the attitudes of students. A scaled reported in general description rather than in grade. Experiment-practice programme was adopted in a lesson for purifying contaminated water and in this lesson, instruction objectives were properly established, the teaching-learning process was clearly specified and students were highly motivated. On the other hand, however, it was difficult to control the class when some groups of students require more times to complete their experiment, and sometimes different results. As regards to evaluation, performance observation test were used for assessing skills and attitudes. If teachers use well-prepared Likert scale, evaluation of all groups within a reasonablely short period of time will be possible. The most effective and successful programme in therms of students' participation and enjoyment, was the 'ah-nah-bah-dah-market' program, which is kind of game of the flea market. For better organized program of this kind, however, are essential, In this program, students appraise their own attitudes and behavior by responding to a written questionnaire. In addition, students were asked to record any anecdotes relating to self-appraisal of changes on one's own attitudes and behaviours. Even after the lesson, students keep recording those changes on letters to herself. Role-playing and simulation game programme was applied to a case of 'NIMBY', in which students should decide where to located a refuse dumping ground. For this kind of programme to e successful, concepts and words used in the script should be appropriate for students' intellectual levels, and students should by adequately introduced into the objective and the procedures of the lessons. Written questionnaire was used to assess individual students' attitudes after the lesson, but in order to acquire information on the changes of students' attitudes and skills, pre-test may have to be made. Doing inquiry programme, in which advantages in which students actually investigated the environmental influence of the areas where school os located, had advantages in developing students' ability to study the environmental problems and to present the results of their studies. For this programme to be more efficient, areas of investigation should be clearly divided and alloted to each group so that repetition or overlap in areas of study and presentation be avoided, and complementary wok between groups bee enhanced. In this programme, teacher assessed students' knowledge and attitudes on the basis of reports prepared by each group. However, there were found some difficults in assessing students' attitudes and behaviours solely on the grounds of written report. Perhaps, using a scaled checklist assessing students' attitudes while their presentation could help to relieve the difficulties.

  • PDF

The Usability Analysis for Ergonomic Evaluation Methods of Work-related Musculoskeletal Disorders (작업관련성 근골격계질환의 인간공학적 평가 기법들에 대한 사용성 평가)

  • Im, Su-Jung;Choi, Soon-Young;Park, Dong-Hyun
    • Journal of the Korea Safety Management & Science
    • /
    • v.13 no.2
    • /
    • pp.83-90
    • /
    • 2011
  • It has been very important to have an exact evaluation for risk factors in order to prevent WMSDs(Work-related Musculoskeletal Disorders). However, most WMSDs evaluation methods have always been some problems of possibilities associated with subjective evaluation. Therefore, this study tried to conduct a sort of usability analysis on three major evaluation methods(OWAS, RULA, REBA). Specifically, major subjects in the study consisted of three parts as follows; comparison of the results between experienced and inexperienced observers, analysis for the consistency of the results in terms of different evaluation times, and analysis for the consistency of the results in terms of different job characteristics(based on the part of the automobile). The results of the study were summarized as follows; 1) There was statistically significant difference of the results by RULA and by REBA between experienced and inexperienced observers. This might be due to the fact that experienced observers have had better ability to detect the important working posture during evaluation. However, the results by OWAS did not give any significantly different results between experienced and inexperienced observers, 2) All three checklists applied by experienced subjects did not show any single result significantly different in terms of different evaluation times. This might have to do with high intra-observer reliability from some of previous studies, 3) The five parts of an automobile were selected as five major jobs with different job characteristics in the automobile industry. Specifically, they were door part, front part(hood, etc.), inside part(dash board, seats, etc.), rear part(trunk etc.), and bottom part. All three methods did not show any significant differences for the results from each observers. Further study on this subject would eventually provide a sophisticated evaluating guidelines for WMSDs regarding determination of observer-specific evaluation, identification of repetitive number of evaluations for stable results for each checklist, determination of job-specific evaluation methods, and so on.

Survey on Quantitative Performance Evaluation Methods of Image Dehazing (안개 제거 기술의 정량적인 성능 평가 기법 조사)

  • Lee, Sungmin;Yu, Jae Taeg;Jung, Seung-Won;Ra, Sung Woong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.4 no.12
    • /
    • pp.571-576
    • /
    • 2015
  • Image dehazing has been extensively studied, but the performance evaluation method for dehazing techniques has not attracted significant interest. This paper surveys many existing performance evaluation methods of image dehazing. In order to analyze the reliability of the evaluation methods, synthetic hazy images are first reconstructed using the ground-truth color and depth image pairs, and the dehazed images are then compared with the original haze-free images. Meanwhile we also evaluate dehazing algorithms not by the dehazed images' quality but by the performance of computer vision algorithms before/after applying image dehazing. All the aforementioned evaluation methods are analyzed and compared, and research direction for improving the existing methods is discussed.

Road Safety Assessment by Using Integrated Evaluation Methods of Road Design Consistency (도로선형 설계일관성 통합평가방법론을 활용한 안전성 평가)

  • Ko, Chun-Soo;Lee, Jong-Hak;Ku, Ji-Sun;Noh, Kwan-Sub
    • International Journal of Highway Engineering
    • /
    • v.15 no.1
    • /
    • pp.121-126
    • /
    • 2013
  • PURPOSES: Road Design Consistency Evaluation can guarantee road alignments with safety factors, however it can be hard work to deal with general car accident factors in only this evaluation index. Ideal Road Design Consistency Evaluation is show the mutual balance of road alignment and human factors with a variety of factors for road safety. METHODS: This study carried out overall road safety evaluations which are methods of running speeding consistency and car platoon safety analysis (driver's behaviors factors) as well. RESULTS: Out of 13 sections in a experimental road layout, safety factors of 8 sections showed 'Good' or 'Fair' status. However, 'Poor' results were found out in 5 sections. Particularly, it showed the different outcomes among the 4 evaluation methods used in this study. CONCLUSIONS: Road safety countermeasures were proposed for the potentially dangerous sections in road which failed to identify in the other methods. This study will contribute toward future study of more reliable Road Design Consistency Evaluation in the future for road safety.