• Journal of Korean Society of Water and Wastewater
• /
• v.34 no.6
• /
• pp.495-502
• /
• 2020

The 37 indicators for performance evaluation of public sewage management agencies are divided into four major categories (agency manpower management ability, wastewater treatment plant operation and management, sludge and water reuse, service quality) in the first stage, and the necessity and score acquisition for the detailed indicators by each major category in the second stages. Priority was investigated through the Analytic Hierarchy Process (AHP) analysis technique for ease and relevance of company efforts. Also, based on the results of this analysis, integrated type weighting and relative importance were analyzed. As a result of the analysis, the weight and relative importance of the first stage classification were in the order of wastewater treatment plant operation and maintenance, operation agency manpower management ability, sludge and water reuse, and service quality. As a result of analyzing the weights and priorities of the detailed performance indicators in the second stage, it was found that operator's career years, the percentage of certification holding rate in operators, compliance with the effluent water quality standards, training times for operators, and efforts to manage hazardous chemicals were important. Some of the indicators of operation agency performance evaluation may include indicators in which the performance of the company's efforts is underestimated or overestimated. In order to improve this, it is necessary to give weights in consideration of the necessity of the indicator, the relevance of the company's efforts, and the ease of obtaining scores.

• Journal of the Korean School Mathematics Society
• /
• v.8 no.2
• /
• pp.223-248
• /
• 2005

This study is to survey and analyze the opinion of teachers about the relevance of educational content in the 7th mathematics curriculum. For the purpose of this study, we analyze the result of the questionnaire survey which consists in the question about the relevance(Quantity, level, validity) of educational content in the 7th mathematics curriculum. 515 elementary school teachers, 314 middle school teachers, and 323 high school teachers are participated in this survey. 75 percent of elementary school teachers think that the educational quantity must be reduced for the relevance of educational content. So do 50 percent of secondary school teachers. Both of them think that the number of topic must be reduced for the relevance. In special, this study shows that the response rate about the object which is related with interest is very low compared with any other mathematics education objects. So, it is necessary to pay more attention to the object which is related with interest.

• The Journal of Information Systems
• /
• v.25 no.4
• /
• pp.37-61
• /
• 2016

Purpose This study examines firms at various industries to identify key organizational characteristics that positively drive the evaluation of cloud computing. In addition, this study tests the impact of one's evaluation has on the adoption and integration of cloud computing within their respective firm. Design/methodology/approach A total of 172 responses from various firms currently using cloud computing service were analyzed using the structural equation modeling(SEM). Findings Results show that organizational Needs(Mobility and Job Relevance), Perceived Factors(Relative Advantages and Cost Savings), and Organizational Readiness(Technical Knowledge, Financial Supports, and Managerial Supports) have a significant impact on cloud computing evaluation; and evaluation influences its adoption, and integration. However, two variables(IT Performance Gaps and Compatibility) have no significant impact on cloud computing evaluation. Finally, Evolutional Leadership has a significant moderating effect within the relationship among variables in the process of cloud computing implementation.

• Journal of the Korean Society for Library and Information Science
• /
• v.41 no.3
• /
• pp.165-179
• /
• 2007

This study regards the evaluation for the main contents of the 'Library Development Plan(2003-2011)' promoted by the Ministry of Culture and Tourism for the library development plan in Korea. SMART evaluation method was introduced for the evaluation of vision, objective, core project of library development plan. Following result was acquired as a result of the study. First. as a result of SMART vision, objective, core projects and main business of library development plan was presented to be 3.05, 3.09, 3.15 and 3.12 respectively. Thus, in the evaluation for components of development Plan, it was excellent in core projects. Second, as a result of SMART, concreteness, measurability, achievability, relevance and time frame of library development plan was presented to be 3.09. 2.99. 3.12. 3.24 and 3.10 respectively. Thus, in the evaluation components of development plan. it was excellent in relevance but it has been found that supplementary measures should be taken on measurability. Third, 'culture-oriented room with knowledge and information' was found to be superior to the 'information library with up-to-date technology' in evaluation of the objective. Fourth, 'substantiality in user service with the supplement of library contents' was excellent in evaluation of core projects but there is some problem with 'activation of library function through training and supplement of professional manpower.' Fifth. 'Enhancement in library information service' was presented to be excellent in evaluation of main business but there was problem in 'reinforcement in function of library for each location and type,' 'partnership of public-private enterprises' and 'promotion for book culture of the public' thus it need to be revised and supplemented hereafter.

• Journal of Technology Innovation
• /
• v.14 no.3
• /
• pp.117-154
• /
• 2006

This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

• Journal of Information Science Theory and Practice
• /
• v.1 no.3
• /
• pp.12-32
• /
• 2013

The paper introduces the research area of interactive information retrieval (IIR) from a historical point of view. Further, the focus here is on evaluation, because much research in IR deals with IR evaluation methodology due to the core research interest in IR performance, system interaction and satisfaction with retrieved information. In order to position IIR evaluation, the Cranfield model and the series of tests that led to the Cranfield model are outlined. Three iconic user-oriented studies and projects that all have contributed to how IIR is perceived and understood today are presented: The MEDLARS test, the Book House fiction retrieval system, and the OKAPI project. On this basis the call for alternative IIR evaluation approaches motivated by the three revolutions (the cognitive, the relevance, and the interactive revolutions) put forward by Robertson & Hancock-Beaulieu (1992) is presented. As a response to this call the 'IIR evaluation model' by Borlund (e.g., 2003a) is introduced. The objective of the IIR evaluation model is to facilitate IIR evaluation as close as possible to actual information searching and IR processes, though still in a relatively controlled evaluation environment, in which the test instrument of a simulated work task situation plays a central part.

• Korean Medical Education Review
• /
• v.25 no.3
• /
• pp.273-284
• /
• 2023

According to the World Health Organization, for medical schools to fulfill their obligation of social accountability, it is necessary for medical education, research, and service areas to ref lect the healthcare system's relevance, quality, cost-effectiveness, and equity. This study utilized Boelen and Heck's (1995) social accountability grid model to analyze the degree to which the Accreditation Standards of Korean Institute of Medical Education and Evaluation 2019 (ASK2019) standards apply the World Federation for Medical Education's (WFME) standards. The social accountability characteristics of the former were compared to those of the WFME, the Liaison Committee on Medical Education, and the Australian Medical Council. Experts with experience and certification in medical education and evaluation classified the ASK2019 standards according to the grid model, evaluated social accountability perspectives, and categorized them according to the process, content, and outcome. Of the 92 standards, 61 (66.30%) were selected as social accountability standards; these encompassed all areas. There was a particular focus on outcome-related areas, such as "mission and outcomes," "student assessment," "educational evaluation," and "continuous improvement." Education and quality were the most common (33, 54.11%), followed by 18 standards related to education and relevance. However, the standards on cost effectiveness and equity corresponding to education, research, and service were significantly insufficient. As a result of classification using a logic model, many criteria were incorporated into the process, producing results similar to those of international accreditation institutions. Therefore, to fulfill medical schools' social accountability, it is necessary to develop cost effectiveness and equity standards with reference to grid models and expand them beyond education to include research and service areas. Developing content and outcome standards is also required.

• Journal of Korean Society of Rural Planning
• /
• v.13 no.2
• /
• pp.17-26
• /
• 2007

This study aims to develop a rational evaluation system which consists of the selection of evaluation items and the estimation of its weight for the Enhancement Program of the Quality of Life for Farmers and Fishermen and Rural Development. This system has two hierarchical steps. The first step shows the evaluation goals which are relevance, efficiency and effectiveness of the program. The second step stands for the evaluation items which have 11 sub-items such as necessity and externalization for the program, rationality of procedures, feedback and monitoring system, budgetary allocations, information activities, impacts on the program, achievements of the goals and so on. A tentative evaluation system was proposed by brainstorming and Delphi method of expert-group. Weighting values of evaluation items were calculated through pair-comparison works of expert group using stepwise matrix sheets by AHP(Analytic Hierarchy Process).

• Journal of The Korean Association For Science Education
• /
• v.37 no.4
• /
• pp.651-658
• /
• 2017

The purpose of this study is to analyze the invention-related content of foreign science curricula and investigate the perception of science educators about the degree of relevance between science curriculum and invention. For the analysis of foreign science curricula, we investigated the programs of 10 nations, including the US, Canada, UK, Japan, Australia, Singapore, New Zealand, France, Finland and China. To analyze the relevance between Korean science curriculum and invention, we examined common topics such as science, integrated science, and science inquiry experiment, and investigated that the elements related to invention education were included in each 'achievement standard' and 'teaching and evaluation methods'. Science educators including science teachers were asked to evaluate the degree of relevance of invention education. The results were as follows. First, science curricula in many countries contained invention-related content. Second, science educators recognized that invention education was related to science curriculum, but the systematic connection was insufficient. Third, because it is mainly limited to the results of designing and device design, they recognized that the relevance of invention education, which focuses on various processes such as problem design, inventive techniques and intellectual property, was not revealed. Therefore, it is necessary to be process-oriented when developing invention education teaching-learning methods and related materials in science education for the future.

• Journal of the Korean Society for information Management
• /
• v.41 no.1
• /
• pp.261-282
• /
• 2024

This study proposed and evaluated electroencephalography (EEG)-based and eye-tracking-based methods to determine relevance by utilizing users' implicit relevance feedback while navigating content in a digital library. For this, EEG/eye-tracking experiments were conducted on 32 participants using video, image, and text data. To assess the usefulness of the proposed methods, deep learning-based artificial intelligence (AI) techniques were used as a competitive benchmark. The evaluation results showed that EEG component-based methods (av_P600 and f_P3b components) demonstrated high classification accuracy in selecting relevant videos and images (faces/emotions). In contrast, AI-based methods, specifically object recognition and natural language processing, showed high classification accuracy for selecting images (objects) and texts (newspaper articles). Finally, guidelines for implementing a digital library interface based on EEG, eye-tracking, and artificial intelligence technologies have been proposed. Specifically, a system model based on implicit relevance feedback has been presented. Moreover, to enhance classification accuracy, methods suitable for each media type have been suggested, including EEG-based, eye-tracking-based, and AI-based approaches.