• 기술경영경제학회:학술대회논문집
• /
• 기술경영경제학회 1998년도 제13회 하계학술발표회 논문집
• /
• pp.131-163
• /
• 1998

The interest in the evaluation of government-sponsored research institutes (GRIs) has increased markedly in Korea in 1990s; this is mainly because of the increasing needs 1) to improve the quality of R&D at GRIs, and 2) to reorient the GRIs' strategic position in Korean national innovation systems due to the enhancement of R&D capabilities of private companies and universities during last decade. As a first attempt to diagnose the managerial and strategic issues of GRIs, a Multi-Ministerial Evaluation Committee was established as an ad hoc task force under the Prime Minister's Office in 1991. According to the recommendations of the committee, the Ministry of Science and Technology (MOST) to which most of GRIs were affiliated, made it a rule to evaluate the annual performance of GRIs since 1992. This paper examines the recent experience of MOST's evaluation of Government-sponsored Research Institute in Korea. After several years'efforts of Science & Technology Policy Institute(STEPI) to build prospective evaluation systenL MOST decided to apply two supplementary approaches for the evaluation of GRIs; one is summative annual evaluation and the other is formative 3-year evaluation. The annual evaluation system that is designed as a temporary measure is to monitor and to guide the self-evaluation activities of GRIs. In the process of annual evaluation, MOST tries to minimize its direct involvement, and allows each GRI to develop self-evaluation system that is most appropriate for the unique characteristics of the institute. If there exist urgent issues under scrutiny, however, it can be incorporated and examined by a group of external experts as special issues in the annual evaluation system. The aim of 3-year evaluation is both to examine the past performance of each GRI and to investigate whether the strategic role of each GRI is viable in the future. Its major focus, however, lies not on auditing past performance but on strengthening future strategic position of each GRI. The MOST designates a group of evaluation experts with appropriate knowledge and competence as members of the General Evaluation Committee for one year. With the help of STEPI, a specialized research institute for R&D evaluation, the General Evaluation Committee develops methodology and procedures for the actual evaluation of GRIs. Based on the evaluation reports and recommendations from the General Evaluation Committee, the MOST develops various policy measures for strengthening GRIs.

• 의학교육논단
• /
• 제24권3호
• /
• pp.250-260
• /
• 2022

Evaluating the effectiveness of educational programs involves measuring learning processes as well as outcomes. It is essential to study cohorts of students and graduates to evaluate the long-term effects of educational programs with data generated both during education and after graduation. The purpose of this study was to establish cohorts of students and graduates to evaluate their performance, thereby providing a basis for evaluating the social accountability of medical education. In this study, student and graduate cohorts were built for both students currently enrolled and graduates at Inje University College of Medicine (IUCM). A model involving the process of cohort establishment and an evaluation indicator framework was developed. In the process of cohort establishment, the following steps were conducted: defining the goals and objectives of the student and graduate cohorts, organizing a cohort committee, developing regulations, registering cohorts, acquiring consent, and building a database. A framework of evaluation indicators according to the graduate roles of IUCM was developed by adapting Kirkpatrick's evaluation model. Next, items to be collected in student and graduate cohorts were selected, and the current status of existing data was analyzed. Moreover, a preliminary analysis was conducted, including analyses of the evaluation indicators and graduates' performance. This study suggests that it is necessary to include additional evaluation indicators considering students' learning environment and well-being in student cohorts and to develop strategies or methods for graduates to continue participating in data collection for a long-term study.

• 지식경영연구
• /
• 제10권1호
• /
• pp.71-100
• /
• 2009

Recently, many of organizations build up their performance measurement system (PMS) to measure their knowledge management performance. However, the system that doesn't well reflect the organization's strategies as well as surroundings could obstruct their performance improvement, instead. Therefore, It is really important to establish the PMS to reflect organization's surroundings and strategies. The purpose of this study is to make a diagnosis of a performance measurement practice of a domestic university's knowledge management. To serve this research purpose, we examine the uptight performance index and PMS from existing references. And we diagnose the specific practices and maturity rates of measuring performances, and the recognition of the performance index at "D" university recently adopting balanced scorecard to performance evaluation through the survey on academic affairs committee members, performance evaluation committee members, and administration members. The method analyzing data from the survey is a gap analysis which includes alignment analysis, congruence analysis, consensus analysis, and confusion analysis. We make a diagnosis of performance measurement practices at "D" university, raise several points of this performance measurement system, and present the improvement plans from these problems.

• 의학교육논단
• /
• 제25권2호
• /
• pp.126-131
• /
• 2023

The aim of this study was to systematically collect data for evaluating short- and long-term outcomes using Kirkpatrick's four-level evaluation model, Chonnam National Medical School has established plans for developing and managing a database of student and graduate cohorts. The Education Evaluation Committee, with assistance from the Medical Education Office, manages the development and maintenance of cohort data. Data collection began in the 2022 academic year with first- through fourth-year medical students and graduates of the year 2022. The collected data include sociodemographic characteristics, admission information, psychological test results, academic performance data, extracurricular activity data, scholarship records, national medical licensing exam results, and post-graduation career paths. The Education Evaluation Committee and the Medical Education Office analyze the annually updated student and graduate cohort data and report the results to the dean and relevant committees. These results are used for admissions processes, curriculum improvement, and the development of educational programs. Applicants interested in using the student and graduate cohort data to evaluate the curriculum or conduct academic research must undergo review by the Educational Evaluation Committee before being granted access to the data. It is expected that the collected data from student and graduate cohorts will provide a sound and scientific basis for evaluating short- and long-term achievements based on student, school, and other characteristics, thereby supporting medical education policies, innovation, and implementation.

• 융합보안논문지
• /
• 제16권1호
• /
• pp.13-21
• /
• 2016

민간경비가 도입된 지 60여년이 지난 현재 민간경비와 관련된 국가공인 자격으로는 경비지도사와 신변보호사 자격제도가 있다. 본 연구에서는 2013년도부터 국가공인자격으로 실시 되어오고 있는 신변보호사 자격검정 사항 중에서 2차 실기시험제도의 문제점에 대하여 논의하였다. 현행 신변보호사 자격검정은 1차 학과시험과 2차 실기시험으로 분류하여 실시하고 있는 가운데 신변보호사의 자격 검증을 엄격히 하여 응시자에 대한 만족도와 대중의 신뢰도를 높여가야할 시기에 봉착하였다고 판단되어 신변보호사 실기시험제도의 문제점에 대한 개선방안을 다음과 같이 제시하였다. 첫째, 현재 단순하고 비교적 기초적인 실기시험 평가 항목의 난이도를 다양화 하여 구분하는 것이 필요하다. 둘째, 현재 실기시험 평가기술은 합기도의 기술분야에 치우쳐 있다고 볼 수 있어 각 무도분야의 실질적 활용가능성이 높은 기술을 복합적으로 접목시켜 다양화 하는 것이 필요하다. 셋째, 현재 일반화 되지 않은 실기시험 평가위원제도를 전문화된 실기시험 평가위원으로 선정할 수 있도록 기준안 마련이 필요하다. 넷째, 현재 실기시험 평가위원과 응시자의 관계에 있어 지인인 경우가 많아 객관성확보차원에서 제척제도를 신설하는 것이 필요하다. 이와 같이 신변보호사 자격검정 실기시험제도의 전문성을 고양시켜나가기 위해 관련기관의 제도적 개선이 시급히 이루어져야 할 것이다.

• 한국해양공학회:학술대회논문집
• /
• 한국해양공학회 2001년도 추계학술대회 논문집
• /
• pp.86-90
• /
• 2001

Demand of good seakeeping perfomace is increasing for sea going vessels such as cruisers, naval ships and container ships. Especillay roll motion is one of major concerns in evaluation of seakeeping performance due to its large resonace motion. Since large roll resonance motion is mainly arised from inherent small damping. use of additional mechnism to provide roll damping can significantly reduce roll motion. In this paper, a reliable performace evaluation method of fin stabilizer, which is very useful for stabilizing roll motion of mid and high speed vessls, is described. Model test and time domain simulation methods are adopted for performance evaluation in which real operating situation of fin stabilizer can be exactly modelled. Model test and simulation results show good correlations between model test and simulation results.

• 의학교육논단
• /
• 제25권2호
• /
• pp.114-118
• /
• 2023

Multiple cohorts (e.g., current students and graduates) were formed to collect information on the entire educational process from admission to graduation regarding students' educational performances at Kosin University College of Medicine. Data that had already been collected and analyzed by different committees for different purposes were grouped into a more systematic and comprehensive system called the cohort system, enabling the necessary data to be collected promptly and analyzed in accordance with the purpose of providing meaningful information in each area of the educational process. Therefore, comprehensive cohort data that can be used for mission statement revision, curriculum development and improvement, student counseling, and student selection were established and utilized. The cohort data were collected from performance evaluation indicators including self-evaluation surveys, evaluation tools for learning outcomes, academic achievement, results of the Korean Medical Licensing Examination, and career placement. Based on the results obtained by analyzing cohort data, a comprehensive cohort report has been published. The data analyzed through the cohort were reported to each committee and used in various ways. Currently, however, only some data have been analyzed and used. In the future, after complete data collection, the cohort data can be used as meaningful basic data for achieving the institution's mission and educational goals, developing and improving the curriculum, counseling students, and selecting students through the analysis of learning performance data from student admission to graduation and after graduation.

• 의학교육논단
• /
• 제15권3호
• /
• pp.112-119
• /
• 2013

Most medical colleges in Korea have been shifting from traditional education to outcome-based education, which is the general trend in medical education. The purpose of this study was to make some suggestions in light of the reality and challenges of student assessment in medical education from the perspective of outcome- based education. First, those who are responsible for student assessment should be diversified to include faculty, residents, students, and evaluation committee members. They need separate roles in educational evaluation, so evaluation competencies are required for them. Second, various methods for evaluation and score interpretation can be used for effective evaluation. We can adopt diagnostic, formative, and summative evaluation functionally, and the norm-referenced, criterion-referenced, growth-referenced, and ability-referenced evaluation based on criteria for score interpretation. Finally, various evaluation domains and test forms can be administered together in the common lectures in the medical school. We can test not only knowledge but also skills and attitudes, with diverse test forms such as supply and performance types.

• 한국해양공학회:학술대회논문집
• /
• 한국해양공학회 2006년 창립20주년기념 정기학술대회 및 국제워크샵
• /
• pp.277-280
• /
• 2006

Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision-making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. However, the objectives of maximising the degree of technical performance, maximising the safety levels and minimising the costs incurred are usually in conflict, and the evaluation of the technical performance, safety and costs is always associated with uncertainties, especially for a novel system at the initial concept design stage. In this paper, a design-decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. It is a Multiple Attribute Decision-Making (MADM) or Multiple Criteria Decision Making (MCDM) framework, which provides a juxtaposition of cost, safety and technical performance of a system during evaluation to assist decision makers in selecting the winning design/procurement proposal that best satisfies the requirement in hand. An illustrative example is used to demonstrate the application of the proposed framework.

• 상하수도학회지
• /
• 제24권5호
• /
• pp.617-628
• /
• 2010

The operation performance of sewer rehabilitation projects conducted with Build-Transfer- Lease contract in Korea will be evaluated using the index of infiltration and inflow (I/I). Though I/I obtained at the fourth year should be initially evaluated based on the I/I values observed for the previous three years after the completion of sewer construction, the concrete methodology have not been proposed to rely on the so called 'performance evaluation committee'. This study suggests two statistical methodology to evaluate the I/I performance; the confidence interval method and the hypothesis-testing method. Assumed ten I/I values in each year for 20 years are used in this study. Two cases are analyzed and compared; case I to use as control data all I/I values for all years obtained before the evaluation year and case II to use I/I values for only 3 years before the evaluation year. As a result, case II tends to have relatively higher scores than case I, reflecting the low mean I/I values at the initial years.