• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2013.06a
• /
• pp.527-529
• /
• 2013

바람직한 해상교통안전진단제도 정립을 위해 보다 종합적이고 체계적인 검토가 필요한 바, 본 연구에서는 메타평가에 관한 이론을 적용하여 설계된 메타평가 모형을 그동안 실시된 우리나라 해상교통안전진단에 적용, 종합적으로 분석 평가하여 해상교통 안전진단제도의 개선방안을 도출하였다. 메타평가는 평가의 질적 개선을 통한 평가결과의 활용도를 제고하기 위하여 평가수행뿐만 아니라 전반적인 평가시스템을 포함한 평가로 그 타당성을 규명하는 일련의 작업으로서 본 연구에서는 문헌연구와 전문가검토, 설문조사 등의 방법을 활용하여 진단활동에 대한 전반적인 평가를 실시하여 개선방안을 마련하였다. 특히, 개선의 시급성을 정량화함으로써 개선 우선순위에 대한 정책적 시사점이 클 것으로 기대한다.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.19 no.4
• /
• pp.382-390
• /
• 2013

The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present. At this point, it needs to establish sound MTSA scheme to proceed acceleration step through the comprehensive review and systematic approach. In this study, it aimed to design of Metaevaluation Model for the comprehensive analysis of MTSA scheme with applying theory of the Metaevaluation, that is the evaluation of evaluation. To put it concretely, This research draw a basic model by using Metaevaluation methods like as literature studies, expert reviews, surveys and etc. and proposed a available 'PIP'OU' Metaevaluation Model through verified validity and reliability. This PIP'OU Model is the first proposed Metaevaluation Model in maritime field and it is expected to be used as framework to draw up improvement measure with deriving problem for the MTSA scheme.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.11a
• /
• pp.127-127
• /
• 2017

과학기술기본법 제12조 및 성과평가법 7조에 따라 국가연구개발 투자의 효율성 제고를 위해 장기간 대규모 예산이 투입되는 사업, 사업간 중복조정 또는 연계가 필요한 사업, 다수 중앙행정기관이 공동으로 추진하는 사업, 국가적 사회적 현안으로 대두된 사업 등에 대해 특정평가를 실시하고 있다. 사업군 특정평가는 "08년부터 "17년까지 총 17회 실시되었으나 사업군 단위의 평가보다 사업군 내 개별사업 중심으로 평가가 수행되어 왔다. 본 연구의 목적은 사업군 특정평가의 평가틀을 제시하는 것으로 기존의 사업 단위 특정평가 방법을 차용해왔던 방식을 사업군 단위 특정평가에 적합한 평가틀을 제안하고자 한다. 평가의 계층구조에서 사업평가와 정책평가 사이에 위치한 사업군 평가에 대한 틀 제시는 향후 과학기술분야의 정책평가 도입을 위한 탐색연구에 해당한다. 이러한 연구목적의 달성을 위해 먼저 기존에 수행되었던 사업군 특정평가의 사례들에 메타평가를 수행하여 현 사업군 평가틀의 한계를 조사하고, 국내외 정책평가 사례 분석을 통해 사업군 특정평가 틀에 활용 가능한 벤치마킹하고자 하였다. 이러한 기존 사업군 평가의 한계와 선행 정책 평가의 시사점을 바탕으로 사업군 특정평가틀을 제시하였다. 메타평가는 선행 문헌조사를 기초하여 본 연구에 적합한 메타평가틀을 구성하여 적용하였고, 국내외 정책평가 사례에 대한 선정과 분석은 정책평가 전문가들의 지문과 면접조사를 활용하였다.

• Journal of the Korea Society for Simulation
• /
• v.14 no.2
• /
• pp.73-81
• /
• 2005

이 논문에서는 메타데이터 레지스트리간의 메타데이터 교환을 위해 제안된 교환 프로토콜의 장점을 명시적으로 보이기 위한 시뮬레이션 결과에 대하여 기술한다. 기존 접근 방법들은 교환 메커니즘의 높은 복잡도, 지역 메타데이터 관리 시스템으로의 종속성, 새로운 메타데이터 관리 시스템의 추가를 위한 높은 비용 등의 문제점을 지닌다. 이를 해결하기 메타데이터 교환 프로토콜이 제안되었다. 그러나 지금까지의 연구에서는 정성적으로만 그 장점을 보였다. 이 논문의 목적은 정략적 관점에서 제안된 프로토콜의 장점을 기술하고자 함에 있다. 특히 이 논문에서는 질의 효율이 가장 중요한 문제로서 다른 요인에 의한 결과에도 영향을 주기 때문에 질의 효율성 문제에 초점을 둔다. 이를 위해 평가 항목과 평가 모델에 대해 정의한다. 질의 효율성 평가를 위한 요인 중에서 대상 메타데이터의 개수, 각 메타데이터를 구성하는 컴포넌트의 개수 및 각 컴포넌트들을 구성하는 속성들의 개수를 주 파라미터로 이용하였다. 이에 따라 시뮬레이션은 크게 세 가지 유형을 지니게 된다 정량적 평가를 통해 교환 프로토콜이 요구되는 이유와 그 정당성을 명시적으로 보인다.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.1
• /
• pp.649-662
• /
• 2017

Since 1980, the number of universities have increased dramatically. However, compared to the quantitative growth, the lack of qualitative growth has often been criticized. Students entering university are estimated to decrease by half in 2025 compared to 2014. In swift response to challenges with decreasing student enrollment, the first University Reform Evaluation (URE) for innovating universities, was conducted and resulted in controversy. Opposition is based on distrust of the overall system, questioning the reliability of the evaluation process utilized for the URE evaluation index. Meta-evaluation is required to improve the quality of evaluation, and standards developed prior to conducting the URE. Therefore, an interdisciplinary approach is necessary for the evaluation of human resource development. This research uses the interdisciplinary approach from the human resources development point of view in attempting to develop meta-evaluation criteria which will enable effective evaluation and analysis of URE. The meta-evaluation standard features the creation of the ERPOU model, by conducting literature review, and considers data from expert symposiums, and surveys. The ERPOU model consists of 5 evaluation fields, 21 evaluation categories, and 42 evaluation standards.

• Journal of Navigation and Port Research
• /
• v.37 no.4
• /
• pp.383-390
• /
• 2013

After forming a institutional framework with specified in Maritime Safety Law(ex. Maritime Traffic Safety Law) on May 27th, 2009, The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present. But there's no review with the comprehensive and systematic approach for proceeding acceleration step of MTSA scheme. At this point, this study analyzed current status and derived improvement measures using by 'PIP'OU model' which was designed for the comprehensive analysis in accordance with metaevaluation theory, like as question investigation and etc. Consequently, it mainly needs to improve 'Assessment Plan' domain and minimized the difference in views between concerned parties. This study is expected to be used to develop systematic maritime policy by proposing the order of priority in improvement matters.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2012.10a
• /
• pp.169-170
• /
• 2012

The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present since May 27th, 2009. But recently, there's a controversy about whether it has been performed properly or the results is significant. These new discussions were arose from lack of validity and appropriateness we had yet to find. At this point, it needs to establish sound MTSA scheme through the comprehensive review. This research developed a suitable meta-evaluation model for MSTA with applying theory of the teta-evaluation, that is the evaluation of evaluations and verified by using meta-evaluation methods like as literature studies, expert reviews, surveys and etc. The results of this study can be used to evaluate MTSA activities and it will contribute to improving MTSA scheme.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of Korea Technology Innovation Society
• /
• v.17 no.4
• /
• pp.703-732
• /
• 2014

Meta-evaluation for national R&D programs should be established within the framework of whole R&D system linked with science and technology needs and objectives. The R&D program evaluation system can be understood as a circulation of input, implementation, output, and utilization. In the result of the Delphi survey, which consisted of twenty-four experts (performed in three rounds), twenty-four indices were developed. The meta-evaluation model included sub-items which were important points of view of it as follow (eight items): propriety of planning, sufficiency of information, and propriety of evaluators in evaluation input; appropriateness of method and appropriateness of procedure in evaluation implementation; credibility of output in evaluation output; and usefulness of report and application of evaluation utilization. As the application of the meta-evaluation model, the total mean was lower than 3.0 of the median value of 2.73 (5 point Likert scale). Finally, it was suggested that the feedback of evaluation results should be more enforced to R&D program improvement particularly (evaluation utilization 2.50).

• Journal of the Society of Disaster Information
• /
• v.14 no.2
• /
• pp.203-210
• /
• 2018

Purpose: The purpose of this study is to build a model for the meta - evaluation of the national infrastructure system and to improve the evaluation system of the national infrastructure system using the model. Method: For the study, the disaster-related laws and regulations, the evaluation report of the national infrastructure system published by the government, the guideline for the establishment of the national infrastructure protection plan, the meta-evaluation previous research data, To analyze the actual state of the evaluation. Results: Among the indices of evaluation of the current national infrastructure system, the supplementary requirements were derived from seven indicators such as appropriateness of education and training plan and implementation of disaster response, evaluation and communication with stakeholders, and evaluation committee training time. Conclusion: It is expected that the improvement plan derived from this study can be used to improve the evaluation index of the national infrastructure system.