• Journal of the Society of Disaster Information
• /
• v.14 no.2
• /
• pp.203-210
• /
• 2018

Purpose: The purpose of this study is to build a model for the meta - evaluation of the national infrastructure system and to improve the evaluation system of the national infrastructure system using the model. Method: For the study, the disaster-related laws and regulations, the evaluation report of the national infrastructure system published by the government, the guideline for the establishment of the national infrastructure protection plan, the meta-evaluation previous research data, To analyze the actual state of the evaluation. Results: Among the indices of evaluation of the current national infrastructure system, the supplementary requirements were derived from seven indicators such as appropriateness of education and training plan and implementation of disaster response, evaluation and communication with stakeholders, and evaluation committee training time. Conclusion: It is expected that the improvement plan derived from this study can be used to improve the evaluation index of the national infrastructure system.

• Journal of Family Resource Management and Policy Review
• /
• v.15 no.3
• /
• pp.43-62
• /
• 2011

The purpose of this study was to propose a framework and system for an advanced evaluation scale for the Multicultural Family Support Center and its services. For this study, we used the Meta-Evaluation method, which is also known as an 'evaluation of the evaluation.' The data were collected from 134 surveys of individuals working in the Multicultural Family Support Center. The questionnaire consisted of two parts: a) general opinions regarding the present evaluation scale; and b) concrete opinions about the details of the scale. The results indicated several problems and issues for improvement. In light of these results, we suggest that not only do the detailed scales have to be modified to incorporate workers' opinions, but also that the management of the evaluation system itself has to be improved in order to achieve more effective evaluation procedures.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.1
• /
• pp.649-662
• /
• 2017

Since 1980, the number of universities have increased dramatically. However, compared to the quantitative growth, the lack of qualitative growth has often been criticized. Students entering university are estimated to decrease by half in 2025 compared to 2014. In swift response to challenges with decreasing student enrollment, the first University Reform Evaluation (URE) for innovating universities, was conducted and resulted in controversy. Opposition is based on distrust of the overall system, questioning the reliability of the evaluation process utilized for the URE evaluation index. Meta-evaluation is required to improve the quality of evaluation, and standards developed prior to conducting the URE. Therefore, an interdisciplinary approach is necessary for the evaluation of human resource development. This research uses the interdisciplinary approach from the human resources development point of view in attempting to develop meta-evaluation criteria which will enable effective evaluation and analysis of URE. The meta-evaluation standard features the creation of the ERPOU model, by conducting literature review, and considers data from expert symposiums, and surveys. The ERPOU model consists of 5 evaluation fields, 21 evaluation categories, and 42 evaluation standards.

• Bulletin of Food Technology
• /
• v.24 no.4
• /
• pp.596-604
• /
• 2011

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.10 no.8
• /
• pp.2088-2102
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result gained 74.3 points out of 100, so it was evaluated as 'Good'. T- test and one-way ANOVA were used to identify the difference between groups. As a result of difference analysis between groups, some evaluation items showed difference within significance level. From this analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D performances.

• Journal of Technology Innovation
• /
• v.13 no.3
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• The Korean Journal of Applied Statistics
• /
• v.21 no.6
• /
• pp.1007-1014
• /
• 2008

Usability evaluation(UE) experiments are conducted to provide UE practitioners with guidelines for better outcomes. In UE research, significant quantities of empirical results have been accumulated in the past decades. While those results have been anticipated to integrate for producing generalized guidelines, traditional meta-analysis has limitations to combine UE empirical results that often show considerable heterogeneity. In this study, a new data mining method called weighted bi-clustering(WBC) was proposed to partition heterogeneous studies into homogeneous subsets. We applied the WBC to UE empirical results and identified two homogeneous subsets, each of which can be meta-analyzed. In addition, interactions between experimental conditions and UE methods were hypothesized based on the resulting partition and some interactions were confirmed via statistical tests.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.4 no.4
• /
• pp.1-25
• /
• 2009

The Government is putting efforts to enhance efficiency and productivity of performances of National R&D Programs by enacting 'Law on Evaluation and Management of Performances of National R&D Program'. This study is the result of development of evaluation model and indices for analysis of efficiency through meta evaluation method for the specific evaluation among evaluation systems for National R&D Program that are being carried out at government-wide level. Meta evaluation model for analysis of efficiency of evaluation system for National R&D Program designed evaluation indices by categorizing compositional factors into 5 categories, namely, evaluation context factor, evaluation resources factor, evaluation process factor, evaluation result factor and evaluation utilization factor. Furthermore, the result of verification of reliability on evaluation composition factors and evaluation indices analyzed to select evaluation items displayed Cronbach' $\alpha$ coefficient of 0.933, thereby illustrating that there is no major problem in the evaluation index system. In addition, computation of weight for each evaluation composition factor and evaluation index was analyzed by using analytical hierarchy process (AHP) technique. The result of analysis displayed overall consistency index of less than 0.1 for the investigators, thereby enabling analysis that there is consistency in investigators.

• Journal of the Korean Society of Radiology
• /
• v.13 no.3
• /
• pp.407-414
• /
• 2019

Recently, after the reorganization as the basis of NCS education, various learning methods are being sought for improving the basic occupational ability and job ability required by NCS, and the evaluation method accordingly is urgently needed. The purpose of this study was to evaluate the applicability of meta-cognitive learning and Havruta learning as evaluation cases in order to improve the job skills and basic skills required in the NCS curriculum. As a result, the meta-cognitive learning response sample statistic showed an average of 2.6883 when the pre-meta-cognitive learning questionnaire was a 5-point scale, and an average of 4.2468 after the meta-cognitive learning questionnaire. The correlation coefficient was 0.782 and the significance probability was 0.045. In the case of the Havruta learning correspondence sample statistic, the average of 3.1515 when the preliminary Havruta learning questionnaire was a 5 point scale and the average of the post-Havruta learning questionnaire was 4.3853, which was improved by 1.23 points. The correlation coefficient was 0.631 and the significance probability was 0.049. Meta-cognitive learning and Havruta learning were found to be correlated. The mean of meta cognition was 3.4675 and the mean of Havruta was 3.7684. Metacognitive learning and Havruta learning were -0.042 And there was no statistically significant difference. Therefore, the learning method to improve the job ability should be applied considering the characteristics of the subject.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2012.10a
• /
• pp.169-170
• /
• 2012

The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present since May 27th, 2009. But recently, there's a controversy about whether it has been performed properly or the results is significant. These new discussions were arose from lack of validity and appropriateness we had yet to find. At this point, it needs to establish sound MTSA scheme through the comprehensive review. This research developed a suitable meta-evaluation model for MSTA with applying theory of the teta-evaluation, that is the evaluation of evaluations and verified by using meta-evaluation methods like as literature studies, expert reviews, surveys and etc. The results of this study can be used to evaluate MTSA activities and it will contribute to improving MTSA scheme.