• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2013.06a
• /
• pp.527-529
• /
• 2013

바람직한 해상교통안전진단제도 정립을 위해 보다 종합적이고 체계적인 검토가 필요한 바, 본 연구에서는 메타평가에 관한 이론을 적용하여 설계된 메타평가 모형을 그동안 실시된 우리나라 해상교통안전진단에 적용, 종합적으로 분석 평가하여 해상교통 안전진단제도의 개선방안을 도출하였다. 메타평가는 평가의 질적 개선을 통한 평가결과의 활용도를 제고하기 위하여 평가수행뿐만 아니라 전반적인 평가시스템을 포함한 평가로 그 타당성을 규명하는 일련의 작업으로서 본 연구에서는 문헌연구와 전문가검토, 설문조사 등의 방법을 활용하여 진단활동에 대한 전반적인 평가를 실시하여 개선방안을 마련하였다. 특히, 개선의 시급성을 정량화함으로써 개선 우선순위에 대한 정책적 시사점이 클 것으로 기대한다.

• Journal of the korean veterinary medical association
• /
• v.39 no.1
• /
• pp.58-72
• /
• 2003

메타분석은 evidence-based medicine의 한가지 수단으로서 현재까지 알려진 모든 지식을 체계적으로 종합하고 평가하는 분석법을 의미한다. 인의학에서는 80년대 이후 메타분석이 보편화되어 있으나 수의학에서는 거의 찾아보기 어렵다. 본 원고에서는 메타분석법에 대한 수의학 관련 연구자들의 이해를 돕기 위하여 젖소의 요네병 (Johne's disease)을 진단하는데 사용되는 ELISA검사의 정확도에 대한 메타분석기법의 적용사례를 중심으로 설명한다.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.10
• /
• pp.158-167
• /
• 2016

This study was conducted to evaluate the quality of meta-analysis of social work in South Korea using the Assessment of Multiple Systematic Review (AMSTAR). Electronic databases including the Korean Studies Information Service System (KISS), DBpia, and RISS4U were searched for 'meta-analysis', 'social work', and 'social welfare' from 2000 to December 2015, and 42 meta-analysis studies were included. Data were analyzed using descriptive statistics, t-tests, and ANOVA. The mean score for AMSTAR evaluation was $4.766{\pm}1.66$, while 19 studies (45.2%) were classified at the low-quality level, and 22 (52.4%) were at the moderate-quality level. The scores of quality assessment were analyzed by publication year, participants, number of studies included, number of DB, reporting study quality, extraction diagram and topics. The findings indicated that the following changes should be implemented to improve the quality and reliability of meta-analysis results in social work research: 1) common reporting guidelines should be provided for the social work field, 2) quality analyses of each study should be conducted to achieve a high level of evidence of effectiveness of social work interventions, 3) the characteristics of the included studies should be provided, and 4) a consensus and procedure based on at least two independent data extractors should be reported.

• Journal of Navigation and Port Research
• /
• v.37 no.4
• /
• pp.383-390
• /
• 2013

After forming a institutional framework with specified in Maritime Safety Law(ex. Maritime Traffic Safety Law) on May 27th, 2009, The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present. But there's no review with the comprehensive and systematic approach for proceeding acceleration step of MTSA scheme. At this point, this study analyzed current status and derived improvement measures using by 'PIP'OU model' which was designed for the comprehensive analysis in accordance with metaevaluation theory, like as question investigation and etc. Consequently, it mainly needs to improve 'Assessment Plan' domain and minimized the difference in views between concerned parties. This study is expected to be used to develop systematic maritime policy by proposing the order of priority in improvement matters.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.19 no.4
• /
• pp.382-390
• /
• 2013

The efforts for improving 'Maritime Traffic Safety Assessment Scheme(MTSA scheme)' have continued to the present. At this point, it needs to establish sound MTSA scheme to proceed acceleration step through the comprehensive review and systematic approach. In this study, it aimed to design of Metaevaluation Model for the comprehensive analysis of MTSA scheme with applying theory of the Metaevaluation, that is the evaluation of evaluation. To put it concretely, This research draw a basic model by using Metaevaluation methods like as literature studies, expert reviews, surveys and etc. and proposed a available 'PIP'OU' Metaevaluation Model through verified validity and reliability. This PIP'OU Model is the first proposed Metaevaluation Model in maritime field and it is expected to be used as framework to draw up improvement measure with deriving problem for the MTSA scheme.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.11a
• /
• pp.127-127
• /
• 2017

과학기술기본법 제12조 및 성과평가법 7조에 따라 국가연구개발 투자의 효율성 제고를 위해 장기간 대규모 예산이 투입되는 사업, 사업간 중복조정 또는 연계가 필요한 사업, 다수 중앙행정기관이 공동으로 추진하는 사업, 국가적 사회적 현안으로 대두된 사업 등에 대해 특정평가를 실시하고 있다. 사업군 특정평가는 "08년부터 "17년까지 총 17회 실시되었으나 사업군 단위의 평가보다 사업군 내 개별사업 중심으로 평가가 수행되어 왔다. 본 연구의 목적은 사업군 특정평가의 평가틀을 제시하는 것으로 기존의 사업 단위 특정평가 방법을 차용해왔던 방식을 사업군 단위 특정평가에 적합한 평가틀을 제안하고자 한다. 평가의 계층구조에서 사업평가와 정책평가 사이에 위치한 사업군 평가에 대한 틀 제시는 향후 과학기술분야의 정책평가 도입을 위한 탐색연구에 해당한다. 이러한 연구목적의 달성을 위해 먼저 기존에 수행되었던 사업군 특정평가의 사례들에 메타평가를 수행하여 현 사업군 평가틀의 한계를 조사하고, 국내외 정책평가 사례 분석을 통해 사업군 특정평가 틀에 활용 가능한 벤치마킹하고자 하였다. 이러한 기존 사업군 평가의 한계와 선행 정책 평가의 시사점을 바탕으로 사업군 특정평가틀을 제시하였다. 메타평가는 선행 문헌조사를 기초하여 본 연구에 적합한 메타평가틀을 구성하여 적용하였고, 국내외 정책평가 사례에 대한 선정과 분석은 정책평가 전문가들의 지문과 면접조사를 활용하였다.

• Journal of the Korea Convergence Society
• /
• v.11 no.2
• /
• pp.161-165
• /
• 2020

Although research using meta-analysis is increasing in the field of rehabilitation science, not all meta-analytical papers are of the same quality. In particular, although meta-analysis is a research method with the highest level of evidence, it may be possible to derive distorted conclusions or alternatives by simply integrating representative values without considering heterogeneity among individual studies. This study analyzed the current status of meta-analysis papers on the subject of language arbitration published in Korea from January 2010 to June 2019, and used A Measurement Tool to Assess the Methodological Quality of Systematic Review (AMSTAR). As a result of evaluating the methodological quality of the final five papers, the average of 7.4 points out of 11 points was found above average. In order to raise the qualitative level of Meta-analysis in speech-language pathology in the future, it is necessary to include verification of publication bias and specification of conflicts of interest.

• Journal of Service Research and Studies
• /
• v.13 no.4
• /
• pp.160-172
• /
• 2023

The metaverse, derived from the fusion of "meta" and "universe," encompasses a three-dimensional virtual realm where avatars actively participate in a range of political, economic, social, and cultural activities. With the recent development of the metaverse, the traditional way of experiencing services is changing. While existing studies have mainly focused on the technological advancements of metaverse services (e.g., scope of technological enablers, application areas of technologies), recent studies are focusing on evaluating the quality of experience (QoE) of metaverse services from a customer perspective. This is because understanding and analyzing service characteristics that determine QoE from a customer perspective is essential for designing successful metaverse services. However, relatively few studies have explored the customer-oriented approach for QoE evaluation thus far. This study conducted an online review analysis using text mining to overcome this limitation. In particular, this study analyzed 227,332 online reviews of the Roblox service, known as a representative metaverse service, and identified points for improving the Roblox service based on the analysis results. As a result of the study, nine service features that can be used for QoE evaluation of metaverse services were derived, and the importance of each feature was estimated through relationship analysis with service satisfaction. The importance estimation results identified the "co-experience" feature as the most important. These findings provide valuable insights and implications for service companies to identify their strengths and weaknesses, and provide useful insights to gain an advantage in the changing metaverse service environment.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.05a
• /
• pp.393-407
• /
• 2017

최근 정부 R&D 방향을 보면 정부출연연의 역할은 중장기, 대규모 신규사업발굴에 초점을 두고 있으며 출연연 자체적으로 연구기획에 많은 투자와 노력을 하고 있다. 하지만, 출연연 주요사업 연구개발계획서에 철저한 준비가 되어야 함에도 기획 전문지식이 체계적으로 축적되지 않았으며 연구기획에 대한 좋은 본보기를 요구하는 연구자들이 지속적으로 이어져왔다. 이에 본 연구에서는 논리적이고 심도있는 검토를 거치는 사전평가 과정인 국가연구개발 예비타당성조사 사업을 본보기로 제안하며 주요사업 기획에 도움이 되는 평가항목들과 내용을 메타분석하고자 한다. 이를 위해 KISTEP에서 공개한 예비타당성조사 보고서의 평가항목들 중에서 출연연 주요사업에 적용될 수 있는 기술적 타당성 평가항목들을 선별한다. 그리고, 선별된 평가항목들끼리의 내용분석을 통해 사업 타당성에 대한 지적사항을 항목별로 정리하여 시사점을 찾아내고자 한다. 본 연구를 통해 주요사업 대규모, 중장기 연구기획 시 실무적으로 도움이 될것으로 기대한다.