• 제목/요약/키워드: Meta Evaluation

검색결과 345건 처리시간 0.047초

메타분석연구에서 나타난 프로그램 구성요소의 실태 : 증거기반 프로그램 개발의 관점에서 (The Feature of the Program components in the Meta Analysis Research : Evidence Based Program Development Perspective)

  • 서인해;공계순
    • 사회복지연구
    • /
    • 제49권3호
    • /
    • pp.247-275
    • /
    • 2018
  • 메타분석을 프로그램 개발 측면에서 조사한 연구가 부족한 상황에서 본 연구는 최근 18년간 발표된 메타분석연구논문에 나타난 프로그램 구성요소의 실태를 분석하고, 이를 토대로 '프로그램 구성요소의 증거수준'을 파악하여 프로그램 개발 활동에서 어떤 의미를 주는가를 탐색하였다. 연구대상은 2000년부터 2017년 6월 현재까지 전국주요학술지에서 검색된 사회복지, 심리, 상담, 보건 영역의 110개 메타분석연구논문(5,781개 프로그램 평가논문)이며 분석방법은 내용분석을 활용하였다. 분석결과는 다음과 같다. 조사된 메타분석논문은 인구대상, 문제, 프로그램 유형에서 범위를 좁혀 연구하는 경향이 많았지만, 여러 이질적인 유형을 포함하여 분석하는 경우도 상당했다. 통계분석방법에서는 프로그램 효과성에 대한 이질적 배경이 되는 요인을 설명할 수 있는 조절효과분석이 상대적으로 적었다. 메타분석을 위한 프로그램 구성요소 선정은 연구자의 임의적인 선택도 매우 많았으며, 특정한 구성요소들 중심으로 편중되게 조사하는 경향이 있었다. 프로그램 구성요소의 효과성과 관계된 통계적인 유의성 비율에 대한 분석결과에서는 대상자의 연령과 문제 심각성, 제공자의 전문성, 개입강도와 개입활동내용이 높은 수준의 '프로그램 구성요소 증거수준'을 보여주고 있었다. 연구결과에 대한 논의와 프로그램 메타분석의 유용성을 높이기 위한 과제도 제시되었다.

PRISMA 2020 지침에 근거한 한방재활의학과학회지 체계적 문헌고찰 보고의 질 평가 연구 (Reporting Qualitative Research of Systematic Review in the Journal of Korean Medicine Rehabilitation According to Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 Guidelines)

  • 나현욱;박신혁;우현준;한윤희;금지혜;이정한;하원배
    • 한방재활의학과학회지
    • /
    • 제32권3호
    • /
    • pp.85-107
    • /
    • 2022
  • Objectives The purpose of this study was to assess the reporting quality of systematic reviews and meta-analyses in the Journal of Korean Medicine Rehabilitation (JKMR) using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines. Methods Systematic reviews and meta-analyses in JKMR, published from January 1991 to January 2022, were selected by searching the Korean studies Information Service System and JKMR homepage. Two independent researchers searched and selected systematic reviews and meta-analyses and evaluated the reporting quality of abstracts and main texts using the PRISMA 2020 guidelines. Results Of 1,515 articles, 39 systematic reviews were finally included for assessment. Evaluation of abstracts resulted in 2 studies rated as high, 11 studies rated as moderate, and 26 studies rated as low. A maximum of 83.3% and a minimum of 25.0% of the items were reported in the abstracts. Evaluation of the manuscripts resulted in no studies rated as high, 14 studies rated as moderate, and 25 studies rated as low. A maximum of 67.9% and a minimum of 34.1% of the items were reported in the manuscripts. Conclusions To improve the quality of systematic reviews published in JKMR, it is necessary to conduct systematic reviews based on the PRISMA 2020 guidelines.

다중 클래스 데이터셋의 메타특징이 판별 알고리즘의 성능에 미치는 영향 연구 (The Effect of Meta-Features of Multiclass Datasets on the Performance of Classification Algorithms)

  • 김정훈;김민용;권오병
    • 지능정보연구
    • /
    • 제26권1호
    • /
    • pp.23-45
    • /
    • 2020
  • 기업의 경쟁력 확보를 위해 판별 알고리즘을 활용한 의사결정 역량제고가 필요하다. 하지만 대부분 특정 문제영역에는 적합한 판별 알고리즘이 어떤 것인지에 대한 지식은 많지 않아 대부분 시행착오 형식으로 최적 알고리즘을 탐색한다. 즉, 데이터셋의 특성에 따라 어떠한 분류알고리즘을 채택하는 것이 적합한지를 판단하는 것은 전문성과 노력이 소요되는 과업이었다. 이는 메타특징(Meta-Feature)으로 불리는 데이터셋의 특성과 판별 알고리즘 성능과의 연관성에 대한 연구가 아직 충분히 이루어지지 않았기 때문이며, 더구나 다중 클래스(Multi-Class)의 특성을 반영하는 메타특징에 대한 연구 또한 거의 이루어진 바 없다. 이에 본 연구의 목적은 다중 클래스 데이터셋의 메타특징이 판별 알고리즘의 성능에 유의한 영향을 미치는지에 대한 실증 분석을 하는 것이다. 이를 위해 본 연구에서는 다중 클래스 데이터셋의 메타특징을 데이터셋의 구조와 데이터셋의 복잡도라는 두 요인으로 분류하고, 그 안에서 총 7가지 대표 메타특징을 선택하였다. 또한, 본 연구에서는 기존 연구에서 사용하던 IR(Imbalanced Ratio) 대신 시장집중도 측정 지표인 허핀달-허쉬만 지수(Herfindahl-Hirschman Index, HHI)를 메타특징에 포함하였으며, 역ReLU 실루엣 점수(Reverse ReLU Silhouette Score)도 새롭게 제안하였다. UCI Machine Learning Repository에서 제공하는 복수의 벤치마크 데이터셋으로 다양한 변환 데이터셋을 생성한 후에 대표적인 여러 판별 알고리즘에 적용하여 성능 비교 및 가설 검증을 수행하였다. 그 결과 대부분의 메타특징과 판별 성능 사이의 유의한 관련성이 확인되었으며, 일부 예외적인 부분에 대한 고찰을 하였다. 본 연구의 실험 결과는 향후 메타특징에 따른 분류알고리즘 추천 시스템에 활용할 것이다.

정부지원 공연예술행사 평가의 후광효과: 지역대표공연예술제 성과관리 체계를 중심으로 (Halo Effect in Evaluating Government Funded Art Programs: The Case of Local Representative Performing Art Festivals)

  • 조문석;오재록
    • 융합정보논문지
    • /
    • 제9권8호
    • /
    • pp.123-133
    • /
    • 2019
  • 이 연구의 목적은 문화예술행사 평가 과정에서 제기되는 평가 오류의 문제 중 하나인 후광효과를 실증적으로 분석하여 문제점을 진단하고 개선 방향을 제시하는 것이다. 이 연구는 2014년과 2015년 진행된 107개 지역대표공연예술제 평가 결과를 대상으로 3개 평가 영역, 15개 평가지표의 평가 결과에 대한 상관관계분석, 요인분석, 회귀분석을 통해 후광효과를 진단하였다. 분석 결과 평가지표 간의 상관계수의 평균은 2014년 0.676, 2015년 0.584로 나타났으며, 요인구조와 평가 영역은 일치하지 않았다. 회귀분석 결과 타 영역의 평가점수와 표준편차는 기획, 집행, 결과영역의 평가 결과에 영향을 미치는 것으로 나타났다. 이러한 평가결과의 왜곡은 평가의 신뢰성과 수용성을 낮추므로 합리적이고 객관적 평가를 위해 평가기준의 정교화, 평가지표별 평가자 다양화, 평가자 대상 사전교육, 메타평가의 실행을 통해 후광효과를 통제할 필요성을 제기한다.

Post-diagnosis Soy Food Intake and Breast Cancer Survival: A Meta-analysis of Cohort Studies

  • Chi, Feng;Wu, Rong;Zeng, Yue-Can;Xing, Rui;Liu, Yang;Xu, Zhao-Guo
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제14권4호
    • /
    • pp.2407-2412
    • /
    • 2013
  • Background and Objectives: Data on associations between soy food intake after cancer diagnosis with breast cancer survival are conflicting, so we conducted this meta-analysis for more accurate evaluation. Methods: Comprehensive searches were conducted to find cohort studies of the relationship between soy food intake after cancer diagnosis and breast cancer survival. Data were analyzed with comprehensive meta-analysis software. Results: Five cohort studies (11,206 patients) were included. Pooling all comparisons, soy food intake after diagnosis was associated with reduced mortality (HR 0.85, 95%CI 0.77 0.93) and recurrence (HR 0.79, 95%CI 0.72 0.87). Pooling the comparisons of highest vs. lowest dose, soy food intake after diagnosis was again associated with reduced mortality (HR 0.84, 95%CI 0.71 0.99) and recurrence (HR 0.74, 95%CI 0.64 0.85). Subgroup analysis of ER status showed that soy food intake was associated with reduced mortality in both ER negative (highest vs. lowest: HR 0.75, 95%CI 0.64 0.88) and ER positive patients (highest vs. lowest: HR 0.72, 95%CI 0.61 0.84), and both premenopausal (highest vs. lowest: HR 0.78, 95%CI 0.69 0.88) and postmenopausal patients (highest vs. lowest: HR 0.81, 95%CI 0.73 0.91). In additioin, soy food intake was associated with reduced recurrence in ER negative (highest vs. lowest: HR 0.64, 95%CI 0.44 0.94) and ER+/PR+ (highest vs. lowest: HR 0.65, 95%CI 0.49 0.86), and postmenopausal patients (highest vs. lowest: HR 0.67, 95%CI 0.56 0.80). Conclusion: Our meta-analysis showed that soy food intake might be associated with better survival, especially for ER negative, ER+/PR+, and postmenopausal patients.

Ki-67/MIB-1 as a Prognostic Marker in Cervical Cancer - a Systematic Review with Meta-Analysis

  • Piri, Reza;Ghaffari, Alireza;Gholami, Nasrin;Azami-Aghdash, Saber;PourAli-Akbar, Yasmin;Saleh, Parviz;Naghavi-Behzad, Mohammad
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제16권16호
    • /
    • pp.6997-7002
    • /
    • 2015
  • Background: In cervical cancer patients it has been reported that there in a significant Ki-67/MIB-1 expression is correlated with survival in cervical cancer patients. However, the prognostic value is still not well understood. Materials and Methods: In the present meta-analysis the prognostic value of Ki-67/MIB-1 with regard to overall survival (OS) and disease-free survival (DFS) in cervical cancer was investigated. The databases of PubMed, ISI Web of Science, Cochrane Central Register of Controlled Trials, EMBASE, Science Direct and Wiley Online Library were used to identify appropriate literature. Results: In order to explore the relationship between Ki-67/MIB-1 and cervical cancer, we have included 13 studies covering 894 patients in the current meta-analysis. The effect of Ki-67/MIB-1 on OS for pooled random effects HR estimate was 1.63 (95%confidence interval (CI) 1.09-2.45; P<0.05). The pooled HR for DFS was 1.26 (95%CI 0.58-2.73; P>0.05) and the subgroup analysis indicated Ki-67/MIB1 was associated with DFS (HR=3.67, 95%CI 2.65-5.09) in Asians. Conclusions: According to this meta-analysis, Ki-67/MIB-1 has prognostic value for OS in patients suffering from cervical cancer. For better evaluation of the prognostic role of Ki-67/MIB-1 on DFS, studies with larger numbers of patients are needed to validate present findings in the future.

혈중 납과 혈압의 연관성에 관한 메타분석 (A Meta-analysis of the Association between Blood Lead and Blood Pressure)

  • 고상백;남정모;최홍열;차봉석;박종구;지호성;김춘배
    • Journal of Preventive Medicine and Public Health
    • /
    • 제34권3호
    • /
    • pp.262-268
    • /
    • 2001
  • Objectives : To integrate the results of studies which assess an association between blood lead and blood pressure. Methods : We surveyed the existing literature using a MEDLINE search with blood lead and blood pressure as key words, including reports published from January 1980 to December 2000. The criteria for quality evaluation were as follows: 1) the study subjects must have been workers exposed to lead, and 2) both blood pressure and blood lead must have been measured and presented with sufficient details so as to estimate or calculate the size of the association as a continuous variable. Among the 129 articles retrieved, 13 studies were selected for quantitative meta-analysis. Before the integration of each regression coefficient for the association between blood pressure and blood lead, a homogeneity test was conducted. Results : As the homogeneity of studies was rejected in a fixed effect model, we used the results in a random effect model. Our quantitative meta-analysis yielded weighted regression coefficients of blood lead associated with systolic blood pressure and diastolic blood pressure results of 0.0047 (95% confidence interval [CI]: -0.0061, 0.0155) and 0.0004 (95% CI: -0.0031, 0.0039), respectively. Conclusions : The published evidence suggested that there may be a weak positive association between blood lead and blood pressure, but the association is not significant.

  • PDF

Whole Brain Radiotherapy Plus Chemotherapy in the Treatment of Brain Metastases from Lung Cancer: A Meta-analysis of 19 Randomized Controlled Trails

  • Liu, Wen-Jing;Zeng, Xian-Tao;Qin, Hai-Feng;Gao, Hong-Jun;Bi, Wei-Jing;Liu, Xiao-Qing
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제13권7호
    • /
    • pp.3253-3258
    • /
    • 2012
  • Objective: To evaluate the efficacy and safety of whole brain radiotherapy (WBRT) plus chemotherapy versus WBRT alone for treating brain metastases (BM) from lung cancer by performing a meta-analysis based on randomized controlled trials (RCTs). Methods: The PubMed, Embase, CENTRAL, ASCO, ESMO, CBM, CNKI, and VIP databases were searched for relevant RCTs performed between January 2000 and March 2012. After quality assessment and data extraction, the meta-analysis was performed using the RevMan 5.1 software, with funnel plot evaluation of publication bias. Results: 19 RCTs involving 1,343 patients were included. The meta-analyses demonstrated that compared to WBRT alone, WBRT plus chemotherapy was more effective with regard to the objective response rate (OR = 2.30, 95% CI = 1.79 - 2.98; P < 0.001); however, the incidences of gastrointestinal reactions (RR = 3.82, 95% CI = 2.33 - 6.28, P <0.001), bone marrow suppression (RR = 5.49, 95% CI = 3.65 - 8.25, P < 0.001), thrombocytopenia (RR = 5.83, 95% CI = 0.39 - 86.59; P = 0.20), leukopenia (RR = 3.13, 95% CI = 1.77 - 5.51; P < 0.001), and neutropenia (RR = 2.75, 95% CI = 1.61 - 4.68; P < 0.001) in patients treated with WBRT plus chemotherapy were higher than with WBRT alone. There was no obvious publication bias detected. Conclusion: WBRT plus chemotherapy can obviously improve total efficacy rate, butalso increases the incidence of adverse reactions compared to WBRT alone. From the limitations of this study, more large-scale, high-quality RCTs are suggested for further verification.

Meta-Analysis of Associations Between Classic Metric and Altmetric Indicators of Selected LIS Articles

  • Vysakh, C.;Babu, H. Rajendra
    • Journal of Information Science Theory and Practice
    • /
    • 제10권4호
    • /
    • pp.53-65
    • /
    • 2022
  • Altmetrics or alternative metrics gauge the digital attention received by scientific outputs from the web, which is treated as a supplement to traditional citation metrics. In this study, we performed a meta-analysis of correlations between classic citation metrics and altmetrics indicators of library and information science (LIS) articles. We followed the systematic review method to select the articles and Erasmus Rotterdam Institute of Management Guidelines for reporting the meta-analysis results. To select the articles, keyword searches were conducted on Google Scholar, Scopus, and ResearchGate during the last week of November 2021. Eleven articles were assessed, and eight were subjected to meta-analysis following the inclusion and exclusion criteria. The findings reported negative and positive associations between citations and altmetric indicators among the selected articles, with varying correlation coefficient values from -.189 to 0.93. The result of the meta-analysis reported a pooled correlation coefficient of 0.47 (95% confidence interval, 0.339 to 0.586) for the articles. Sub-group analysis based on the citation source revealed that articles indexed on the Web of Science showed a higher pooled correlation coefficient (0.41) than articles indexed in Google Scholar (0.30). The study concluded that the pooled correlation between citation metrics with altmetric indicators was positive, ranging from low to moderate. The result of the study gives more insights to the scientometrics community to propose and use altmetric indicators as a proxy for traditional citation indicators for quick research impact evaluation of LIS articles.

Effectiveness of Electroacupuncture for Patients with Failed Back Surgery Syndrome: A Systematic Review and Meta-analysis

  • Shin, Donghoon;Shin, Kyungmoon;Jeong, Hwejoon;Kang, Deok;Yang, Jaewoo;Oh, Jihoon;Lim, Jinwoong
    • Journal of Acupuncture Research
    • /
    • 제39권3호
    • /
    • pp.159-169
    • /
    • 2022
  • Failed back surgery syndrome (FBSS) is a term that applies to symptoms such as persistent or recurring low back pain, paresthesia, sciatica, or numbness after spine surgery. Electroacupuncture (EA) has been reported to have excellent analgesic effects although there have been no systematic reviews on the effects of EA on FBSS. Therefore, a systematic review and meta-analysis of the effectiveness of EA on FBSS was conducted. Eight databases were searched for studies that used EA for FBSS and 7 randomized controlled trials (RCTs) were included. RCTs of EA as combination therapy for FBSS compared with conventional treatment demonstrated improvement in the level of pain, lumbar functional scale scores, and quality of life. However, meta-analysis showed that reduction in pain was not statistically significant, while evaluation of lumbar function significantly improved, although the quality of evidence in the RCTs was generally low. RCTs comparing EA alone with conventional treatment demonstrated an improved level of pain, lumbar function, and effective rate of treatment. Meta-analysis showed that pain was significantly decreased in the EA alone group compared with the control group, although the quality of evidence was low. To improve the quality of evidence, high-quality RCTs are required in the future.