• 제목/요약/키워드: Evaluation effectiveness

검색결과 3,212건 처리시간 0.031초

의약품 보험급여 결정을 위한 경제성평가 연구의 평가 (Review of Economic Evaluation Studies for Drug Reimbursement Decision)

  • 최상은
    • 보건행정학회지
    • /
    • 제15권4호
    • /
    • pp.1-25
    • /
    • 2005
  • Legislation on pharmaceutical reimbursement decision using economic evaluation results was made in Korea in fm, but has yet to be fully implemented. We evaluated the quality of Korean economic evaluation studies of pharmaceuticals to understand gaps between legislation and implementation. From this evaluation, we propose policy options that might strengthen the research Infrastructure In order to support such studies. We reviewed 23 published studies for drugs conducted between 1996 and 2004. Evaluation criteria included methodological characteristics, healthcare system characteristics, population characteristics, and applicability of results. Large variation in study quality was observed, particularly with study design, outcome data, treatment patterns and interpretation. Korean clinical data used was mostly from observational studies of 1-2 hospitals. Foreign data was extracted from clinical trials that did not Include Asian population and their selection criterion was not clarified. With respect to treatment patterns, medical records and hospital bills were used without adjustment regarding area, hospital type, and others. And next frequent situation relied on expert opinion from academic physicians in specialty practice. preference measures, when used, were not elicited from the Korean population. $78.3\%$ of studies did not clarify the funding source. If the Korean economic evaluation policy is to provide meaningful data for decision makers, the quality of cost-effectiveness studies will need to improve dramatically. This may involve access to or creation of better data, more diverse funding, unproved training of researchers and evaluators, and partnerships with technology manufacturers.

정보검색효율에 관한 연구 (A Study on the Effectiveness of Information Retrieval)

  • 윤구호
    • 한국문헌정보학회지
    • /
    • 제8권
    • /
    • pp.73-101
    • /
    • 1981
  • Retrieval effectiveness is the principal criterion for measuring the performance of an information retrieval system. The effectiveness of a retrieval system depends primarily on the extent to which it can retrieve wanted documents without retrieving unwanted ones. So, ultimately, effectiveness is a function of the relevant and nonrelevant documents retrieved. Consequently, 'relevance' of information to the user's request has become one of the most fundamental concept encountered in the theory of information retrieval. Although there is at present no consensus as to how this notion should be defined, relevance has been widely used as a meaningful quantity and an adequate criterion for measures of the evaluation of retrieval effectiveness. The recall and precision among various parameters based on the 'two-by-two' table (or, contingency table) were major considerations in this paper, because it is assumed that recall and precision are sufficient for the measurement of effectiveness. Accordingly, different concepts of 'relevance' and 'pertinence' of documents to user requests and their proper usages were investigated even though the two terms have unfortunately been used rather loosely in the literature. In addition, a number of variables affecting the recall and precision values were discussed. Some conclusions derived from this study are as follows: Any notion of retrieval effectiveness is based on 'relevance' which itself is extremely difficult to define. Recall and precision are valuable concepts in the study of any information retrieval system. They are, however, not the only criteria by which a system may be judged. The recall-precision curve represents the average performance of any given system, and this may vary quite considerably in particular situations. Therefore, it is possible to some extent to vary the indexing policy, the indexing policy, the indexing language, or the search methodology to improve the performance of the system in terms of recall and precision. The 'inverse relationship' between average recall and precision could be accepted as the 'fundamental law of retrieval', and it should certainly be used as an aid to evaluation. Finally, there is a limit to the performance(in terms of effectiveness) achievable by an information retrieval system. That is : "Perfect retrieval is impossible."

  • PDF

수산부문 정부재정지원정책의 정성 평가 (Policy Evaluation of the Government Financial Transfers to Korean Fisheries : LISREL Approach)

  • 박성쾌;김정봉
    • 수산경영론집
    • /
    • 제33권2호
    • /
    • pp.1-29
    • /
    • 2002
  • The main objective of this research aims at analyzing efficiency of government financial transfers(GFTs) to the Korean fisheries sector, using the Linear Structural Relations model(i.e., LISERL model) and the field survey data. Most policies of GFTs tend to be implemented to protect industries with weak competitive advantages such as infant and/or primary industries. Specific policy instruments include income transfers, government loans with lower interest rates, taxes and the like. Fishing activities are made at a highly changeable natural environment of the ocean with a great amount of risk and uncertainty. Fishing households make their livelihood under the small-scale fisheries. Such fisheries and fishing households have also a relatively weak market power. Because of these fisheries characteristics most coastal states have adopted a variety of government support programs. However, despite such a huge government support, during the past several decades the world fishing communities have seen a tendency of continuous fishereis resource overexploitation. For this resason there have been hot debates over the government support policies for fisheries through OECD, FAO, WTO, and UNEP. In general, policy evaluations tend to be made on the basis of benefit-cost(B/C) analysis. However, the B/C analysis may produce results quite different from real ones primarily due to many unmeasurable effects. Thus, the authors composed simple questionaires and let fishermen, government officials and academic people answer the questions. The survery was made in several ways such as post-mail and personal/group interviews. In recent years, for analysis of policy performances and effectiveness, the LISREL model has often been used, which consists of structural and measurement eqquations. This model has a good advantage of transforming unobservable variables to observable ones so that it helps construct endogenous cause and effect relationships among relevant variables. The evaluation was done from the two aspects: policy results and policy effectiveness. The policy result evaluation showed that there is a need for improvement for policy problem perception and decision-making process, while the policy effect evaluation suggested that the policy goals were successfully achieved and social justice was improved from the perspective of the entire society as well. However, the research results showed that the GFT policies rendered little contrubtion to narrowing down the gap between GFT beneficiaries and non-beneficiaries incomes.

  • PDF

전문대학생용 학습전략 프로그램 개발 및 효과 (The Development and effectiveness of Learning Strategy Program for Junior College Students)

  • 황재규
    • 문화기술의 융합
    • /
    • 제9권1호
    • /
    • pp.299-311
    • /
    • 2023
  • 본 연구는 전문대학생들을 위한 학습전략 프로그램의 개발과정과 그 효과성을 검증하기 위한 것이다. 전문대학생들을 위한 학습전략 프로그램의 필요성과 타당성은 선행연구를 통해 확인하고 검토되었으며, 프로그램 개발과정을 프로그램 계획, 프로그램 개발, 프로그램 실행, 프로그램 평가의 4단계로 구분하여 프로그램 개발 관리로 통합하었다. 1단계 프로그램 계획단계에서는 개발방향 설정, 목적과 목표를 설정하였다. 2단계 프로그램 개발 단계에서는 선행연구 분석, 내용 선정, 프로그램 조직, 평가계획을 하였다. 3단계 실행단계에서는 프로그램을 실행하였고, 4단계 평가단계에서는 프로그램 평가를 실시하여 프로그램을 개발하였다. 프로그램의 효과를 검증하기 위하여 전문대학생용 학습전략 진단 척도로 검사를 실시하여 자료를 수집하였고, 사전·사후·추후검사 점수에 대하여 효과 검증을 실시하였다.

국방규격 개선사업의 성과평가모형 개발 및 적용방안 연구 (A Study on the Development and Application of Performance Evaluation Model for Defense Standard Improvement Projects)

  • 이민철;김영현;안영준;김준수
    • 품질경영학회지
    • /
    • 제51권2호
    • /
    • pp.185-202
    • /
    • 2023
  • Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

사장교에 장착된 MR 댐퍼의 비용효율성 평가 및 최적설계 연구 (A Study on Cost-Effectiveness Evaluation and Optimal Design of ant dampers for Cable-Stayed Bridges)

  • 박원석;함대기;고현무;박관순
    • 한국지진공학회논문집
    • /
    • 제10권6호
    • /
    • pp.47-56
    • /
    • 2006
  • 지진응답 제어를 위하여 사장교 구조물에 장착된 준능동MR 댐퍼의 경제적 효율성 평가기법을 제안하였으며, 다양한 지반운동 특성에 대하여 비용효율성을 극대화하는 MR 댐퍼의 최적용량에 대한 분석을 수행하였다. MR 댐퍼의 비용효율성 평가를 위하여 생애주기비용 개념을 적용하였으며, 생애주기비용을 이루는 비용항목 중 손상비용의 기대값을 평가하기 위하여 지진재해로 인한 사장교의 파괴확률을 추정하였다. 사장교의 파괴로 인한 직 간접 손상비용의 규모를 매개변수로 하여 비용효율성을 평가하였다. 비용효율성 평가지수는 MR 댐퍼의 장착으로 인한 추가 투자비용과 사장교 구조물의 손상비용으로 이루어진 함수로서, 탄성받침이 사용된 기존의 설계에 대한 경제적 효율성을 나타내도록 정의하였다. 사장교의 지진응답 제어를 위하여 장착된 MR 댐퍼는 경제적으로 효율적인 대안인 것으로 나타났다. 지반운동의 특성과 손상비용 규모에 대한 MR 댐퍼의 최적 용량을 분석한 결과, 지진위험도 및 손상비용 규모가 커짐에 따라 가장 높은 비용효율성을 가지는 MR 댐퍼용량이 증가하는 것을 확인할 수 있었다.

정부의 정보 보안 대책 법제화의 사전 효과성 분석 방법 (An Ex Ante Evaluation Method for Assessing a Government Enforced Security Measure)

  • 심우현
    • 한국전자거래학회지
    • /
    • 제20권4호
    • /
    • pp.241-256
    • /
    • 2015
  • 기업의 정보 보안을 보장하기 위해, 많은 정부가 다양한 보안 관련 대책을 의무화해오고 있다. 하지만 이러한 보안 대책의 실행에 앞서, 이의 잠재적 효과성을 분석하는 연구는 부족한 실정이다. 본 연구는 안전벨트의 착용 법제화가 자동차 사고 사망자 감소에 미치는 효과에 대한 연구를 응용하여, 정부의 다양한 보안 대책의 사전 효과성 평가가 가능한 모형을 개발하는 것을 목적으로 한다. 또한, 인터넷 진흥원의 정보보호실태조사(기업편) 데이터를 개발된 모형에 적용하여 어떠한 보안대책의 법제화가 사회 및 산업 전반의 보안위험을 줄이는데 효과적인지 사전평가를 시행하였다. 그 결과 보안교육의 법제화가 다른 보안대책에 비해 효과적임을 확인하였다.

청소년 흡연중재 교육프로그램의 효과평가에 관한 설명적 문헌고찰 (Descriptive literature review on the evaluation of the youth smoking prevention program effectiveness)

  • 박경옥;이경원
    • 한국학교ㆍ지역보건교육학회지
    • /
    • 제6권
    • /
    • pp.35-48
    • /
    • 2005
  • The age of the very first smoking is a significant indicator of life-long health status. Smoking prevention intervention was actively conducted based in middle and high schools with the support of the Korean Act for Health Promotion since 1998. These governmental supports became large and various smoking prevention programs were developed and conducted in diverse standards and perspectives. This study made a comprehensive descriptive literature review on smoking prevention educational programs for youth in Korea to identify the intervention quality and effectiveness of them for future smoking prevention program development. A total of 28 peer-reviewed journal articles published between May, 1995 and May 2005 (for the last 10 years) were finally included in this review process. The study participants should be adolescences in middle or high schools in Korea and the intervention types of the review studies should be smoking prevention or cessation educational programs. The outcomes of the reviewed studies were reanalyzed by the participants' characteristics, theory basement, evaluation design, intervention period, evaluation outcomes, and program effectiveness Most smoking intervention programs were not specified by sex and smoking status. Largely most intervention programs focused on male students although female students' smoking percent is increasing including both smokers and nonsmokers. Based on the school grades, the large percents of smoking intervention were conducted to the first grade of middle school and the first grade of high school. Almost 70% of the reviewed studies did not apply any health behavior change theories and the Transtheoretical model and social cognitive theory were utilized in 7 studies among the last reviewed 30%. The theory-based intervention studies had greater effectiveness than the non-theory based studies. More than 90% had quasi-experimental evaluation design and the effectiveness of the non-experimental designed study seemed over estimated than the quasi-experimental or experimental designed studies. More than 60% of the reviewed studies made their education for less than j days, over a short period and the evaluation factors were knowledge and attitude in general which can be obtained in short intervention period. Therefore, smoking intervention programs for youth in Korea need to be modified in terms of research design such as the intervention period, intervention-evaluation design, theory-based approach, and population-focused intervention specification.

  • PDF

수산자원회복계획의 성과평가 개선방향에 관한 연구 (A Study on Establishing the Performance Evaluation System of the Fish Stock Rebuilding Plans)

  • 김대영;이정삼;김도훈
    • 수산경영론집
    • /
    • 제42권3호
    • /
    • pp.15-29
    • /
    • 2011
  • The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.