• Title/Summary/Keyword: Evaluation effectiveness

Search Result 3,199, Processing Time 0.031 seconds

Review of Economic Evaluation Studies for Drug Reimbursement Decision (의약품 보험급여 결정을 위한 경제성평가 연구의 평가)

  • Choi Sang-Eun;Sullivan Sean D.
    • Health Policy and Management
    • /
    • v.15 no.4
    • /
    • pp.1-25
    • /
    • 2005
  • Legislation on pharmaceutical reimbursement decision using economic evaluation results was made in Korea in fm, but has yet to be fully implemented. We evaluated the quality of Korean economic evaluation studies of pharmaceuticals to understand gaps between legislation and implementation. From this evaluation, we propose policy options that might strengthen the research Infrastructure In order to support such studies. We reviewed 23 published studies for drugs conducted between 1996 and 2004. Evaluation criteria included methodological characteristics, healthcare system characteristics, population characteristics, and applicability of results. Large variation in study quality was observed, particularly with study design, outcome data, treatment patterns and interpretation. Korean clinical data used was mostly from observational studies of 1-2 hospitals. Foreign data was extracted from clinical trials that did not Include Asian population and their selection criterion was not clarified. With respect to treatment patterns, medical records and hospital bills were used without adjustment regarding area, hospital type, and others. And next frequent situation relied on expert opinion from academic physicians in specialty practice. preference measures, when used, were not elicited from the Korean population. $78.3\%$ of studies did not clarify the funding source. If the Korean economic evaluation policy is to provide meaningful data for decision makers, the quality of cost-effectiveness studies will need to improve dramatically. This may involve access to or creation of better data, more diverse funding, unproved training of researchers and evaluators, and partnerships with technology manufacturers.

A Study on the Effectiveness of Information Retrieval (정보검색효율에 관한 연구)

  • Yoon Koo-ho
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.8
    • /
    • pp.73-101
    • /
    • 1981
  • Retrieval effectiveness is the principal criterion for measuring the performance of an information retrieval system. The effectiveness of a retrieval system depends primarily on the extent to which it can retrieve wanted documents without retrieving unwanted ones. So, ultimately, effectiveness is a function of the relevant and nonrelevant documents retrieved. Consequently, 'relevance' of information to the user's request has become one of the most fundamental concept encountered in the theory of information retrieval. Although there is at present no consensus as to how this notion should be defined, relevance has been widely used as a meaningful quantity and an adequate criterion for measures of the evaluation of retrieval effectiveness. The recall and precision among various parameters based on the 'two-by-two' table (or, contingency table) were major considerations in this paper, because it is assumed that recall and precision are sufficient for the measurement of effectiveness. Accordingly, different concepts of 'relevance' and 'pertinence' of documents to user requests and their proper usages were investigated even though the two terms have unfortunately been used rather loosely in the literature. In addition, a number of variables affecting the recall and precision values were discussed. Some conclusions derived from this study are as follows: Any notion of retrieval effectiveness is based on 'relevance' which itself is extremely difficult to define. Recall and precision are valuable concepts in the study of any information retrieval system. They are, however, not the only criteria by which a system may be judged. The recall-precision curve represents the average performance of any given system, and this may vary quite considerably in particular situations. Therefore, it is possible to some extent to vary the indexing policy, the indexing policy, the indexing language, or the search methodology to improve the performance of the system in terms of recall and precision. The 'inverse relationship' between average recall and precision could be accepted as the 'fundamental law of retrieval', and it should certainly be used as an aid to evaluation. Finally, there is a limit to the performance(in terms of effectiveness) achievable by an information retrieval system. That is : "Perfect retrieval is impossible."

  • PDF

Policy Evaluation of the Government Financial Transfers to Korean Fisheries : LISREL Approach (수산부문 정부재정지원정책의 정성 평가)

  • 박성쾌;김정봉
    • The Journal of Fisheries Business Administration
    • /
    • v.33 no.2
    • /
    • pp.1-29
    • /
    • 2002
  • The main objective of this research aims at analyzing efficiency of government financial transfers(GFTs) to the Korean fisheries sector, using the Linear Structural Relations model(i.e., LISERL model) and the field survey data. Most policies of GFTs tend to be implemented to protect industries with weak competitive advantages such as infant and/or primary industries. Specific policy instruments include income transfers, government loans with lower interest rates, taxes and the like. Fishing activities are made at a highly changeable natural environment of the ocean with a great amount of risk and uncertainty. Fishing households make their livelihood under the small-scale fisheries. Such fisheries and fishing households have also a relatively weak market power. Because of these fisheries characteristics most coastal states have adopted a variety of government support programs. However, despite such a huge government support, during the past several decades the world fishing communities have seen a tendency of continuous fishereis resource overexploitation. For this resason there have been hot debates over the government support policies for fisheries through OECD, FAO, WTO, and UNEP. In general, policy evaluations tend to be made on the basis of benefit-cost(B/C) analysis. However, the B/C analysis may produce results quite different from real ones primarily due to many unmeasurable effects. Thus, the authors composed simple questionaires and let fishermen, government officials and academic people answer the questions. The survery was made in several ways such as post-mail and personal/group interviews. In recent years, for analysis of policy performances and effectiveness, the LISREL model has often been used, which consists of structural and measurement eqquations. This model has a good advantage of transforming unobservable variables to observable ones so that it helps construct endogenous cause and effect relationships among relevant variables. The evaluation was done from the two aspects: policy results and policy effectiveness. The policy result evaluation showed that there is a need for improvement for policy problem perception and decision-making process, while the policy effect evaluation suggested that the policy goals were successfully achieved and social justice was improved from the perspective of the entire society as well. However, the research results showed that the GFT policies rendered little contrubtion to narrowing down the gap between GFT beneficiaries and non-beneficiaries incomes.

  • PDF

The Development and effectiveness of Learning Strategy Program for Junior College Students (전문대학생용 학습전략 프로그램 개발 및 효과)

  • Hwang Jae Gyu
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.1
    • /
    • pp.299-311
    • /
    • 2023
  • This study is to verify the development process and effectiveness of a learning strategy program for junior college students. The necessity and feasibility of learning strategy programs for junior college students were confirmed and reviewed through prior studies, and the program development process was divided into four stages: program planning, program development, program execution, and program evaluation, and integrated into program development management. In the first stage of program planning, the development direction, goals and objectives were set. In the second stage of program development, prior research analysis, content selection, program organization, and evaluation plan were conducted. In the third stage of execution, the program was executed, and in the fourth stage of evaluation, program evaluation was conducted to develop the program. In order to verify the effectiveness of the program, the test was conducted using the learning strategy diagnostic scale for junior college students to collect data, and the effectiveness was verified for the pre-, post-, and post-test scores.

A Study on the Development and Application of Performance Evaluation Model for Defense Standard Improvement Projects (국방규격 개선사업의 성과평가모형 개발 및 적용방안 연구)

  • Lee, Min Cheol;Kim, Young Hyun;Ahn, Young Jun;Kim, Jun Su
    • Journal of Korean Society for Quality Management
    • /
    • v.51 no.2
    • /
    • pp.185-202
    • /
    • 2023
  • Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

A Study on Cost-Effectiveness Evaluation and Optimal Design of ant dampers for Cable-Stayed Bridges (사장교에 장착된 MR 댐퍼의 비용효율성 평가 및 최적설계 연구)

  • Park, Won-Suk;Hahm, Dae-Gi;Koh, Hyun-Moo;Park, Kwan-Soon
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.10 no.6 s.52
    • /
    • pp.47-56
    • /
    • 2006
  • A method is presented for evaluating the economic efficiency of a semi-active magneto-rheological (MR) damper system for cable-stayed bridges under earthquake loadings. An optimal MR damper capacity maximizing the cost-effectiveness is estimated for various seismic characteristics of ground motion. The economic efficiency of MR damper system is addressed by introducing the life-cycle cost concept. To evaluate the expected damage cost, the probability of failure is estimated. The cost-effectiveness index is defined as the ratio of the sums of the expected damage costs and each device cost between a bridge structure with the MR damper system and a bridge structure with elastic bearings. In the evaluation of cost-effectiveness, the scale of damage cost is adopted as parametric variables. The results of the evaluation show that the MR damper system can be a cost-effective design alternative. The optical capacity of MR damper is increased as the seismic hazard becomes severe.

An Ex Ante Evaluation Method for Assessing a Government Enforced Security Measure (정부의 정보 보안 대책 법제화의 사전 효과성 분석 방법)

  • Shim, Woohyun
    • The Journal of Society for e-Business Studies
    • /
    • v.20 no.4
    • /
    • pp.241-256
    • /
    • 2015
  • In order to ensure that all firms are cyber-secure, many governments have started to enforce the implementation of various security measures on firms. Prior to the implementation, however, it is vague whether government enforced security measures will be effective for mitigating cyber-security risks. By applying a method for estimating the effectiveness of a mandatory seatbelt law in reducing fatalities from motor vehicle accidents, this study develops an ex ante evaluation method that can approximate the effectiveness of a government enforced security measure in reducing country-wide or industry-wide cyber-security risks. Using data obtained from the Korean Internet and Security Agency, this study then explores how to employ the developed method to assess the effectiveness of a specific security measure in mitigating cyber-security risks, if enforced by the government, and compares the effectiveness of various security measures. The comparison shows that compulsory security training has the highest effectiveness.

Descriptive literature review on the evaluation of the youth smoking prevention program effectiveness (청소년 흡연중재 교육프로그램의 효과평가에 관한 설명적 문헌고찰)

  • Park, Kyoung-Ok;Lee, Kyung-Won
    • The Journal of Korean Society for School & Community Health Education
    • /
    • v.6
    • /
    • pp.35-48
    • /
    • 2005
  • The age of the very first smoking is a significant indicator of life-long health status. Smoking prevention intervention was actively conducted based in middle and high schools with the support of the Korean Act for Health Promotion since 1998. These governmental supports became large and various smoking prevention programs were developed and conducted in diverse standards and perspectives. This study made a comprehensive descriptive literature review on smoking prevention educational programs for youth in Korea to identify the intervention quality and effectiveness of them for future smoking prevention program development. A total of 28 peer-reviewed journal articles published between May, 1995 and May 2005 (for the last 10 years) were finally included in this review process. The study participants should be adolescences in middle or high schools in Korea and the intervention types of the review studies should be smoking prevention or cessation educational programs. The outcomes of the reviewed studies were reanalyzed by the participants' characteristics, theory basement, evaluation design, intervention period, evaluation outcomes, and program effectiveness Most smoking intervention programs were not specified by sex and smoking status. Largely most intervention programs focused on male students although female students' smoking percent is increasing including both smokers and nonsmokers. Based on the school grades, the large percents of smoking intervention were conducted to the first grade of middle school and the first grade of high school. Almost 70% of the reviewed studies did not apply any health behavior change theories and the Transtheoretical model and social cognitive theory were utilized in 7 studies among the last reviewed 30%. The theory-based intervention studies had greater effectiveness than the non-theory based studies. More than 90% had quasi-experimental evaluation design and the effectiveness of the non-experimental designed study seemed over estimated than the quasi-experimental or experimental designed studies. More than 60% of the reviewed studies made their education for less than j days, over a short period and the evaluation factors were knowledge and attitude in general which can be obtained in short intervention period. Therefore, smoking intervention programs for youth in Korea need to be modified in terms of research design such as the intervention period, intervention-evaluation design, theory-based approach, and population-focused intervention specification.

  • PDF

A Study on Establishing the Performance Evaluation System of the Fish Stock Rebuilding Plans (수산자원회복계획의 성과평가 개선방향에 관한 연구)

  • Kim, Dae-Young;Lee, Jung-Sam;Kim, Do-Hoon
    • The Journal of Fisheries Business Administration
    • /
    • v.42 no.3
    • /
    • pp.15-29
    • /
    • 2011
  • The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.