• 제목/요약/키워드: assessment of program outcomes

Search Result 140, Processing Time 0.033 seconds

COVID-19 International Collaborative Research by the Health Insurance Review and Assessment Service Using Its Nationwide Real-world Data: Database, Outcomes, and Implications

  • Rho, Yeunsook;Cho, Do Yeon;Son, Yejin;Lee, Yu Jin;Kim, Ji Woo;Lee, Hye Jin;You, Seng Chan;Park, Rae Woong;Lee, Jin Yong
    • Journal of Preventive Medicine and Public Health
    • /
    • v.54 no.1
    • /
    • pp.8-16
    • /
    • 2021
  • This article aims to introduce the inception and operation of the COVID-19 International Collaborative Research Project, the world's first coronavirus disease 2019 (COVID-19) open data project for research, along with its dataset and research method, and to discuss relevant considerations for collaborative research using nationwide real-world data (RWD). COVID-19 has spread across the world since early 2020, becoming a serious global health threat to life, safety, and social and economic activities. However, insufficient RWD from patients was available to help clinicians efficiently diagnose and treat patients with COVID-19, or to provide necessary information to the government for policy-making. Countries that saw a rapid surge of infections had to focus on leveraging medical professionals to treat patients, and the circumstances made it even more difficult to promptly use COVID-19 RWD. Against this backdrop, the Health Insurance Review and Assessment Service (HIRA) of Korea decided to open its COVID-19 RWD collected through Korea's universal health insurance program, under the title of the COVID-19 International Collaborative Research Project. The dataset, consisting of 476 508 claim statements from 234 427 patients (7590 confirmed cases) and 18 691 318 claim statements of the same patients for the previous 3 years, was established and hosted on HIRA's in-house server. Researchers who applied to participate in the project uploaded analysis code on the platform prepared by HIRA, and HIRA conducted the analysis and provided outcome values. As of November 2020, analyses have been completed for 129 research projects, which have been published or are in the process of being published in prestigious journals.

Building Transparency on the Total System Performance Assessment of Radioactive Repository through the Development of the FEAS Program (FEAS 프로그램 개발을 통한 방사성폐기물 처분장 종합 성능 평가(TSPA) 투명성 증진에 관한 연구)

  • 서은진;황용수;강철형
    • Tunnel and Underground Space
    • /
    • v.13 no.4
    • /
    • pp.270-278
    • /
    • 2003
  • Transparency on the Total System Performance Assessment (TSPA) is the key issue to enhance the public acceptance for a permanent high level radioactive repository. Traditionally, the study on features, events and processes (FEPs) and associated scenarios has been regarded as the starting point to open the communicative discussion on TSPA such as what to evaluate, how to evaluate and how to translate outcomes into more friendly language that many stakeholders can easily understand and react with. However, in most cases, it has been limited to one way communication, because it is difficult for stakeholders outside the performance assessment field to assess the details on the story of the safety assessment, scenario and technical background of it. Fortunately, the advent of the internet era opens up the possibility of two way communication from the beginning of the performance assessment so that every stakeholder can exchange their keen opinions on the safety issues. To achieve it, KAERI develops the systematic approach from the FEPs to Assessment methods flow chart. All information is integrated into the web based program named FEAS (FEp to Assessment through Scenario development) under development in KAERI. In parallel, two independent systems are also under development the web based QA(Quality Assurance) system and the PA(Performance Assessment) input database. It is ideal to integrate the input data base with the QA system so that every data in the system can checked whenever necessary. Throughout the next phase R&D starting from the year 2003, these three systems will be consolidated into one unified system.

An Evaluation of Site-Based Environmental Education Programs (체험환경교육의 활성화를 위한 프로그램 평가 연구)

  • Park, Tae-Yoon;Noh, Kyung-Im;Choi, Don-Hyung;Park, Hyun-Ju;Lee, Eun-Ju
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.5 no.4
    • /
    • pp.39-50
    • /
    • 2002
  • The purpose of this study was to evaluate site-based environmental education(EE) programs. For the evaluation, an evaluation chart was developed. The chart was consisted of twenty evaluation items in the following six categories : 'goals & objectives', 'instructional planning', 'instruction', 'learning outcomes & evaluation', 'features of program', and 'program operation'. One hundred sixty five site-based EE programs, funded by the Korean Ministry of Environment in 2000, were evaluated. After the evaluation, the programs were also categorized and analyzed according to regions, organizations, and amount of funds. The results indicated that awareness, participation, and attitude were addressed in the purpose of the programs, while knowledge and skills were not. The diversity of activities and teaching strategies of the programs were insufficient. Cultural aspects, fairness, originality, and accuracy were also insufficiently addressed. Assessment and evaluation of such programs were needed to be considered to a larger degree. From the analysis of programs according to categories, Choongbuk province in the regional aspect and schools in the organizational aspect got higher scores than others. Overall, the more funding the program received, the higher score it got in evaluation. Some improvements and strategies for activating site-based EE were recommended based on the result of the evaluation.

Research on the Location Decision of Korea Land Spatialization Program's Test-bed (지능형국토정보기술 테스트베드 입지선정에 관한 연구)

  • Song, Ki-Sung;Park, Ji-Man;Lee, Jung-Hun;Kim, Byung-Guk
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.4
    • /
    • pp.1-8
    • /
    • 2009
  • The Korean Government recognized that the importance of spatial information market is promoting Korean Land Spatialization Program(KLSP) to commercialize and practice of the technology. For achieve this purpose, KLSP is planning to build test-bed for field test, integration, display of outcomes. The most important problem in this process is reasonable decision of location. In this paper, the subject is to find how to decide efficiently in locating facilities to test Geospatial information technology like KLSP Test-bed. Consequently, we look over some cases of the inside and outside of the country, and analyze property of outcomes to apply the test-bed. And then we find assessment items for locating.

  • PDF

Analysis of Educational Reality and Expectations Regarding Competencies Defined in "The Role of Korean Doctor, 2014" ("한국의 의사상, 2014"의 역량 규정에 대한 의과대학의 교육현실과 기대수준 분석)

  • Yang, Eunbae B.;Shin, Hyekyung;Suh, Dukjoon;Han, Jae Jin
    • Korean Medical Education Review
    • /
    • v.20 no.3
    • /
    • pp.164-172
    • /
    • 2018
  • The aim of this study is to determine whether the 65 competencies, defined in "the role of Korean doctor, 2014", are suitable for basic medical education phase in Korea. It seeks to analyze the gap among the educational reality and expectation, assessment situation of the competencies above. We also try to define issues of the development, application and assessment phases of competency-based medical education (CBME) at individual medical schools. We designed survey tools based on the Miller's assessment pyramid (knowledge, explanation, demonstration, and performance) for each of the 65 competencies. The survey distributed to 41 medical schools in April 2015 and 38 replies were received (92.7%). Competencies that matched both the educational reality and expectation were numbers 1 (patient care), 33 (social accountability), and 49 (professionalism). However, all the other competencies ranked lower in current status than that of desirable level. 54 out of 65 competencies (83.07%) remained at the knowledge and explanation level when each competence were assessed. In the development, application, and assessment phases of CBME, common issues that medical schools commonly noted were difficulty linking competencies to curriculum preparation and student assessment, the lack of faculty's understanding, difficulty to reach consensus among faculties, and absence of teaching and learning methods and assessment tools that fits CBME. For the successful settle down of CBME, there is a need for efforts to develop the model of graduate outcomes, to share information and experience, and to operate faculty development program by the medical education communities.

Validation of the ACS NSQIP Surgical Risk Calculator for Patients with Early Gastric Cancer Treated with Laparoscopic Gastrectomy

  • Alzahrani, Saleh M;Ko, Chang Seok;Yoo, Moon-Won
    • Journal of Gastric Cancer
    • /
    • v.20 no.3
    • /
    • pp.267-276
    • /
    • 2020
  • Purpose: The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) risk calculator is useful in predicting postoperative adverse events. However, its accuracy in specific disorders is unclear. We validated the ACS NSQIP risk calculator in patients with gastric cancer undergoing curative laparoscopic surgery. Materials and Methods: We included 207 consecutive early gastric cancer patients who underwent laparoscopic gastrectomy between January 2018 and January 2019. The preoperative characteristics and risks of the patients were reviewed and entered into the ACS NSQIP calculator. The estimated risks of postoperative outcomes were compared with the observed outcomes using C-statistics and Brier scores. Results: Most of the patients underwent distal gastrectomy with Roux-en-Y reconstruction (74.4%). We did not observe any cases of mortality, venous thromboembolism, urinary tract infection, renal failure, or cardiac complications. The other outcomes assessed were complications such as pneumonia, surgical site infections, any complications requiring re-operation or hospital readmission, the rates of discharge to nursing homes/rehabilitation centers, and the length of stay. All C-statistics were <0 and the highest was for pneumonia (0.65; 95% confidence interval: 0.58-0.71). Brier scores ranged from 0.01 for pneumonia to 0.155 for other complications. Overall, the risk calculator was inconsistent in predicting the outcomes. Conclusions: The ACS NSQIP surgical risk calculator showed low predictive ability for postoperative adverse events after laparoscopic gastrectomy for patients with early gastric cancer. Further research to adjust the risk calculator for these patients may improve its predictive ability.

Effects of a School-based Intervention Program on Attitude and Knowledge of Household Members Towards a Smoke-free Home: a Cluster Controlled Trial

  • Intarut, Nirun;Chongsuvivatwong, Virasakdi;McNeil, Edward
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.3
    • /
    • pp.1235-1242
    • /
    • 2016
  • Background: A school-based smoke free home (SFH) program is useful in empowering the mother and child to reduce secondhand smoke exposure but the effects of pretesting on knowledge and attitude has been largely ignored. We aimed to test whether such a program can be effective in Southern Thailand with an additional assessment of the net effect of the pretest. Materials and Methods: A Solomon four-group design was used. Twelve rural primary schools were assigned to one of the four conditions (each with 3 schools): intervention with and without a pretest, control with and without the same pretest. The intervention was performed in the classroom and home over a period of 1 month. Outcomes were assessed at baseline and 3 months after the intervention on whether the home was smoke free and related knowledge and attitude. Results: The intervention could lead to a smoke-free home without statistical significance. Attitude, knowledge and self-confidence on creating a smoke-free home, and self-confidence in avoidance of secondhand smoke exposure and persuading smokers to not smoke in their home were significantly improved. No pretest effect was observed. Conclusions: Gain in attitude, knowledge and self-confidence among family members from the brief school-based education should be enhanced by other measures.

The Effect of the Dr. LEE Jong-wook-Seoul Project on Medical Student Academic Performance in Laos

  • Kim, Jungho;Kim, Taejong;Shin, Jwa-Seop
    • Korean Medical Education Review
    • /
    • v.21 no.1
    • /
    • pp.31-40
    • /
    • 2019
  • The Dr. LEE Jong-wook-Seoul Project (DLSP) in the Lao People's Democratic Republic (PDR) is a long-term development cooperation initiative aimed at upgrading the medical education capacity at the University of Health Sciences (UHS) in the Lao PDR. Under the project, eight faculty members from UHS were trained at the Seoul National University College of Medicine for a 12-month period during 2010-2011. Using a training-of-trainers model, we estimated the effect of DLSP on the learning outcomes of students, which was measured using the standard test scores of the students. The questionnaire developed by the Medical Education Assessment Consortium in Korea was given to the students and both the percent-correct and standardized scores were examined. The evaluation strategy was to compare the learning outcomes of the students taught by the trainees with those that were not and to compare the medical topics taught by the trainees with other topics. It was found that the first group of trainees in the DLSP was associated with an increase of 1.5 in the percent-correct test scores for basic medicine. While the interpretation requires caution, it is consistent with the view that a training program for faculty members could be effective in improving the teaching capacity of medical schools in developing countries.

The Effect of Korean Prospective Drug Utilization Review Program on the Prescription Rate of Drug-Drug Interactions (의약품 처방·조제지원서비스(Drug Utilization Review)사업이 병용금기 처방률에 미치는 영향)

  • Kim, Dong-Sook;Park, Juhee;Jeon, Ha-Rim;Park, Chanmi;Kang, Hyeun Ah
    • Health Policy and Management
    • /
    • v.24 no.2
    • /
    • pp.120-127
    • /
    • 2014
  • Background: Since December 2010, online computerized prospective drug utilization review (pDUR) has been implemented in Korea. pDUR involves the review of each prescription before the medication is dispensed to the individual patient. The pDUR is performed electronically by Health Insurance Review & Assessment Service (HIRA), which is a Korean governmental agency, and then HIRA provides medical institutions and pharmacies with information that can be helpful to them in preventing potential drug problems such as drug/drug interactions or ingredient duplication. The aim of this study was to assess the impact of the Korean pDUR implementation on the proportion of drug-drug interactions (DDIs) using claims data from HIRA. Methods: A before-after comparison of the prevalence of DDIs between prescription was conducted, using HIRA administrative claims data of medical institution from January 2010 to December 2011. The analysis unit was the prescription issued and pairs before and after. The main outcome measures were the proportion of DDIs within- (control group) or between- physician encounters. To examine the difference, a paired t-test was applied. Results: We found that DDIs proportion between prescription decreased significantly (t=3.04, p=0.0026) after the implementation of pDUR, whereas there is no significant reduction within prescription (t=1.15, p=0.2518). With respect to the prevalence of DDIs between drug groups, the most dramatic reduction was occurred between 3-hydroxy-3-methylglutaryl coenzyme A reductase inhibitors and anti-fungal agents. Conclusion: It seems effective that giving a direct feedback to prescribers by a prospective DUR. Further research is needed to assess the impact of DUR to final outcomes such as hospitalization.

A Study on the Development of Hybrid-typed Education Model for PO6 and PO7 Estimation (복합학제적 능력 및 의사소통 능력과 관련된 학습성과 평가를 위한 융합교육형 모델 개발에 관한 연구)

  • Kim, Eun-Joo;Cho, Young-Im;Do, Seung-Lee
    • Journal of Engineering Education Research
    • /
    • v.13 no.6
    • /
    • pp.132-142
    • /
    • 2010
  • The purpose of this study is to suggest the assessment method for PO6(teamwork) and PO7(communication skill), one of the most important assessment items in engineering accreditation. In this paper, we used the assessment criteria of Rubric, to empirically measure the teamwork and communication skill. Teamwork and communication skill (PO6, PO7) are the most critical social competences in modern society. Numerous studies on education showed that teamwork and communication skill can be enhanced through learning. We, therefore, need to investigate teamwork and communication skill in terms of education. However, research on the assessment method of the engineering accreditation, based on educational view is scarce. In this study, we suggest the assessment criteria of Rubric for PO6 and PO7 with the perspective of the education. We also tried to apply the developed criteria to the related subjects.

  • PDF