• The Journal of the Convergence on Culture Technology
• /
• v.8 no.6
• /
• pp.553-560
• /
• 2022

The research of course-embedded learning evaluation method, which can be used to measure the competency of learners by evaluation of learning outcomes, has been performed for competency-based education in the university. In this paper, we propose an learning evaluation and adaptive feedback model based on learning outcomes, learning subjects, learning concepts graph, and an evaluation matrix. Firstly, we define the layered learning outcomes, a graph of learning subjects and concepts, and two association matric. Secondly, we define algorithms to calculate the level of learning achievement and the learning feedback to learners. We applied the proposed method to a specific course, "Java Programing", to validate the effectiveness of our method. The experimental results show that our proposed method can be useful to measure the learning achievement of learners and provide adaptive feedbacks to them.

• Korean Journal of Adult Nursing
• /
• v.26 no.6
• /
• pp.653-667
• /
• 2014

Purpose: This study was aimed to develop frequently-used clinical scenarios and scoring rubrics to assess core basic nursing skills in adult health nursing clinical practice for clinical evaluation based on program learning outcomes (PO). Methods: This study was a methodological research combining focus group interviews and questionnaires to select and construct scenarios. Data were collected from clinical practitioners, adult health nursing professors, and new nurses from November, 2013 to April, 2014. The developed scenarios and rubrics were applied to nursing students by way of showing an example. Results: The 12 frequently-used clinical scenarios were developed. The proportion of the evaluation rubrics were 30% for clinical instructors where as 70% for college instructors. In order for students to achieve the important learning outcomes from the courses for clinical practice, four program outcomes (POs) were selected as well as a rubric for each POs was developed. Students who had situation-based clinical practices showed higher levels of satisfaction on mastery of core basic nursing skills and communication skills. Conclusion: This findings of the study suggested the strategies for complementing pitfalls in clinical setting and achieving PO during students' clinical practicum.

• Safety and Health at Work
• /
• v.7 no.1
• /
• pp.83-85
• /
• 2016

Effective interventions to reduce work-related exposures are available for many types of work-related diseases or injuries. However, knowledge of the impact of these interventions on injury or disease outcomes is scarce due to practical and methodological reasons. Study designs are considered for the evaluation of occupational health interventions on occupational disease or injury. Latency and frequency of occurrence of the health outcomes are two important features when designing an evaluation study with occupational disease or occupational injury as an outcome measure. Controlled evaluation studies-giving strong indications for an intervention effect-seem more suitable for more frequently occurring injuries or diseases. Uncontrolled evaluation time or case series studies are an option for evaluating less frequently occurring injuries or diseases. Interrupted time series offer alternatives to experimental randomized controlled trials to give an insight into the effectiveness of preventive actions in the work setting to decision and policy makers.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.42-50
• /
• 2013

The main purpose of this study was to develop a program outcomes assessment tool using reflection journal. Reflection journal has recently come to gain more attention from school as an alternative assessment tool. Although numerous studies reconfirmed the educational importance and value of reflection journal as an assessment tool, research on the assessment tool of the engineering accreditation, based on education view is scarce. After literature reviews about the case studies on the program outcomes assessment, this study, to analyse the current assessment tools, and then, examined the educational implications of reflection journal as a program outcomes assessment tool. This study suggested the assessment tool using reflection journal for PO6 (teamwork) and PO11 (engineering ethics), one of the most important assessment items in engineering accreditation. In this study, we used the performance criteria, assessment criteria, rubric, and closed the loop to measure the teamwork and engineering ethics. The result of this study is significant in terms of guiding the future evaluation system development for program outcomes.

• Journal of Engineering Education Research
• /
• v.24 no.6
• /
• pp.30-39
• /
• 2021

The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

• East Asian Economic Review
• /
• v.27 no.1
• /
• pp.3-31
• /
• 2023

Dissemination of information can enhance smallholder farmers' agricultural outcomes and incomes in developing countries. However, the impact evaluation for new information can be inaccurate without considering pre-existing information that the indigenous people have used. This study explores qualitative causal links between existing agricultural information used by Lao smallholder farmers on rice yield and selling price with 180 household data. We categorized the pre-existing information into weather, farming technique, input, intermediate trader, and sales price. The source of each piece of information is used as an instrumental variable to overcome the endogeneity issue between information use and agricultural outcomes. Using farming technique information positively affects rice yields by 57.1% compared to those without that information. Moreover, intermediate trader and crop sales information result in 64.5% and 60.0% higher selling prices than non-user groups. A statistically significant causal relationship exists with agricultural outcomes. The more genuine impact should be measured with a newly updated impact evaluation approach that considers this pre-existing agricultural information.

• Journal of the Korean Society for information Management
• /
• v.35 no.3
• /
• pp.271-286
• /
• 2018

The purpose of this study is to measure the outcomes of a program provided by a public library using the evaluation framework based on Logic Model. A reading program for children which was operated by a public library in Seoul was selected. The outcome evaluation was started with the analysis of the reading program process including planning, operation, and evaluation. Based on the analysis, a logic model framework for outcome evaluation was developed. For evaluation, user, bibliography, and circulation data were collected from the library KOLAS system. Additionally, the participant information were extracted from the final report drafted after the program. The research results show that the number of circulation of program participants was increased after the program. In addition, the range of reading topic was expanded. These findings indicate that the reading program is an effective program for promoting children's reading habit and that outcome evaluation might be a valid tool to measure the effectiveness of public library programs.

• Journal of Korean Critical Care Nursing
• /
• v.4 no.2
• /
• pp.1-14
• /
• 2011

Purpose: This study was aimed to understand and describe the Korean critical care advanced practice nurses' work experience. Methods: Data was collected through 2 focus group interviews that were held in two different university hospitals in Seoul, Korea. All interviews were recorded and transcribed, and data were analysed using modified qualitative content analysis. Results: Ten themes were drawn from data analysis. They are "Various and complex tasks", "Excellency of advanced nursing practice", "Pressure and responsibility accompanied with pride", "Role identity confusion", "Role conflict", "Leaping and evolving role", "Gap between role and outcome evaluation", "Underestimated outcomes", "Where are my outcomes?" "Searching for outcomes: publicize the role". Conclusion: The results of this study help to understand the role of Korean critical care advanced practice nurses and to guide to outcome evaluation of their role effectiveness. Developing qualitative outcome indicators, cost-effectiveness ananlysis of Korean critical care advanced practice nurses' role, and accumulation of evidences through researches on outcome evaluation will be needed to successfully settle down advanced practice nursing in Korea.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2009.05b
• /
• pp.143-147
• /
• 2009

Graduates from engineering colleges are demanded to have been acquired some abilities and qualities during their undergraduate years through the standard of the so-called "programmed learning results and evaluation" This paper aims at analyzing the learning results evaluation tool for graduates from the architectural engineering department through the examples of the colleges with engineering accreditation in Korea, and suggesting a more appropriate programmed learning result evaluation tool. The basic theories on programmed learning results were studied, and then the previous study examples were researched. The study objects were limited to the fourteen colleges which offered the examples of the learning results evaluation tools of the colleges with engineering accreditation in Korea. Types and the present situation of those evaluation tools were analyzed. In addition, the proposals for the evaluation tool of programmed learning results and the performance standard were suggested for those with an engineering accreditation, based on the case study of the performance standards of each college with an engineering accreditation. The study results showed that much more national research needs to be conducted to clarify the standards of selecting an evaluation tool and a performance standard appropriate for the level of each college so that it can make a proper proposal.

• Communications for Statistical Applications and Methods
• /
• v.23 no.4
• /
• pp.343-353
• /
• 2016

In doubly-censored data, an originating event time and a terminating event time are interval-censored. In certain analyses of such data, a researcher might be interested in the elapsed time between the originating and terminating events as well as regression modeling with risk factors. Therefore, in this study, we introduce a model evaluation method to measure the predictive ability of a model based on negative predictive values. We use a semiparametric estimate of the predictive accuracy to provide a simple and flexible method for model evaluation of doubly-censored survival outcomes. Additionally, we used simulation studies and tested data from a prostate cancer trial to illustrate the practical advantages of our approach. We believe that this method could be widely used to build prediction models or nomograms.