• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.7
• /
• pp.183-191
• /
• 2018

This paper evaluates the achievement of program outcomes using course-embedded assessment for information security programs. In the case study concerning the development of course-embedded assessment used in this paper, we evaluate program outcomes using various evaluation tools including the course evaluation data. In addition, we consider the evaluation rubric and evaluation procedure for course-embedded program outcomes, set performance criteria, select the probe course with high contribution to the program outcomes according to curriculum flowchart, set course objectives for the probe course, and explain the rubric for each assessment tool to measure achievement level. Subsequently, we perform course-embedded program outcomes assessment, based on tests and projectevaluation tool for each program objectives, and present the achievement levels based analysis results. These results prove the effectiveness of the proposed course-embedded assessment for program outcomes.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.11
• /
• pp.81-90
• /
• 2009

It is inevitable for college students to be confused when they first face university education, which requires them to be self-reliant and responsible, after finishing their course of education, which is passive under control of period and environment, in primary, middle, and high schools. Introduction to college courses, which require students to be subjective and responsible, to be taken after chronically and environmentally controlled primary and secondary education, are but confusing. In this stage, college education should provide ground for educational system so that students can escape from repetitively enforced way of studying of fixed curriculums and study creatively and subjectively while befitting each individual's aptitude. For instance, in programming classes in engineering school, students scholastic achievements are closely interrelated with the professor's educational principles. A change in method of education, from one previously focused on theoretical contents to one centered on practices and experiments, can reap good results. Also, as the need arose for introduction of practice-focused evaluation system, from recognition-centered professor evaluating system to enablement of actively developing creative and self-reliant way of learning, we applied the Rublic System. It is a feedback system that all or most students become the evaluators, of which the indicators of evaluation such as category, standard, and score are public. We have looked into whether or not there has been an improvement in GPAs of students, and if there exists an improvement then what efforts should be made to solidify the system.

• 한국정보교육학회:학술대회논문집
• /
• 2005.08a
• /
• pp.153-160
• /
• 2005

프로젝트 학습은 구성원간의 협동을 통해 문제를 해결해 나가는 학습형태로 학습자의 문제해결력을 높일 수 있는 방법이며, 프로젝트 학습에서의 평가는 교사의 조언과 지도를 통해 학생의 학습 능력을 향상시키는데 도움을 준다. 그러나, 협동학습에서는 일명 '무임승차'라는 문제점이 발생할 수 있어 오프라인 상태에서의 학습활동시 교사가 학생 개개인의 프로젝트 학습 능력을 측정 및 관리하기가 정확하게 이루어지기에 한계가 있다. 이에 본 연구에서는 웹상에서 이루어지는 프로젝트 학습시, 학습자에게 효과적으로 조언과 지도를 통하여 학습수행능력을 향상시킬 목적으로 개별 학습자의 프로젝트활동을 효과적으로 평가할 수 있는 평가시스템을 설계하고자 한다. 평가는 프로젝트 중 평가와 프로젝트 후 평가로 이루어지며, 단계별 평가 기준 관점은 Chard가 제시한 프로젝트 활동 평가 준거를 참고하여 정하였고, 루브릭 평가 방법을 도입하여 세 가지 단계로 제시하였다.

• Journal of The Korean Association For Science Education
• /
• v.42 no.4
• /
• pp.397-415
• /
• 2022

As the global warming problem becomes serious, the need for carbon cycle education in school is increasing. Adopting systems thinking ability is needed to understand the carbon cycle systematically. Furthermore, under the rapid change of environment, society, and economy, systems thinking ability is being emphasized as it can strengthen the competencies of students who will be leading the future society. The purposes of this study are as follows: first, is developing the systems thinking instrument for the carbon cycle and the rubric for analysis of systems thinking instrument. The second is analyzing the systems thinking ability of students using the developed instrument and rubric. In order to perform this study, previous studies related to the carbon cycle and systems thinking education were analyzed. Based on the analysis results, the systems thinking instrument for the carbon cycle and rubric were developed. The systems thinking ability was analyzed by implementing the developed instrument and rubric to 172 high school and university students. The results of this study are as follows: first, the systems thinking instrument for the carbon cycle was developed, and a rubric utilization guide was constructed. The instrument and rubric were modified through pilot study for middle school students producing expert opinion in relation to systems thinking and carbon cycle. Second, the systems thinking ability of students was analyzed. Consequently, students had systems thinking ability fully at a low level, such as identifying the variables related to the carbon cycle. However, it was shown that they lacked the systems thinking ability at a high level, such as time delay and feedback processes. The importance of the carbon cycle has been increasing since the global warming is the most pressing issue and significant environmental problem facing us today. Application of the systems thinking ability can contribute to understanding these complex problems and finding fundamental solutions.

• Journal of Korean Critical Care Nursing
• /
• v.5 no.2
• /
• pp.15-27
• /
• 2012

Purpose: To evaluate the applicability of Lasater Clinical Judgment Rubric (LCJR) as an evaluation tool for hypoglycemia simulation practicum on Korean nursing students. Methods: The methodological study was done to evaluate the reliability and validity of the LCJR. Based on Benner's 4 levels of nursing grading rubric, ten items of the LCJR was evaluated for interrater reliability and internal consistency. The content validity was tested by eight experts and concurrent validity was done by Clark (2006)'s clinical simulation grading rubric. Fifty five video-taped cases of senior nursing students in Y University were used for the reliability and concurrent validity of the LCJR. Results: The interrater reliability was r=.90 (p<.001); Kendall tau b=.87 (p <.001), and Cronbach's alpha was .90. A value of item content validity index of the LCJR was .97 and correlation coefficient between the LCJR and Clark's instrument was .90 (p<.001). The mean (${\pm}SD$) of the nursing students' clinical judgment was 2.04 (${\pm}50$). Conclusion: The LCJR is a useful tool to examine the simulation performance evaluation for improving competency among nursing students. The results indicated that the LCJR may provide valuable information regarding clinical judgment of nursing students and thus, suggested to use to develop a simulation-based education program.

• Journal of Engineering Education Research
• /
• v.15 no.5
• /
• pp.108-118
• /
• 2012

The purpose of this study was to provide analytic rubrics for measuring teamwork(PO6), communication and presentation skills(PO7), and life-long learning(PO8) based on theoretical concepts of performance assessment and rubrics. Also, this study analyzed data about performance assessment and rubics from courses offered through college of engineering. Participants were 34 senior engineering students who took the course 'Technical writing and presentation'. In the second week of the course, students were given the pre-test instrument which was developed for measuring students' understanding of program outcomes for this study. After performing project activities using rubrics, students were encouraged to complete the post-test instrument and the reaction questionnaire during the ninth week. The data were analyzed by using SPSS 14.0 and Microsoft Excel. The research findings are as follows. First, to promote and evaluate program learning outcomes appropriately, performance assessment-based on rubircs should be implemented. Second, in the reaction questionnaire about the rubircs, students answered that using rubircs for performing the project was very useful for understanding the performance procedures and assessment criteria. Third, the mean of understanding of program outcomes of students in post-test was significantly increased than in the pre-test(p<.0001). From the findings, performance assessment and rubrics should be used as evaluation tools at course levels in terms of promoting program learning outcomes for engineering education.

• Korean Journal of Adult Nursing
• /
• v.26 no.6
• /
• pp.653-667
• /
• 2014

Purpose: This study was aimed to develop frequently-used clinical scenarios and scoring rubrics to assess core basic nursing skills in adult health nursing clinical practice for clinical evaluation based on program learning outcomes (PO). Methods: This study was a methodological research combining focus group interviews and questionnaires to select and construct scenarios. Data were collected from clinical practitioners, adult health nursing professors, and new nurses from November, 2013 to April, 2014. The developed scenarios and rubrics were applied to nursing students by way of showing an example. Results: The 12 frequently-used clinical scenarios were developed. The proportion of the evaluation rubrics were 30% for clinical instructors where as 70% for college instructors. In order for students to achieve the important learning outcomes from the courses for clinical practice, four program outcomes (POs) were selected as well as a rubric for each POs was developed. Students who had situation-based clinical practices showed higher levels of satisfaction on mastery of core basic nursing skills and communication skills. Conclusion: This findings of the study suggested the strategies for complementing pitfalls in clinical setting and achieving PO during students' clinical practicum.

• Korean Journal of Child Studies
• /
• v.26 no.2
• /
• pp.27-41
• /
• 2005

The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.4
• /
• pp.173-180
• /
• 2020

This is the report of a case study to describe the results of applying an evaluation tool for communication ability when performing core basic nursing skills in fundamental nursing practice education. The communication ability evaluation tool was constructed based on a literature review and expert advice. The tool was applied to test 94 students who were taking fundamental nursing practice courses from October to November 2019. As a result, five factors (self-introduction, eye contact, emotional support, information provision, and therapeutic touch) were derived as evaluable items of communication ability to be evaluated when performing core basic nursing skill, and were evaluated when performing core basic nursing skills to measure vital signs. The average communication ability was 3.96 out of 5 points. According to the rubric, 95.8% of all students attained 'medium' and reached their goal achievement level. The findings of this study are meaningful in providing an important basis for improving the performance outcome evaluation process and for constructing a systematic evaluation system in fundamental nursing practicum. Further studies to secure the validity and reliability of this communication ability evaluation tool and comparative studies with various evaluation tools are suggested.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.3
• /
• pp.1874-1883
• /
• 2015

The purpose of this study was to verify clinical reasoning of nursing students as well as clarify the relevance between clinical reasoning and academic achievement. 87 students broke into 30 groups of two or three. The students performed post operative care for adult patients in the simulation practicum course of their final semester. Data were collected by evaluating the video-recorded nursing practicum using the clinical reasoning rubric. Clinical reasoning of 61(70.1%) students was limited to the beginning level and that of 6(6.9%) students of the highest scoring was at the third level among the four levels of ability. There was no significant correlation between clinical reasoning and the final cumulative GPA, while there was low level of significant correlation between clinical reasoning and GPA of adult health nursing course or adult health nursing practicum course. Therefore, it is necessary to improve the nursing curriculum to enhance nursing students' clinical reasoning.