• Journal of Engineering Education Research
• /
• v.13 no.4
• /
• pp.87-92
• /
• 2010

It is strongly desirable to continuously study the program outcomes that are one of the requirements of engineering accreditation. In this paper, the results of program outcome evaluation obtained by using four tools - exit written exams, essay tests, capstone design, and an official English test - were compared to those of program outcome evaluation obtained by a course-embedded assessment method. The former evaluation was carried out for 15 students who graduated in February 2010 by using the four evaluation tools, while the latter was performed by using a course offered in the Spring and Fall semesters in 2009. Two evaluation results revealed no large difference in almost all 12 program outcomes, which indicates that course-embedded assessment would be one of the practical and effective program outcome evaluation tools.

• Journal of Engineering Education Research
• /
• v.14 no.2
• /
• pp.13-20
• /
• 2011

This study aimed to seek the ways of improving program outcomes assessment systems for engineering education accreditation of South Korea through performing comparative analysis on those of the United States. Case-study research method was implemented to achieve the research goal. Five university programs, which have been well recognized as good practices in engineering education accreditation in the United States, were selected and analyzed. In addition, those of three universities in South Korea were chosen for comparative analysis, which were reformed by university affiliated Engineering Education Innovative Centers. The analysis results indicated that there were differences in each program's program outcomes, assessment level of program outcomes, evaluation methods on program outcomes achievement, and analysis and improvement records. It was drawn up that the evaluation methods on program outcomes achievement should be paid full attention. For better program outcomes assessment system, however, the followings are in more attention. Firstly, to establish program outcomes reflecting program goal. Secondly, to set up the detailed plans for analysis and quality improvement on program outcomes. Thirdly, to keep continuing efforts on curriculum update.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.7
• /
• pp.183-191
• /
• 2018

This paper evaluates the achievement of program outcomes using course-embedded assessment for information security programs. In the case study concerning the development of course-embedded assessment used in this paper, we evaluate program outcomes using various evaluation tools including the course evaluation data. In addition, we consider the evaluation rubric and evaluation procedure for course-embedded program outcomes, set performance criteria, select the probe course with high contribution to the program outcomes according to curriculum flowchart, set course objectives for the probe course, and explain the rubric for each assessment tool to measure achievement level. Subsequently, we perform course-embedded program outcomes assessment, based on tests and projectevaluation tool for each program objectives, and present the achievement levels based analysis results. These results prove the effectiveness of the proposed course-embedded assessment for program outcomes.

• Journal of Engineering Education Research
• /
• v.11 no.4
• /
• pp.46-57
• /
• 2008

The core of accreditation for engineering education is to improve the ability and quality of graduates through CQI system based on outcomes. For the program outcomes of the engineering education accreditation criterion, it is necessary to understand the relationship among education assessment, objective and curriculum. This study has focused on the program outcomes and the assessment. First the measure for improving the general problems of the program outcomes associated with assessment tool have been stated. And the detailed measure for practicing the program outcome, the assessment system and the assessment tool, which makes use of Rubrics, have been discussed. Therefore it is expected that the program outcome and the assessment may be conducted at universities with the assessment tool established in this study.

• Journal of Engineering Education Research
• /
• v.12 no.1
• /
• pp.57-63
• /
• 2009

This Paper presents a clearly explained and richly illustrated case study of assessment and evaluation for program outcomes in accreditation for engineering education, which describe what Program students are expected to be able to do by the time of graduation. In particular, the performance criteria based on performance level, assessment tools, and level-of-achievement rubrics for assessment of program outcomes in electrical engineering program of Kwangwoon university will be briefly addressed. Obviously, the assessment, evaluation, and improvement processes for the specified program outcomes should be continuously carried out to demonstrate that the program objectives and outcomes are being met.

• The Journal of Korean Institute for Practical Engineering Education
• /
• v.1 no.1
• /
• pp.25-29
• /
• 2009

Assessment of program achievement is an essential item to analyze and improve the engineering education program. Program achievements are the abilities to be obtained after finishing the 4 year engineering program, and the program achievements should be evaluated for the quality improvement of program. There are two important considerations to determine the assessment method. the first one is reliability and the second one is the feasibility. In this paper, we propose a assessment tools and introduce the assessment methods of program outcomes. The proposed method is designed to enhance the reliability and feasibility of assessment in engineering education.

• Journal of Engineering Education Research
• /
• v.10 no.2
• /
• pp.73-86
• /
• 2007

The purpose of this study is to suggest directions to improve engineering education and the assessment system of our country. For this object, the present situation of engineering education and assessment system in Korea have been reviewed and next, for those of study, the research papers and publications about the environment of college education are analyzed. Finally, an improved assessment system is suggested. It has already passed out for 6 years since execute the accreditation for engineering education in our country now, but essential point for step in accreditation for engineering education is how the evaluator can make the outcomes of studying. This is not a new terminology that is deformed according to special quality of college of engineering which prefer out-come based of study than process based of study to mean accomplishment in engineering education. The evaluation that estimate program is a skill, but an assessment method is not the meaning of individual student accomplishment also, it is the measure of validity estimation that should be estimate ability of students who complete program by proper authority. However, a new evaluation strategy that assess student outcome by person who consider the objectivity and validity, reliability should be develop for decision making of ABEEK. It is an original, private discussion for assessment strategy about the method for student learning outcomes assessment.

• The Journal of the Korea Contents Association
• /
• v.21 no.3
• /
• pp.410-418
• /
• 2021

In a program that runs an engineering education certification, program outcomes refer to the knowledge, skills, and attitudes a student must have until graduation. In general, capstone design is used as a tool for evaluating program outcomes. This paper applies the intraclass correlation coefficient (ICC) to measure the raters' reliability in assessing program outcomes. Several raters evaluate program outcomes, and the result is used to obtain the raters' ICC. ICC measures the reliability of ratings or measurements for clusters - data that has been collected as groups or sorted into groups. If the ICC is close to 1, it means that the reliability among the raters is high. We evaluated the proposed method's usefulness through case analysis. As a method for assessing an evaluation tool's objectivity, multiple raters measure the same evaluation tool. As a result, we measured the ICC values for all POs, and analyzed the cause for the low measured POs. We applied this method to evaluate program outcomes of the Department of Computer Engineering in the past two years. As a result, we derived guidelines for improvement and program outcomes.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.5
• /
• pp.3121-3130
• /
• 2015

The purpose of this study was to suggest application of Course Embedded Assessment (CEA) for program outcome in nursing education through literature & Office of Assessment web site reference review on concept, advantage, disadvantage, process, measure, tool and precaution. The process of CEA is program outcome, calculate weight of program outcome, embed program outcome in curriculum, development a rubric for CEA, assessment, analysis the result and achievement, feedback loop. CEA is vary useful to proof the student personal achievement and program quality improvement.

• Journal of Engineering Education Research
• /
• v.13 no.6
• /
• pp.143-151
• /
• 2010

This paper presents a case study on the assessment of program outcomes using the capstone design course based on 16-year management experience and improvements of the school of mechanical design and automation engineering in the seoul national university of science and technology. First, the program outcomes related with the capstone design course are introduced, and the assessment methods and items are described. Based on them, the assessment results in 2008 were obtained and a strategy to improve the results were built after analyzation. As for the strategy, we revealed the assessment items and good examples in an internet web site in advance. As a result, we were able to obtain about 3.3% improved assessment results in 2009. Finally, the validity, efficiency, internal stability, and sustainability of the assessment of the program outcomes using the capstone design course are addressed in terms of a notion of the course-embedded assessment.