• Title/Summary/Keyword: program outcomes

Search Result 918, Processing Time 0.024 seconds

An Analysis for the Course-Embedded Assessment Tool to Validate Program Outcomes (프로그램 학습성과 타당성 관찰을 위한 교과목-임베디드 평가도구 분석)

  • Shin, Haeng-Ja;Kim, Si-Pom;Kang, Won-Ho
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.7 no.4
    • /
    • pp.82-95
    • /
    • 2008
  • As society has changed to being more knowledge-based, it is necessary that change of paradigm is incorporated into engineering education and the education goals and the assessment method of educational outcomes is developed to promptly meet the needs of the times. A purpose of this study is to measure learning outcomes in coursework of engineering college every semester, which ultimately provides to validate program outcomes. We looked into teaching-learning style of course in the engineering college and analyzed its grade method and tool. By use of a survey, we derived a reasonable method to measure for the learning outcomes in course and presented tools for course-embedded assessment to measure that learning outcomes had been tied to their objectives. These tools are effective to determine that program outcomes and education goals have been achieved, ultimately. In addition, it will help that instruction builds a loop system for better.

  • PDF

Case Study with Regard to ABEEK Assessment Process for Program Outcomes (공학교육인증의 학습성과 평가체계의 사례 연구)

  • Hur, Don
    • Journal of Engineering Education Research
    • /
    • v.12 no.1
    • /
    • pp.57-63
    • /
    • 2009
  • This Paper presents a clearly explained and richly illustrated case study of assessment and evaluation for program outcomes in accreditation for engineering education, which describe what Program students are expected to be able to do by the time of graduation. In particular, the performance criteria based on performance level, assessment tools, and level-of-achievement rubrics for assessment of program outcomes in electrical engineering program of Kwangwoon university will be briefly addressed. Obviously, the assessment, evaluation, and improvement processes for the specified program outcomes should be continuously carried out to demonstrate that the program objectives and outcomes are being met.

Reliability Analysis and Improvement Plan for Evaluation of Program Outcomes among Demand-driven Raters (프로그램 학습성과 평가에 대한 수요지향 평가자 간 신뢰도 분석 및 개선 방안)

  • Lee, Youngho;Shin, Younghak;Kim, Jonghwa
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.3
    • /
    • pp.410-418
    • /
    • 2021
  • In a program that runs an engineering education certification, program outcomes refer to the knowledge, skills, and attitudes a student must have until graduation. In general, capstone design is used as a tool for evaluating program outcomes. This paper applies the intraclass correlation coefficient (ICC) to measure the raters' reliability in assessing program outcomes. Several raters evaluate program outcomes, and the result is used to obtain the raters' ICC. ICC measures the reliability of ratings or measurements for clusters - data that has been collected as groups or sorted into groups. If the ICC is close to 1, it means that the reliability among the raters is high. We evaluated the proposed method's usefulness through case analysis. As a method for assessing an evaluation tool's objectivity, multiple raters measure the same evaluation tool. As a result, we measured the ICC values for all POs, and analyzed the cause for the low measured POs. We applied this method to evaluate program outcomes of the Department of Computer Engineering in the past two years. As a result, we derived guidelines for improvement and program outcomes.

Development of Program Outcomes Evaluation System for Multidisciplinary Major in Design and Software (디자인과 소프트웨어 융합전공의 프로그램 학습성과 평가체계 개발)

  • Choi, Ji-Eun;Kim, Hakil;Jin, Sung-Hee
    • Journal of Engineering Education Research
    • /
    • v.22 no.6
    • /
    • pp.74-88
    • /
    • 2019
  • In recent years, the design has formed and operated convergence education in conjunction with many other academic fields, and ABEEK also encourages the participation of convergence engineering programs. The purpose of this study is to require design and software convergence major to operate program that accord engineering education certification criteria to develop a program outcomes evaluation system and examine its validity. The program outcomes evaluation system was developed in accordance with development research methods and procedures. As a result, developed evaluation system program outcomes for convergence-based program outcomes: convergence ability, creative thinking ability, entrepreneur ability, and design ability. Finally, it revised and supplemented them through expert validity examine. Expert validity review included 9 experts in engineering, IT engineering, education technology, and design. The validity, usefulness, intelligibility, universality, and explanatory power of the evaluation system were reviewed. The results of this study are expected to provide practical tools for operating ABBEK of convergence programs between design and engineering.

A Study on the Development and Application of Rubrics for Performance Assessment in Terms of Promoting Program Learning Outcomes (학습성과 수행평가를 위한 루브릭 개발과 적용에 관한 연구)

  • Shin, Minhee
    • Journal of Engineering Education Research
    • /
    • v.15 no.5
    • /
    • pp.108-118
    • /
    • 2012
  • The purpose of this study was to provide analytic rubrics for measuring teamwork(PO6), communication and presentation skills(PO7), and life-long learning(PO8) based on theoretical concepts of performance assessment and rubrics. Also, this study analyzed data about performance assessment and rubics from courses offered through college of engineering. Participants were 34 senior engineering students who took the course 'Technical writing and presentation'. In the second week of the course, students were given the pre-test instrument which was developed for measuring students' understanding of program outcomes for this study. After performing project activities using rubrics, students were encouraged to complete the post-test instrument and the reaction questionnaire during the ninth week. The data were analyzed by using SPSS 14.0 and Microsoft Excel. The research findings are as follows. First, to promote and evaluate program learning outcomes appropriately, performance assessment-based on rubircs should be implemented. Second, in the reaction questionnaire about the rubircs, students answered that using rubircs for performing the project was very useful for understanding the performance procedures and assessment criteria. Third, the mean of understanding of program outcomes of students in post-test was significantly increased than in the pre-test(p<.0001). From the findings, performance assessment and rubrics should be used as evaluation tools at course levels in terms of promoting program learning outcomes for engineering education.

Developing an Outcome-Based Industrial and Systems Engineering Program

  • Alfares, Hesham K.;Al-Turki, Umar M.;Duffuaa, Saleh O.
    • Industrial Engineering and Management Systems
    • /
    • v.9 no.1
    • /
    • pp.60-68
    • /
    • 2010
  • In this paper, a systematic methodology is proposed for developing an outcome-based undergraduate Industrial and Systems Engineering Program at the Systems Engineering Department of King Fahd University of Petroleum & Minerals (KFUPM) in Saudi Arabia. This program is an upgrade of the Industrial Engineering and Operations Research (IE/OR) option, which has been in existence since 1984 and has been revised several times since then. The methodology and process used is motivated by the Accreditation Board for Engineering and Technology (ABET) 2000 criteria and has been employed to develop the program's objectives and outcomes. Subsequently, a curriculum is designed that is expected to deliver the objectives and outcomes. The paper presents the methodology, objectives, outcomes and the developed curriculum of the outcome-based program.

A Case Study on Program Outcomes Assessment of Information Security Program for Engineering Education Accreditation (공학교육인증을 위한 정보보호학 프로그램의 학습성과 평가에 관한 연구)

  • Chung, Weonil;Oh, Soo-Hyun;Kim, Hwankoo
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.26 no.3
    • /
    • pp.777-785
    • /
    • 2016
  • Engineering education accreditation addresses evaluation for program outcomes according to educational objectives and assessment process, which students are expected to obtain by the time of graduation in order to train international competitive engineers with continuous quality improvement in engineering programs. This paper shows a case study of a program outcomes assessment system including performance criteria, evaluation process, document system and continuous quality improvement process and an achievement evaluation by the assessment system for program outcomes in Information Security Program of Hoseo university.

Model Development and Strategy plan for Implementing Program Outcomes and Assessment ('프로그램학습성과 및 평가'실천을 위한 모형 개발 및 전략에 대한 연구)

  • Kim, Myoung-Lang;Yoon, Woo-Young;Kim, Dong-Hwan;Chung, Jin-Taek
    • Journal of Engineering Education Research
    • /
    • v.10 no.4
    • /
    • pp.29-42
    • /
    • 2007
  • The 'Program outcomes and assessment' is an important criterion evaluating of engineering education in accreditation of engineering education. ABEEK prescribes program outcomes which are the basic capabilities in the application of the fundamental knowledge and practical tools of the engineering field. Also ABEEK asks to prove that all programs are constructed a proper educational curriculum and are satisfied program outcomes and CQI. Therefore program outcomes must satisfy both two key points. First, as a quality control aspect, engineering programs must prove that graduates of accredited programs can perform twelve capabilities. Second, as a continuous quality improvement aspect, accredited programs have to upgrade a level of engineering educational quality. Consequently the purpose of study is to introduce a new model for CQI and QC systems, implementing strategies as an actualizing of program outcomes.

A Study on Graduate Attributes Assessment for K-EP (K-Engineering Professional) Qualification (K-EP(K-Engineering Professional) 자격을 위한 졸업생역량 평가방안 연구)

  • Choi, Se Hyu;Kang, Sang Hee;Kim, Jung Soo;Yoon, Jiyoung
    • Journal of Engineering Education Research
    • /
    • v.24 no.6
    • /
    • pp.30-39
    • /
    • 2021
  • The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

Framework for Course-Embedded Outcomes Assessment: A Case Study of Architecture & Building Engineering Program at KSNU (교과기반 학습성과 평가시스템 개발: 군산대학교 공학인 건축공학심화프로그램 사례 연구)

  • Pak, Sungsine
    • Journal of Engineering Education Research
    • /
    • v.23 no.1
    • /
    • pp.47-58
    • /
    • 2020
  • Kunsan National University obtained accreditation for its Architecture & Building Engineering Program from the Accreditation Board for Engineering Education in Korea (ABEEK) in 2004 and has offered an ABEEK-accredited degree pathway ever since. Then, in 2018, the university introduced the course-embedded outcomes assessment system as per ABEEK's KEC2015 accreditation criteria. One year into its implementation, the new system allows the measurement and assessment of 10 program outcomes covering 19 curricular modules and 1 non-curricular licensing examination. The system incorporates the four areas of specialization within architectural engineering as well as the three course categories of the math, science, and computer; liberal arts; and engineering core modules under the accreditation scheme. It also takes the students' academic years into account, especially for the mandatory modules offered to all students. Its rubric clarifies the performance criteria, performance level, assessment tools, objectives, and modules. The 2018 course-embedded outcomes assessment system is an ever-evolving structure with regular CQI: Continuous Quality Improvements along the circular process of system establishment → implementation → evaluation as per the virtuous cycle model required for an accredited engineering program.