• Title/Summary/Keyword: learning outcomes assessment

Search Result 89, Processing Time 0.025 seconds

An Analysis for the Course-Embedded Assessment Tool to Validate Program Outcomes (프로그램 학습성과 타당성 관찰을 위한 교과목-임베디드 평가도구 분석)

  • Shin, Haeng-Ja;Kim, Si-Pom;Kang, Won-Ho
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.7 no.4
    • /
    • pp.82-95
    • /
    • 2008
  • As society has changed to being more knowledge-based, it is necessary that change of paradigm is incorporated into engineering education and the education goals and the assessment method of educational outcomes is developed to promptly meet the needs of the times. A purpose of this study is to measure learning outcomes in coursework of engineering college every semester, which ultimately provides to validate program outcomes. We looked into teaching-learning style of course in the engineering college and analyzed its grade method and tool. By use of a survey, we derived a reasonable method to measure for the learning outcomes in course and presented tools for course-embedded assessment to measure that learning outcomes had been tied to their objectives. These tools are effective to determine that program outcomes and education goals have been achieved, ultimately. In addition, it will help that instruction builds a loop system for better.

  • PDF

A Study on the Development and Application of Rubrics for Performance Assessment in Terms of Promoting Program Learning Outcomes (학습성과 수행평가를 위한 루브릭 개발과 적용에 관한 연구)

  • Shin, Minhee
    • Journal of Engineering Education Research
    • /
    • v.15 no.5
    • /
    • pp.108-118
    • /
    • 2012
  • The purpose of this study was to provide analytic rubrics for measuring teamwork(PO6), communication and presentation skills(PO7), and life-long learning(PO8) based on theoretical concepts of performance assessment and rubrics. Also, this study analyzed data about performance assessment and rubics from courses offered through college of engineering. Participants were 34 senior engineering students who took the course 'Technical writing and presentation'. In the second week of the course, students were given the pre-test instrument which was developed for measuring students' understanding of program outcomes for this study. After performing project activities using rubrics, students were encouraged to complete the post-test instrument and the reaction questionnaire during the ninth week. The data were analyzed by using SPSS 14.0 and Microsoft Excel. The research findings are as follows. First, to promote and evaluate program learning outcomes appropriately, performance assessment-based on rubircs should be implemented. Second, in the reaction questionnaire about the rubircs, students answered that using rubircs for performing the project was very useful for understanding the performance procedures and assessment criteria. Third, the mean of understanding of program outcomes of students in post-test was significantly increased than in the pre-test(p<.0001). From the findings, performance assessment and rubrics should be used as evaluation tools at course levels in terms of promoting program learning outcomes for engineering education.

A Study on Learning Modules for Course Embedded Assessment of Soft Skills Program Outcomes (소프트스킬 프로그램 학습성과의 교과기반 평가(CEA)를 위한 학습모듈(안)에 관한 연구)

  • Kang, Sang Hee
    • Journal of Engineering Education Research
    • /
    • v.23 no.6
    • /
    • pp.40-50
    • /
    • 2020
  • This paper proposes learning modules as a kind of integrated instruction model for soft skills program outcomes to enable CEA. Learning modules consist of course learning objectives(outcomes) described in detail, learning content(elements), learning activities(teaching learning methods), evaluation methods, evaluation rubrics so that they can be evaluated based on the performance criteria of the program learning outcomes. The unit of time for the learning module is 50 minutes. If this learning module is applied, it is expected that the soft skill program outcomes can be evaluated in the technical course. As a result of the expert feasibility study, the positive answers were much higher than the negative answers in most of the questions about the composition of the learning module or the method of managing the class.

Data modeling and algorithms design for implementing Competency-based Learning Outcomes Assessment System (역량기반 학습성과 평가 시스템 구현을 위한 데이터 모델링 및 알고리즘 설계)

  • Chung, Hyun-Sook;Kim, Jung-Min
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.11
    • /
    • pp.335-344
    • /
    • 2021
  • The purpose of this paper is the development of course data models and learning achievement computation algorithms for enabling the course-embedded assessment(CEA), which is essential of competency-based education in higher education. The previous works related CEA have weakness in the development of the systematic solution for CEA computation. In this paper, we propose data models and algorithms to implement competency-based assessment system. Our data models are composed of a layered architecture of learning outcomes, learning modules and activities, and an associative matrix of learning outcomes and activities. The proposed methods can be applied to the development of the course-embedded assessment system as core modules. We evaluated the effectiveness of our proposed models through applying the models to a practical course, Java Programing. From the result of the experiments we found that our models can be used in the assessment system as a core module.

A Comparative Study of the Results from an OECD Higher Education Learning Outcomes Assessment between Accredited Students with an Engineering Education and Non-Accredited Students (공학교육 인증프로그램 재학생과 비인증프로그램 재학생의 OECD 고등교육학습성과평가 결과 비교분석)

  • Kim, Hakjin;Song, Ohsung
    • Journal of Engineering Education Research
    • /
    • v.18 no.5
    • /
    • pp.51-58
    • /
    • 2015
  • This research was conducted to assess the effects of an engineering education accreditation program devised by the University of Seoul on higher education outcomes by comparing and analyzing the evaluation results of engineering accredited students (31) and those who are not accredited (47) with the OECD AHELO (Assessment of Higher Education Learning Outcomes) in 2013. The AHELO assessment tool consisted of 25 multiple-choice questions which evaluated generic skill-learning outcomes, also using contextual surveys to establish the students' backgrounds. The results were evaluated statistically. In the results from the multiple-choice exam for generic skill learning outcomes, accredited students scored 1.35 points higher than non-accredited students. Secondly, according to the contextual survey related to students' university education experience, such as lectures, seminars, group projects, and online tutoring, it was found that accredited students were provided more activities in seminars and group projects. Moreover, for class activities, more of these were provided to accredited students, especially in the areas of assortment-structuralization and teamwork-based activities. Thirdly, according to the contextual survey results related to participation in class, specifically regarding asking questions and participating in discussions, interacting with the professor, and opportunities for study time, there were no recognizable differences between accredited and non-accredited students, However, while accredited students at least had opportunities to gain experience in most areas, there were some areas for which education resources were not provided to non-accredited students. Therefore, for the University of Seoul, our results imply that accredited students may show better performance in the areas of academic accomplishment and in their educational environment as compared to non-accredited students. These results demonstrate that the engineering education accreditation program positively contributes to employment competitiveness while also improving the necessary global standards of higher education outcomes.

A Critical Evaluation of the Concept and Writing of Learning Outcomes (학습성과의 개념과 작성에 대한 탐구)

  • Lee, Dong Yub;Yang, Eunbae B.
    • Korean Medical Education Review
    • /
    • v.18 no.3
    • /
    • pp.125-131
    • /
    • 2016
  • Recent changes in educational paradigms that emphasize the performance or outcomes of education are redefining how learning objectives are being described as 'learning outcomes' in various academic disciplines. Medical education is not an exception to this trend. However, it has come to our attention that the key concepts and appropriate descriptions of learning outcomes have not been well understood among educators and that this lack of understanding has hindered our efforts to implement the practice in the field. This study aims to provide a direction to establish and describe learning outcomes by examining previous studies that have focused on setting learning objectives as well as learning outcomes. Setting and describing learning outcomes starts from reflection on the approach of behavioral learning objectives, which overemphasizes learner's acquired knowledge, skills, and attitude in each classroom rather than actual performance. On the other hand, the learning outcome approach focuses on what the learner is able to do as a result of a learning experience. This approach is more learner-friendly and encourages students to lead and be responsible for their learning process. Learning outcomes can best be described when the relevance of actual contexts and the hierarchy of learning objectives are considered. In addition, they should be in the form of context, task, performance, and level, as well as be planned with proper assessment and feedback procedures. When these conditions are met, the learning outcome approach is beneficial to students as it presents a curriculum that is more open to learners. Despite these advantages of the learning outcome approach, there is a possible concern that setting the learning outcomes and describing them can restrict evaluation to lower cognitive skills if the concept of learning outcome is narrowly interpreted or is set too low. To avoid such narrow applications, it is important for educators to understand the comprehensiveness of the learning outcome setting and to consider long-term outcomes embedded in an organizational vision rather than only short-term behavioral outcomes.

Development of Program Outcome Self-Assessment Tool in Korean Nursing Baccalaureate Education (간호학 프로그램 학습성과 간접측정 도구개발)

  • Kim, Hyun-Kyoung
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.21 no.2
    • /
    • pp.215-226
    • /
    • 2015
  • Purpose: This study aimed to develop a self-assessment tool to evaluate program outcomes of nursing students in Korean nursing undergraduate education. Methods: The instrument development process consisted of literature review, focus group interviews, and item validation. A total of 117 items were analyzed through content validity testing. Data was gathered from 302 nursing students in Korea and analyzed using SPSS 21.0. Results: To construct validity, principal component analysis and Varimax rotation were used, and 12 factors, with a cumulative explanatory variance of 69.16%, were determined from 79 items. For internal consistency and reliability, Cronbach's ${\alpha}$ was .91. The half-split reliability results were .84 and .85, and the ROC curve showed an optimal cutpoint at 227. A five-point Likert scale was used for scoring. Conclusion: This instrument was found to have fair validity and reliability as a self-assessment tool for nursing student learning outcomes. Therefore, it can be used to evaluate program outcomes indirectly in nursing schools.

The Evaluation Tool and Process for Effective Education Outcomes Measurement and Analysis of Computer Education

  • Kim, Young-Tak;Sim, Gab-Sig
    • Journal of the Korea Society of Computer and Information
    • /
    • v.21 no.9
    • /
    • pp.149-156
    • /
    • 2016
  • This paper is concerned with education courses operating practices for basic computer literacy training. In this study, we propose an example for students to effectively measure and evaluate the achievement of defined ability in the performance measurement and analysis, learning objectives and learning outcomes set in operation throughout the course. Through research and development use case presents the tools for teaching method and effective and objective measurement of the related subjects. And based on the results, we propose the possibility of utilizing NCS-based course operation and education certification. In this study, the measurement process is based on the association with the objective of the development and operation, and measurement tools, measuring tools for measuring learning outcomes associated with the curriculum design methods for the measurement and evaluation of the case of the operation of the course units of learning outcomes and the method proposed.

Assessment in Outcome-Based Education (성과중심교육에서 학생평가)

  • Im, Sun Ju
    • Korean Medical Education Review
    • /
    • v.15 no.1
    • /
    • pp.25-30
    • /
    • 2013
  • Assessment plays a vital role in outcome-based education (OBE). This article describes the characteristics of assessment and appropriate assessment instruments for measuring learning outcomes in OBE. Assessment in OBE needs to be formative, continuous, and frequent. Miller's pyramid is useful for selecting the appropriate assessment instruments to reflect a specific outcome; different methods can be applied to evaluate one outcome. Outcomes and competency mean that student must 'do'; therefore, performance tests are emphasized. Qualitative methods as well as quantitative methods are used to evaluate the outcomes of areas such as professionalism or ethics. An absolute criterion-based standard is usually applied to decide whether students pass or fail, but the decision should be based on gathering value judgments and reaching consensus. Active participation of faculty members and students in assessment is crucial.

Effects of Action Learning Approaches on Learning Outcomes in Nursing Management Courses (액션러닝 기반 간호관리학 강의 및 실습 운영의 효과)

  • Jang, Keum Seong;Park, Soon Joo
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.18 no.4
    • /
    • pp.442-451
    • /
    • 2012
  • Purpose: The purpose of this study was to identify effects of action learning approaches on learning outcomes of students taking nursing management courses. Methods: The questionnaire surveys were completed between March 2011 and June 2012 by 109 undergraduate seniors in the nursing department of C University. Survey data were obtained 3 times: before, in and after the study of nursing management. The course consisted of lectures and clinical practices. Learning outcomes were measured through problem solving skills, team efficacy, and class satisfaction. Collected data were analyzed using repeated measures ANOVA with the SPSS 20.0 program Results: Scores for problem solving skills (F=13.67, p<.001) and team efficacy (F=4.49, p=.012) showed statistically significant increases after the course. The scores also increased significantly after the lectures for 5 of 9 problem solving skill subscales: analysis skill, divergent thinking, decision making, assessment, feedback, and after the clinical practices for 2 subscales: divergent thinking, and execution and risk taking. Class satisfaction score also increased after both the lectures and the clinical practices. Conclusion: The findings from this study suggest that an action learning approaches for nursing management courses would be a useful teaching and learning method to achieve learning outcomes.