• Title/Summary/Keyword: Learning outcome measurement

Search Result 17, Processing Time 0.024 seconds

Exploring the Development Directions of Learning Outcome in Higher Education through the Analysis of Popular Tools: A Case of University K (주요 고등교육 학습성과 분석 도구 분석을 통한 발전 방향 모색: K대학 사례 연구)

  • Taehyung Kim;Eunjeong Jang
    • Journal of Practical Engineering Education
    • /
    • v.16 no.2
    • /
    • pp.129-141
    • /
    • 2024
  • In recent times, there has been a shift towards student-centered higher education policies, leading to a growing interest among universities to improve students' learning outcomes. To aid in this endeavor, this study aims to provide guidance for University K to enhance their learning outcome management by comparing and analyzing their learning outcome indicators with those of other domestic and foreign universities. The study examined detailed measurement questions from major learning outcome measurement tools such as AHELO, NSSE, and CLA+. Upon comparison and analysis of University K's major learning outcome indicators with those of other universities, it was found that most of the indicators overlapped. However, some indicators such as student support/facilities for learning, instructor quality, and communication were absent from University K. Therefore, it is crucial to decide whether to add these indicators to the existing learning outcomes or to confirm them through other surveys. Moreover, even for the same indicator, some indicators with different measurement need to consider changing the measurement.

A Learning Progression for Water Cycle from Fourth to Sixth Graders with Ordered Multiple-Choice Items (순위 정렬 선다형 평가 문항을 적용한 초등학교 4~6학년 학생들의 물의 순환에 대한 학습 발달 과정)

  • Seong, Yeonseon;Maeng, Seungho;Jang, Shinho
    • Journal of Korean Elementary Science Education
    • /
    • v.32 no.2
    • /
    • pp.139-158
    • /
    • 2013
  • This study investigated elementary students' (grade 4~6) learning progressions for water cycling drawn from iterative assessments using ordered multiple-choice (OMC) items. An assessment system, which consisted of construct map, item design, outcome space, and measurement model, was employed in this study to examine children's learning progressions. At the first stage of the assessment system, a construct map was designed on which children's conceptual understandings from naive to most sophisticated were represented. At the item design stage, 8 OMC items were drawn from the construct map. Each item option of the OMC items was scored from 0 to 3 according to its level of understanding at the stage of outcome space. As a measurement model, Rasch model, a branch of item response theory, was applied to interpreting the outcomes of the OMC items. This cycle of assessment system was furtherly implemented iteratively in order to elaborate on the first version of water cycling learning progression. In conclusion, children's understanding of water cycling could be described in two aspects: water distribution and water movement. We identified children's conjectural developmental pathways about water cycling existed from superficial and naive accounts to more complex and abstract accounts.

Practical Measurement on Education Outcome Through Multi-Evaluations (다면적 평가를 통한 교육성과 평가도구 개발 및 분석연구)

  • Baik, Ran
    • Journal of Engineering Education Research
    • /
    • v.15 no.6
    • /
    • pp.98-102
    • /
    • 2012
  • This paper diagnose subjects and measures the learning ability of students based on the goal of developing an assessment tool for education productivity based on multi-aspect evaluation conducted by ICEE at Honam University. Furthermore, develop an assessment tool for education productivity that provides a motive to bring detailed improvements in teaching methods through the diagnosis. In addition, a method for compensating the issues and improving the quality of subject is suggested to develop learning ability of students through applying the assessment tool. An integrated operated system of CQI is desired to be built along with quality improvement of education through measuring academic quality by studying the methods for enhancing academic and learning ability achievement from analysis of the curriculum provided in the "ABEEK program". Through this study the current state of education productivity is presented through analyzing the difference between students who participated in the "ABEEK program" and who did not participate, and operating a comparison between the student's comprehension on their majors and liberal arts by the multi-aspect evaluation that has been conducted for 2 years.

A Study on the Relationship of Learning, Innovation Capability and Innovation Outcome (학습, 혁신역량과 혁신성과 간의 관계에 관한 연구)

  • Kim, Kui-Won
    • Journal of Korea Technology Innovation Society
    • /
    • v.17 no.2
    • /
    • pp.380-420
    • /
    • 2014
  • We increasingly see the importance of employees acquiring enough expert capability or innovation capability to prepare for ever growing uncertainties in their operation domains. However, despite the above circumstances, there have not been an enough number of researches on how operational input components for employees' innovation outcome, innovation activities such as acquisition, exercise and promotion effort of employee's innovation capability, and their resulting innovation outcome interact with each other. This trend is believed to have been resulted because most of the current researches on innovation focus on the units of country, industry and corporate entity levels but not on an individual corporation's innovation input components, innovation outcome and innovation activities themselves. Therefore, this study intends to avoid the currently prevalent study frames and views on innovation and focus more on the strategic policies required for the enhancement of an organization's innovation capabilities by quantitatively analyzing employees' innovation outcomes and their most suggested relevant innovation activities. The research model that this study deploys offers both linear and structural model on the trio of learning, innovation capability and innovation outcome, and then suggests the 4 relevant hypotheses which are quantitatively tested and analyzed as follows: Hypothesis 1] The different levels of innovation capability produce different innovation outcomes (accepted, p-value = 0.000<0.05). Hypothesis 2] The different amounts of learning time produce different innovation capabilities (rejected, p-value = 0.199, 0.220>0.05). Hypothesis 3] The different amounts of learning time produce different innovation outcomes. (accepted, p-value = 0.000<0.05). Hypothesis 4] the innovation capability acts as a significant parameter in the relationship of the amount of learning time and innovation outcome (structural modeling test). This structural model after the t-tests on Hypotheses 1 through 4 proves that irregular on-the-job training and e-learning directly affects the learning time factor while job experience level, employment period and capability level measurement also directly impacts on the innovation capability factor. Also this hypothesis gets further supported by the fact that the patent time absolutely and directly affects the innovation capability factor rather than the learning time factor. Through the 4 hypotheses, this study proposes as measures to maximize an organization's innovation outcome. firstly, frequent irregular on-the-job training that is based on an e-learning system, secondly, efficient innovation management of employment period, job skill levels, etc through active sponsorship and energization community of practice (CoP) as a form of irregular learning, and thirdly a model of Yί=f(e, i, s, t, w)+${\varepsilon}$ as an innovation outcome function that is soundly based on a smart system of capability level measurement. The innovation outcome function is what this study considers the most appropriate and important reference model.

Antecedents and Outcome Variable and Mediating Effects of Continuous-Related Career Learning (지속경력학습의 선행 및 결과변인과 매개효과)

  • Ji, Sung-Ho
    • The Journal of the Korea Contents Association
    • /
    • v.15 no.8
    • /
    • pp.564-578
    • /
    • 2015
  • The present study is aimed to investigate antecedents(person-job fit, human capital investment) and outcome variable(subjective career success) of continuous-related career learning, and to demonstrate mediating effects of continuous-related career learning. The data which was applied to analysis was collected from 241 office workers who have worked for automobile company in Ulsan and public companies in Jeju and applied temporal separation of measurement as an alternative for common method bias. The results are as follows. First, person-job fit, human capital investment affected to career-related continuous learning positively. Second, the impacts of career-related continuous learning to subjective career success was positively significant. Third, the mediating effects by career-related continuous learning demonstrated statistically significant in the links between antecedents-outcome variables as partial mediation. Implications of this study contribute to expand research area of continuous-related career learning with regard to job and organizational variables, and to facilitate of research interests on subjective career success. In addition, the mechanism of career advance was empirically proved by continuous-related career learning.

Developing a Social Presence Scale for Measuring Students' Involvement during e-Learning Process

  • KANG, Myunghee;CHOI, Hyungshin
    • Educational Technology International
    • /
    • v.9 no.2
    • /
    • pp.1-15
    • /
    • 2008
  • One of the challenges that online learners face is feeling of isolation and diminishing desire of maintaining active participation during e-learning. Social presence, that is considered to be a vital factor in e-learning, is recently started to receive a support from the field. Although research indicated a significant role of social presence in both learning process and learning outcome, there is no widely accepted measurement scale of social presence. This study, therefore, developed a new scale to measure social presence based on the existing theories and validated it against 723 participants. Nineteen self-report items with three dimensions, co-presence, influence, and cohesiveness, were identified and validated using Exploratory Factor Analysis (EFA) in a preliminary and a follow-up study.

Influence of Simulation-Based Practice on Emergency Care for Patients with Dyspnea on Learning Outcomes in Nursing Students (시뮬레이션을 활용한 호흡곤란 응급관리 실습이 간호학생의 학습 성과에 미치는 영향)

  • Hur, Hea-Kung;Choi, Hyang-Ok;Jung, Ji-Soo;Kang, Hye-Won;Kim, Gi-Yon
    • Journal of Korean Critical Care Nursing
    • /
    • v.5 no.1
    • /
    • pp.12-22
    • /
    • 2012
  • Purpose: This study was conducted to evaluate the learning outcomes of simulation-based practice on emergency care for patients with dyspnea in nursing students. Methods: One group pre-post experimental design with 28 nursing students was used. Simulation-based practice on the basis of SimMan Human Patient Simulator including academic lectures, simulation lab exercises and debriefing was applied for four and half hours. The learning outcomes were assessed by measuring knowledge, critical thinking, problem solving process of cognitive skills, self-confidence and learning attitudes of affective domain. Furthermore, self reported clinical performance ability of psychomotor skills was examined. Results: After the completion of simulation-based practice, there was a significant increase in the mean of following measured variables: knowledge, critical thinking, problem solving process of cognitive skills, self-confidence, learning attitudes of affective domain and clinical performance ability of psychomotor skills. Significant positive relationships were found among learning outcome measurement variables. Conclusion: Simulation-based practice is an effective method to improve cognitive skills, affective domain and psychomotor skills of nursing students. Hence, Simulation-based practice should be applied for improving current limited emergency care training for nursing students and enhancing students' competency in clinical situations.

  • PDF

Directions of Simulation-Based Learning in Nursing Practice Education: A Systematic Review (간호학 실습교육에서 시뮬레이션기반학습의 방향 고찰)

  • Lim, Kyung-Choon
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.17 no.2
    • /
    • pp.246-256
    • /
    • 2011
  • Purpose: With the decrease in available clinical sites, a decrease in adequately prepared clinical faculty, and demand to prepare health care students to begin work, we need alternative methods to teach clinical skills for health care professionals. The use of simulation as an educational process that can replicate clinical practices is becoming popular in nursing. Therefore, this study was conducted to review directions of simulation-based learning in nursing education. Methods: A systematic review of quantitative studies was undertaken using Medline, KERIS, and KISS. The primary search terms were simulation and nursing. Reference lists from relevant papers and the websites of relevant nursing organizations were also searched. Nine studies met inclusion criteria and were analyzed in detail. Results: All studies reported simulation as a valid teaching/learning strategy. Six of the studies (66.7%) showed that simulation technology was a practical and successful model to use in teaching a variety of clinical skills for nursing students and nurses. Conclusion: Simulation may have some advantages over other teaching methods, depending on the scenario, context, topic, and method. Further study is needed to determine the effect of team size on learning and to develop a universal method of outcome measurement.

A Proposal of Curriculum and Teaching Sequence for Seasonal Change by Exploring a Learning Progression (학습 발달과정 탐색을 통한 계절의 변화 교육과정 및 교수 계열 제안)

  • Heo, Jaewan;Lee, Kiyoung
    • Journal of the Korean earth science society
    • /
    • v.39 no.3
    • /
    • pp.260-274
    • /
    • 2018
  • The purpose of this study was to propose curriculum and teaching sequence for seasonal change by exploring a learning progression. For the purpose, 4 steps of construct modeling approach (specifying construct, item design, outcome space, and measurement model) proposed by Wilson (2005) was applied. In the stage of specifying construct, 'length of shadow according to seasons', 'position of constellation according to seasons', 'seasons of the southern hemisphere and northern hemisphere', 'cause and phenomenon of seasonal change' were selected as the subconstructs of seasonal changes, and constructed a construct map showing the level of development from level 1 to level 4 for each subconstruct based on the results of the previous research. In the item design stage, we developed five assessment items consisting of 3 items in the form of C-E (choose and explain) and two items in the form of CR (constructed response), applied it to 383 elementary, middle and high school students. In the outcome space stage, the students' responses to the assessment items were categorized based on the construct map. The categories were classified into 4 levels according to student ability and scores of 1-4 were given. In the measurement model stage, we applied the partial credit model of the Rasch model and compared whether the learning pathway created from the results of students' response coincides with the construct map. Based on the results of the research, we modified the construct map and finally created hypothetical learning progression on seasonal change. Finally, we proposed an orientation of curriculum amendment and effective teaching sequence for seasonal change.

Study on Validity of SDLRS Instrument for Evaluation of Life-Long Outcome (평생학습 학습성과 평가를 위한 자기주도학습 준비도 검사도구(SDLRS)의 타당성 연구)

  • Han, Ji-Young
    • Journal of Engineering Education Research
    • /
    • v.11 no.4
    • /
    • pp.64-75
    • /
    • 2008
  • The purpose of the study was to verify reliability and validity of SDLRS instrument and to prove up possibility of usage as an evaluation method for evaluating life-long learning. Literature review and survey were used to accomplish objectives of the study. 218 students in department of mechanical engineering of A university at Gyunggi province were responded for SDLRS(Guglielmino, 1977) instrument. Data were analyzed using descriptive statistics, factor analysis, t-test, and ANOVA test. 58 items in original version instrument were converted to 23 items. There were 7 factors for assessing the self-directed learning readiness according to this measurement scale with a total variance of about 58%. The total reliability of the final 23 items was $\alpha$. The final 7 factors consisted of love for learning, openness for learning, self-perception, basic learning function and independence, acceptance of responsibility for learning, leadership and future directivity, and creativity and exploration. The result of SDLRS analysis according to individual background, there were significant statistically in the grade, period of employment in industry, entering graduate school or not, and GPA, but no significant statistically in sexual difference, employment in industry or not, final academic level of parent, and income level of the family. In the future, final instrument will be needed to check in the respect of correlation with another ability and skill influencing on life-long learning, and more study will be done for developing life-long learning.