• Title/Summary/Keyword: achievement evaluation

Search Result 814, Processing Time 0.027 seconds

Exploring a Learning Progression for Eight Core Concepts of Middle School Science Using Constructed Response Items in the National Assessment of Educational Achievement (NAEA) (국가수준 학업성취도 평가의 서답형 문항을 이용한 중학교 과학 8개 핵심 개념에 대한 학습발달과정 탐색)

  • Lee, Kiyoung;Dong, Hyokwan;Choi, Wonho;Kwon, Gyeongpil;Lee, Inho;Kim, Yong-Jin
    • Journal of Science Education
    • /
    • v.41 no.3
    • /
    • pp.382-404
    • /
    • 2017
  • This study aims to explore a learning progression for eight core concepts of middle school science using constructed response items in the national assessment of educational achievement (NAEA). For this purpose, a total of 7,390 responses of the 9th graders on 8 constructed response items in NAEA conducted in 2015 were inputted by computer and the inputted answers were analyzed and classified into different levels. After completing this process, five levels were set for each construct and a construct map was created according to the levels. In this study, the construct map was written in a progression-based rubric format, which was used as a criterion for leveling the answers of all students. In addition, the Rasch model was applied to measure the scores and achievements of the respondents by means of statistical analysis to correlate the scores of the students with the achievement levels of the constructs. Lastly, a preliminary learning progression was created by revising the construct map reflecting the results of Rasch model application. This study was meaningful in that it explored the possibility of developing the learning process by using constructed response items in NAEA. However, the preliminary learning progression developed in this study is still hypothetical and inferential because it is not longitudinally traced to individual students. Therefore, it is necessary to continually revise and supplement through iterative research process.

A Comparative Study of Mathematics Curriculum and National Assessment Between Japan and Korea (일본과 우리나라의 수학과 교육과정과 국가수준 학업성취도 평가 비교)

  • Rim, Haemee;Kim, Bumi
    • School Mathematics
    • /
    • v.16 no.2
    • /
    • pp.259-283
    • /
    • 2014
  • This research investigated the Revised mathematics curriculum and the National Achievement Test of Japan that advanced by leaps and bounds in PISA 2012. As compared with Korea, Japan shows similar trends in the affective domain and the cognitive domain of international achievement test. To put it concretely, this research compared and analyzed the mathematics contents domain of the 2009 revised mathematics curriculum of Korea and the 2008 revised mathematics curriculum of Japan being applied. The analysis was conducted in many aspects including overall of Japanese mathematics education system, the contents to be covered in each grade, and the methods of essential learning themes. We compared the mathematics contents dealt with each country based on the framework of analysis such as

    . Also, this research compared and analyzed overview of evaluation system, assessment frame, item characteristic, type of item of NAEA, NAT, and PISA. The results show the introduction time, the degree of deepening themes handled in each country, common themes and topics were very similar between Korea and Japan. But content area of Japan and Korea have been highlighted in the curriculum of middle school and elementary school in each are different. We know that Test B of NAT also emphasized the use of mathematical knowledge. Form the results, we obtained the basic data for the improvement of the next our curriculum. In addition, this results suggests the implications for the improvement of school mathematics curriculum of Korea.

  • PDF
  • Analysis of the Effect of Sincere Learning Attitudes on Academic Achievement in On-line Education (온라인 교육에서 성실한 학습 태도가 학업 성취도에 미치는 영향 분석)

    • Lee, Eunjoo;Jeong, Youngsik
      • Journal of The Korean Association of Information Education
      • /
      • v.23 no.5
      • /
      • pp.481-489
      • /
      • 2019
    • In order to explore the learning attitude of the learners and the effects of conscious learning attitudes on academic achievement in On-line education system of open high school, we analyze the log data of 2,965 first graders who studied English, Math, Integrated Society and Integrated Science during the first semester of 2018. This study examines the learning status according to the learner's background variables, and analyzes the number of lessons per hour, learning progress rate, learning period, learning start month, and formative evaluation results for each class. In addition, to verify the effects of conscious learning attitude on academic achievement, skewness and kurtosis are calculated by using learning frequency values for each class. As a result, in almost all fields, the average number of lessons per class, study duration, progress rate, and grades, women are higher than men. In addition, the older ones are, the higher they are and the Seoul area is higher than the other area. The average learning period is 2~3 months, and the longer the learning period, the higher the formative evaluation score. Lastly, even though the number of learning is lower than that of learners who concentrate on a certain period of time, the formation scores of learners who learn consciously are higher.

    Error analysis on factorization and the effect of online individualization classes (인수분해에 대한 오류 분석과 온라인 개별화 수업의 효과)

    • Choi, Dong-won;Heo, Haeja
      • Journal of the Korean School Mathematics Society
      • /
      • v.24 no.1
      • /
      • pp.83-105
      • /
      • 2021
    • In this paper, we analyzed the misconceptions and errors incurred during factorization learning. We also examined whether online individualization classes had a positive effect on students' mathematical achievement. The experiment was conducted for 4 weeks (16 times in total) on middle school juniors in rural areas of Gyeonggi Province, where the influence of private extra education was small. In the class, the 'Google Classroom' was used as a LMS, the video lecture was uploaded to YouTube, and the teacher interacted with the students through "Zoom" and "Facetalk". In the online class situation, students' assignments and test answers were checked in real time through 'Google Classroom', and immediate feedback was provided to the experimental class group's students. However, for the control group students, feedback was provided only to those who desired. A total of 7 achievement evaluations were conducted in the order of pre-test, formative evaluation (5 times), and post-test to confirm the change in students' ability improvement and achievement. Through the formative evaluation analysis, it was possible to grasp the types of errors and misconceptions that occured during the factorization process. Students' errors were divided into four types: theorem or definition distortion error, functional errors such as calculation, operation, and manipulation, errors that do not verify the solution, and no response. As a result of ANCOVA, the two groups did not show any difference from the 1st to 4th formative assessment. However, the 5th formative assessment and post-test showed statistically significant differences, confirming that online individualization classes contributed to improvemed achievement.

    Exploring the change in achievement by the transition of the test mode from paper to computer: Focusing on the national assessment of educational achievement of high school mathematics (종이에서 컴퓨터로의 매체 전환에 따른 평가 결과의 변화 탐색: 고등학교 수학 국가수준 학업성취도 평가를 중심으로)

    • Jung, Hye-Yun;Song, Chang-Geun;Kim, Young-Jun;Lee, Kyeong-Hwa
      • The Mathematical Education
      • /
      • v.61 no.4
      • /
      • pp.597-612
      • /
      • 2022
    • Recently, large-scale mathematics assessments are shifting from traditional paper-based tests to computer-based tests, nationally and internationally. This study explored the mode effect (the difference in student achievement by the change of test mode) according to the types of test items, the technological function reflected in the items, the characteristics of students' computer use, and the computer-based test environment. To this end, we analyzed the results of the 2020 national assessment of educational achievement of high school mathematics conducted on a paper and computer basis. As a result, firstly, the mode effect induced by the mode transition was generally insignificant, but the mode effect was larger in the extended response type than other types. Secondly, there were differences in the mode effect according to the transition to test with computer mode where innovative items were added. Thirdly, the difference between mode effects was statistically significant according to the student's sense of efficacy in computer use. The results of this study suggest that innovative items should be introduced deliberately according to the targeted content and competency in evaluation, and that assessment design and environment preparation need to be carefully developed so that nonessential abilities other than students' mathematical ability or incidental situation do not distort the assessment results.

    Exploring Factors Influencing Affective Characteristics in Elementary School Students: Focusing on School Mathematics Education and Social Environment (초등학생의 정의적 특성에 영향을 미치는 요인 탐색: 학교에서의 수학 교육 및 사회적 환경을 중심으로)

    • Kwon, Jeom-Rae;Kwon, Misun
      • Education of Primary School Mathematics
      • /
      • v.26 no.3
      • /
      • pp.199-217
      • /
      • 2023
    • Affective characteristics have been consistently emphasized in mathematics education, but students' confidence or interest in mathematics has not changed significantly. This study analyzes the factors affecting the affective characteristics according to students' academic achievements, which have not been studied so far. The study was surveyed 593 students in the 5th and 6th grades, divided into school mathematics education and social-environmental factors. As a result of the study, students cited 'mathematics class at school' as the factor that had the most influence on their affective characteristics, regardless of academic achievement. Excluding 'mathematics classes at school', upper level students said that 'private education' and 'college entrance exams and jobs', had the most influence on their affective characteristics. Middle level students said that 'assessment at school' and 'private education' had the most influence on their affective characteristics. Lower-level students said that 'school evaluation' and 'mathematics textbook' had the most influence on the affective characteristics. In particular, as the academic achievement level decreased, students' participation in classes decreased rapidly. Most students said that the mathematics content they were learning was too difficult for that reason. Considering these research results, it would be effective to apply methods according to students' academic achievement to some extent in order to improve affective characteristics.

    Establishing and Operating Cohort Evaluation at Kosin University College of Medicine (고신대학교 의과대학 코호트 구축과 운영 사례)

    • Sejin Kim
      • Korean Medical Education Review
      • /
      • v.25 no.2
      • /
      • pp.114-118
      • /
      • 2023
    • Multiple cohorts (e.g., current students and graduates) were formed to collect information on the entire educational process from admission to graduation regarding students' educational performances at Kosin University College of Medicine. Data that had already been collected and analyzed by different committees for different purposes were grouped into a more systematic and comprehensive system called the cohort system, enabling the necessary data to be collected promptly and analyzed in accordance with the purpose of providing meaningful information in each area of the educational process. Therefore, comprehensive cohort data that can be used for mission statement revision, curriculum development and improvement, student counseling, and student selection were established and utilized. The cohort data were collected from performance evaluation indicators including self-evaluation surveys, evaluation tools for learning outcomes, academic achievement, results of the Korean Medical Licensing Examination, and career placement. Based on the results obtained by analyzing cohort data, a comprehensive cohort report has been published. The data analyzed through the cohort were reported to each committee and used in various ways. Currently, however, only some data have been analyzed and used. In the future, after complete data collection, the cohort data can be used as meaningful basic data for achieving the institution's mission and educational goals, developing and improving the curriculum, counseling students, and selecting students through the analysis of learning performance data from student admission to graduation and after graduation.

    A Study on IT Curriculum Evaluation for College Students

    • Kim, Heon Joo;Kim, Kyung-mi;Yi, Kang
      • Journal of the Korea Society of Computer and Information
      • /
      • v.27 no.10
      • /
      • pp.255-265
      • /
      • 2022
    • We compared and analyzed the factors affecting the lecture evaluation of IT subjects, which are mandatory for all students of H University. The purpose of this study is to determine whether lecture satisfaction has a significant correlation with academic achievement, attendance rate, and categories of courses. In this study, we check whether the lecture satisfaction of IT liberal arts subjects that require a lot of computer-based practice differs from that of other liberal arts subjects. We used the 2,149 evaluation data of 12 lectures submitted by 2,322 students in the first and second semesters of year 2019 at University H. As for the lecture evaluation results, in addition to the evaluation scores of the multiple choice questions, the subjective questions were also quantified by classifying the statements submitted by the students into positive and negative types to make the results of the lecture evaluation objective. Our research results show that student group who have the higher attendance rates and academic achievements have higher level of lecture satisfaction and they also use more positive words than negative words in subjective evaluation questions. Students with the lower score use the more negative words, but the ratio between positive and negative words does not differ between groups. Higher attendance rates groups in the basic programming courses and software applications courses have higher lecture satisfaction ratio. But in the intermediate programming courses, the higher attendances rate and the lecture satisfaction do not have any significant relationship. Also students in the intermediate programming courses use more negative words than those in the basic programming courses.

    A Study on the Improvement of the Effectiveness of Feedback of Government Performance Evaluation (정부업무평가의 환류 효용성 제고방안에 관한 연구)

    • Yuiryong Jung
      • The Journal of the Convergence on Culture Technology
      • /
      • v.10 no.3
      • /
      • pp.541-550
      • /
      • 2024
    • The aim of this study is to find a way to improve the effectiveness of feedback that can contribute to the development of government work evaluation through comparison of systems between Korea and the United States. To this end, this study compared and analyzed the cases of Korea and the United States in relation to the feedback system of political affairs evaluation. In the case of the United States, it was confirmed that it was linked to a relatively high level of the learning dimension of the feedback system of achieving and improving policy goals, while in Korea, such linkage was segmented and controlled. In the case of Korea, it was confirmed that the government work evaluation system was in power, and its purpose was to improve policies and to control the evaluation target rather than learning for it. In the case of the United States, it is noteworthy that the autonomy of its own ministries is guaranteed as much as possible, the clarity and achievement of the goals presented by the ministries are prioritized, and the feedback also has a support and learning system as a regular system, not an ex post system. It is necessary to focus on policy improvement that can be linked to the achievement of policy goals in government work evaluation. It is also necessary to take a quarterly monitoring system, but to transform the ex post evaluation system into a learning and supportive system that can achieve policy goals, not control.

    Study on the Quantification of Failure Rate for Safety-critical Fault-tolerant USN System (안전필수 결함허용 USN시스템의 고장률정량화에 관한 연구)

    • Shin, Duc-Ko;Shin, Kyung-Ho;Jo, Hyun-Jeong;Song, Yong-Soo
      • Proceedings of the KSR Conference
      • /
      • 2011.05a
      • /
      • pp.1414-1419
      • /
      • 2011
    • In this paper we study the modeling to quantitatively assess the failure rate of USN system designed for fault-tolerant architecture, aiming at applying the world's best domestic USN technology to safety-critical railways. In order to apply the USN system to the safety-critical field like a train control sector that the failures of controllers may cause severe railway accidents such as train collision and derailment, the quantitative reliability and safety evaluation recommended in IEC 62278 must be preceded. We also develop the evaluation model for overall system failure rate for the distributed network structure, which is the characteristics of USN system. Especially, we allocate reliability targets to component units, and present an availability evaluation plan through the plan on the quantitative achievement of failure rate for sensor nodes, gateways, radio-communication network and servers, along with the failure rate model of the overall system considering network operational features.

    • PDF

    (34141) Korea Institute of Science and Technology Information, 245, Daehak-ro, Yuseong-gu, Daejeon
    Copyright (C) KISTI. All Rights Reserved.