• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• The Mathematical Education
• /
• v.61 no.4
• /
• pp.581-595
• /
• 2022

The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

• Communications of Mathematical Education
• /
• v.16
• /
• pp.201-215
• /
• 2003

이 연구에서는 창의적인 문제해결능력을 검사하는 도구로 널리 알려진 개방형 문항 5 문제를 수정 또는 번역하여 중학교 2학년 학생들에게 적용하고 그 결과를 분석하였다. 검사도구에 대한 양호도 분석 결과는 다음과 같다. 첫째, 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수는 0.8이다. 둘째, 문항반응이론에 근거한 문항의 적합도 지수는 모두 1.2미만으로서 분석모형에 적합한 문항이라고 볼 수 있다. 또한, 문항간의 난이도의 차이는 로짓트 점수가 0.6을 넘지 않은 범위에서 골고루 분포되어 있다. 셋째, 문항 신뢰도 지수가 모두 0.80보다 높은 것으로 나타나 사용된 문항들은 서로 잘 분리되어 창의적 문제해결력을 추정하고 변별하는데 무리가 없다. 학생들의 반응에 대한 분석 결과는 다음과 같다. 문항1에서 곡선을 이용한 반응은 영재학생들에서만 발견할 수 있었다. 문항2에 대한 각 반응의 독창성 점수는 모두 0이다 이것은 문항2가 널리 알려진 문제에 기인한 것으로 해석된다. 문항3은 영재학생들이 더 많은 반응을 보인 것으로 모든 반응이 독창성 점수를 부여받았다. 문항4에 대하여 일반학생들은 거의 반응을 하지 못하였다. 문항5는 대부분의 학생이 반응을 하였으며 반응의 종류도 가장 다양하였다.

• Journal of the Korean School Mathematics Society
• /
• v.24 no.4
• /
• pp.407-428
• /
• 2021

This study compares and analyzes the mathematics assessment items of the middle school's national-level academic achievement tests in Korea and Japan, recently revised as a competency-focused curriculum. By comparing and analyzing the assessment items in each country, the analytic framework is integrated into content areas, contexts, and competencies. The characteristics of each country's assessment items developed for each content area were analyzed using the framework. We suggested some implications on developing and improving national-level academic assessment items.

• Journal of the Korean School Mathematics Society
• /
• v.20 no.3
• /
• pp.325-344
• /
• 2017

Since PISA2006, the computer based assessment in mathematics(CBAM) was introduced for the first times and at last PISA2015 used all items in CBAM for problem solving. In this study, we focused on which important properties were considered in constructing geometric 'fence items' used in PISA 2015 to find the future direction over our teacher education, especially for constructing 'computer based assessment items.' For the purpose of the study, we analyzed the fence items on three components such as dependency, invariant, and path found in dragging activities, within a computer environment using the dynamic Geometry Software, GSP. Also, for the future, we provided an open-ended problem related to the fence items, which we could use as the merit of computer-based environment.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.4
• /
• pp.39-49
• /
• 2007

The purpose of this study is to provide analysis resources to develop high standard questions by analyzing item characteristics and item usability of 'Basic course of Information Technology' in the College Scholastic Ability Test, For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty, item discrimination, item reliability, and distracters. As a result of analyzing tests in 2005 and 2006, questions were equally extracted from educational contents. However, the standard of questions were in need of revision. The development of high quality contents in Vocational Education Section was needed in order to meet to the College Scholastic Ability Test standards. Therefore, it is required to develop various difficulties and acceptable distinguishable questions.

• Communications for Statistical Applications and Methods
• /
• v.1 no.1
• /
• pp.192-205
• /
• 1994

본 논문에서는 피험자의 능력과 검사문항에 정답할 확률과의 관계에 기초한 문항반응 이론의 기본 가정과 통계적 모형을 소개하였다. 또한 검사의 목적상 필요한 피험자의 능력을 정확히 추정하는 방법과, 검사에 사용되는 각 문항을 특성지우는 문항모수의 여러가지 통계적 추정 방법에 대하여 정리하였다. 그 방법들은 결합 최우추정법, 조건부 최우추정법, 주변 최우추정법, 베이지안 추정법 및 이들의 혼합에 의한 방법이다. 문항반응이론의 적용의 한 예로서 93년도 대입학력고사의 수학 시험문항을 BILOG 라는 컴퓨터 프로그램을 이용하여 분석하였다.

• Journal of the Korean School Mathematics Society
• /
• v.23 no.4
• /
• pp.469-489
• /
• 2020

Middle school students are known to have high levels of math anxiety. According to the need for test tools that reflect the characteristics of today's middle school students, it was intended to develop a mathematical anxiety test for middle school students. Sub-factors of mathematical anxiety were established based on prior research and questions corresponding to each factor were produced. The suitability and validity of the questions were analyzed through two pilot tests. Then some of the questions were revised. This test was conducted on 255 middle school students using the revised questions, and the validity and reliability of the test tools were analyzed on 246 student responses. The final developed test tool consisted of 6 sub-factors and a total of 36 questions, and was intended to provide students, teachers, and parents with information about students' mathematical anxiety by providing criteria for the degree of anxiety.

• School Mathematics
• /
• v.9 no.2
• /
• pp.223-240
• /
• 2007

The purpose of this study was to investigate the degree to which the middle school mathematics curriculum matched the item difficulty levels of representative mathematics items. The items used in this study were developed for the National Assessment of Educational Achievement. Ranks for difficulty values of the 60 multiple-choice item were calculated via both Classical Test Theory and Item Response Theory and correlated with the rank order of the mathematics content and cognitive domains sequence. There are six content domains; number and operation, algebra, measurement, figure, pattern and function, and probability and statistics. The cognitive domains include computation, understanding, reasoning and problem-solving. Results suggest a congruence between cognitive domain's sequence and item difficulty levels of items based on that sequence. This finding indicates that the linear or hierarchical assumptions concerning the sequence appears to be reasonable. The characteristics of items that were exceptions to this trend were addressed.

• Journal of the Korean School Mathematics Society
• /
• v.24 no.3
• /
• pp.261-282
• /
• 2021

This study identified the meaning of mathematical justification and its characteristics for middle school math gifted students. 17 middle school math gifted students participated in questionnaires and written exams. Results show that the gifted students recognized justification in various meanings such as proof, systematization, discovery, intellectual challenge of mathematical justification, and the preference for deductive justification. As a result of justification exams, there was a difference in algebra and geometry. While there were many deductive justifications in both algebra and geometry questionnaires, the difference exists in empirical justifications: there were many empirical justifications in algebra, but there were few in geometry questions. When deductive justification was completed, the students showed satisfaction with their own justification. However, they showed dissatisfaction when they could not deductively justify the generality of the proposition using mathematical symbols. From the results of the study, it was found that justification education that can improve algebraic translation ability is necessary so that gifted students can realize the limitations and usefulness of empirical reasoning and make deductive justification.