• Korean Journal of Comparative Education
• /
• v.28 no.5
• /
• pp.1-19
• /
• 2018

The purpose of educational assessments such as the Trends in International Mathematics and Science Study (TIMSS) is to compare groups such as countries. When the unit of measurement is above the student level, group-level diagnostic assessment based on multilevel item response theory (ML-IRT) can be considered just as cognitive diagnosis models are developed from item response theory. This study suggests an ML-IRT-based group-level diagnostic assessment model by modifying an item feature model by Park and bolt (2008). The model is illustrated on the recently released TIMSS 2015 Grade 8 mathematics assessment. The results provide skill profiles for the studied countries and the nine cognitive attributes; that is, the attribute effects can be compared across the countries and also across the attributes. By controlling unexplained variance, the suggested model may provide more reliable and more informative group-level comparisons. The results are interpreted using an example. Limitations and directions for future research are also discussed.

• Communications of Mathematical Education
• /
• v.18 no.2 s.19
• /
• pp.239-250
• /
• 2004

수학적 힘의 함양과 문제해결력의 신장을 위한 수학교육에서 확률영역은 중요한 학습소재임에도 불구하고, 확률영역은 어려운 것으로 고착되었다. 이 연구에서는 학생들이 확률영역의 어떤 부분을 어려워하고 이해하기 힘들어하는지를 구체적 문항분석을 통하여 알아봄으로서 교수-학습의 기초자료를 제공하고자한다. 이를 위하여, 지난 10년간 출제되었던 대학수학능력시험의 확률영역 16문항을 고등학교 학생 220명에게 실시하고, 고전검사이론과 문항반응이론울 적용하여 그 결과를 분석하였다. 고전검사이론에서는 신뢰도와 변별도를 측정하였고, 문항반응이론에서는 Rasch 1-모수 문항반응모형에 근거한 BIGSTEP을 사용하여 내적타당도와 난이도를 측정하였다.

• Journal of Digital Convergence
• /
• v.17 no.5
• /
• pp.385-390
• /
• 2019

This study aimed to identify the model fit of various versions of Performance Enhancement Attitude Scale (PEAS) developed for measuring quantitatively the attitude toward doping and to provide the information on Korean version of PEAS. One hundred and eighty elite athletic players participated in this study and they filled out 17 items PEAS under the supervision. And 17 items, 11 items, 9 items, 8 items and 6 items PEAS were analyzed by using confirmatory factor analysis. The result of this study showed that an 8 items PEAS was fit for Korean elite athletic players, and a 6 items PEAS was for adolescents, but insignificant. Therefore, further studies of the relationship between psychosocial factors and attitudes toward doping by using 8-items PEAS would provide precise and useful information for developing anti-doping strategy.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• 재활복지
• /
• v.21 no.2
• /
• pp.169-190
• /
• 2017

The purpose of this study was to investigate item goodness-of-fit of Scale, Rasch rating scale model was applied to 5 dimensions 24 items of the Test of Performance Strategies (TOPS) in a sample of athletes with physical disabilities (n=215). An assumption to test Rasch Model, which is satisfaction of unidimensionality, is regarded through PCAR test, and WINSTEPS 3.65 program is used to test the goodness-of-fit of items. The results of this study were: First, 3-point rating category was appropriate for the TOPS instead of the existing 5-point rating category. Second, as a result of analyzing the goodness-of-fit of the items, 21 items of the TOPS were suitable, but 3 items were not. Third, the item reliability of person separation of the TOPS was acceptable, but the person reliability of item separation was not suitable and it was necessary to adjust the item order considering the difficulty level of the items. Fourth, as a result of comparing the individual attribute score and the difficulty level through the Item-Person Map, the distribution of the item difficulty distribution was shown to be biased in some factors compared to the personal attribute score distribution.

• Communications of Mathematical Education
• /
• v.19 no.1 s.21
• /
• pp.321-323
• /
• 2005

본 연구에서는 2004년 11월에 시행된 '2005학년도 대학수학능력시험 수리영역 가형' 의 문항을 분석하였다. 즉, 2-모수 문항 반응 모형에 근거한 베이지안(Bayesian) 1.0을 이용하여 문항의 난이도 및 변별도를 측정하였으며 고전검사이론 프로그램임 테스트안(Testan) 1.0을 이용하여 문항의 신뢰도 및 오답지 매력도를 구하였다. 이 결과는, 학생들이 어느 단원을 어려워하고 어떤 내용을 이해하지 못 하는지 그 원인을 찾을 수 있으므로, 교수-학습의 기초 자료로 활용할 수 있을 것이다.

• Communications of Mathematical Education
• /
• v.16
• /
• pp.201-215
• /
• 2003

이 연구에서는 창의적인 문제해결능력을 검사하는 도구로 널리 알려진 개방형 문항 5 문제를 수정 또는 번역하여 중학교 2학년 학생들에게 적용하고 그 결과를 분석하였다. 검사도구에 대한 양호도 분석 결과는 다음과 같다. 첫째, 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수는 0.8이다. 둘째, 문항반응이론에 근거한 문항의 적합도 지수는 모두 1.2미만으로서 분석모형에 적합한 문항이라고 볼 수 있다. 또한, 문항간의 난이도의 차이는 로짓트 점수가 0.6을 넘지 않은 범위에서 골고루 분포되어 있다. 셋째, 문항 신뢰도 지수가 모두 0.80보다 높은 것으로 나타나 사용된 문항들은 서로 잘 분리되어 창의적 문제해결력을 추정하고 변별하는데 무리가 없다. 학생들의 반응에 대한 분석 결과는 다음과 같다. 문항1에서 곡선을 이용한 반응은 영재학생들에서만 발견할 수 있었다. 문항2에 대한 각 반응의 독창성 점수는 모두 0이다 이것은 문항2가 널리 알려진 문제에 기인한 것으로 해석된다. 문항3은 영재학생들이 더 많은 반응을 보인 것으로 모든 반응이 독창성 점수를 부여받았다. 문항4에 대하여 일반학생들은 거의 반응을 하지 못하였다. 문항5는 대부분의 학생이 반응을 하였으며 반응의 종류도 가장 다양하였다.

• Journal of Educational Research in Mathematics
• /
• v.14 no.1
• /
• pp.71-88
• /
• 2004

The purpose of this study was to examine particular variables that play a significant role in the difficulty of math test items in College Scholastic Ability Test (CSAT). The study also aimed to develop a model of measuring the item difficulty. Variables correlated to item difficulty were drawn from the review of the related literature and the analysis of the content and difficulty of the past test items of CSAT. The first instrument was designed by using the correlated variables. According to the results of correlation analysis, the second instrument was made by deleting the variables which showed relatively low correlation with item difficulty and by refining some variables. Several models were proposed by using the revised instrument. The comparison of the R square and cross validity of each model reveals that integrated regression model was the most stable and accurate among the proposed models. The study also showed that statistically significant predictors were choice format, content domain, behavior domain, and the degree of item familiarity in the order of proportion of variance accounted by the predictors. Despite the limited scope of the present research, it can be suggested that its findings provide useful insights into predicting math test item difficulty.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• Journal of Korean Home Economics Education Association
• /
• v.19 no.3
• /
• pp.149-168
• /
• 2007

The purpose of this study was to analyze the home economics education items in the teacher recruitment examination for secondary school. To achieve the purpose, all the home economics education items, which were carried out for seven times from the school year 2001 to the most recent year 2007, were compared and analyzed. The form of items was analyzed by frequency and rate. Behavioral domain of items was analyzed by content analysis. In this study, some recommendations were suggested for the quality of home economics education items through discussion of science education and society education items, which were abstracted from the school year 2001 to the most recent year 2007. The results of this study were as follows. First, the score ratio of home economics education items was fluid as 20-30% from the school year 2001 to 2004 but it fixed as 30-35% since the school year 2005. In subcategory of home economics education, curriculum items accounted for highest ratio(43%). In the next thing, items of teaching-learning method(35%), evaluation(19%) and philosophy(3%) related to home economics education were followed in order. Second, the form of home economics education items was coexistent form of single item and subordinate item from the school year 2001 to 2004. But it was changed into form of single item by 100% since the school year 2005. Third, regarding the content of home economics education items, most of the curriculum items were related to the content of the 7th National Curriculum. Teaching-learning method items were taken mostly from model of teaching-learning. Evaluation items were taken mostly from performance assessment. Philosophy items related to home economics education were taken only from Habermas's three systems of action on the school year 2005. Fourth, about behavioral domain of home economics education items, most of the curriculum items were level of 'simple knowledge or memory'. Therefore, it was suggested that behavioral domain of curriculum items had to be changed into 'complex knowledge or comprehension and application'. The behavioral domain of teaching-learning method items and education evaluation items was mostly 'complex knowledge or comprehension and application'. However, to bettering the items it was suggested that the behavioral domain of them has to be changed 'comprehension' into more 'application'. Fifth, regarding the coverage of home economics education items, curriculum items were limited only superficial content of the 7th National Curriculum. Therefore, it was suggested that coverage of curriculum items had to be extended to theoretical content, which was philosophical background and various principles of curriculum. It was suggested that coverage of teaching-learning method items had to be extended to the content including various teaching-learning theories and the practical reasoning home economics instruction proved effective as home economics instruction recently. Evaluation items were taken mostly from performance assessment. Therefore, it was suggested that coverage of evaluation items had to be extended to analysis of evaluation result, item validity and reliability, and evaluator's philosophical perspective.