• Communications for Statistical Applications and Methods
• /
• v.7 no.2
• /
• pp.597-603
• /
• 2000

A versatile dimensionality assessment index DETECT has been developed for binary item response data by Kim (1994). The present paper extends the use of DETECT to the polytomously scored item data. A simulation study shows DETECT performs well in differentiating multidimensional data from unidimensional one by yielding a greater value of DETECT in the case of multidimensionality. An additional investigation is necessary for the dimensionally meaningful clustering methods, such as HAC for binary data, particularly sensitive to the polytomous data.

• Journal of Fisheries and Marine Sciences Education
• /
• v.27 no.6
• /
• pp.1546-1555
• /
• 2015

This study was performed to analyze the item characteristics of competency inventory for designer (CID), which Gil (2011) developed for measurement of design competency. To accomplish the purpose of this study, general partial credit (GPC) model based on polytomous item response theory was applied. The findings were as follows: First, CID is a reliable instrument for measuring design competency. Second, most items of CID have low item discrimination and average item difficulty according to the GPC model. Especially, there are some problems to have low item discrimination in view of validation. To improve the goodness of CID, we will need to examine why CID has low item discrimination.

• Journal of The Korean Association For Science Education
• /
• v.24 no.3
• /
• pp.519-531
• /
• 2004

In recent years, there has been an increased emphasis on performance assessment to evaluate students' abilities. Our nation has introduced a change in testing and assessment. Additional work on the efficacy, reliability, and comparability in order to develop the performance assessment item has been needed in the enforcement of the 7th National Science Curriculum. Also, criteria for professional and technical standards has been needed to be developed. The purpose of this study was to draw out various key concepts and to develop achievement standards, assessment standards and performance assessment items based on the 7th National Science Curriculum on the subject matter of reproduction(chapter 13) and biological accumulation(chapter 17). And also, this study examined the validity of completed performance assessment items based on classical test theory and polytomous item response theory. Twelve key concepts in chapter 13(reproduction) and four from chapter 17(biological accumulation) were abstracted. Twenty-six achievement standards in chapter 13(reproduction), and nine in chapter 17(biological accumulation) were developed. The achievement standards were determined in terms of knowledge(K), process skill(P) and attitude(A). Twenty-five assessment standards in chapter 13(reproduction) and nine in chapter 17(biological accumulation) were developed. Based on the developed achievement standards and assessment standards, twenty-two performance assessment items(seventeen open-ended questions, three essays, and two portfolios) with concrete grading criteria were developed. Eight open-ended items were applied to 240 10th graders to evaluate reliabilities of the test which consisted of four items per each chapter. The results would be suggested that the applied items were valid for performance assessment because item difficulties and item discriminations were proper. There was not much differences in item discrimination between interpretation from classical test theory and that from polytomous item response theory. However, there were some differences in item difficulties between the interpretations of two theories because the characteristics of examinees were reflected in classical test theory.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.122-131
• /
• 2002

Recently, performance assessment that makes growing use of free response items in a large scale assessment has been emphasized. This study is an empirical examination of the effectiveness of free response items in comparison with multiple choice items. Using the information function in Item Response Theory (IRT) framework, item information of free response items and multiple-choice items from the Third International Mathematics and Science Study-Repeat (TlMSS-R) were obtained. Test information of the whole science area as well as each area of science contents was computed. On average, free response items yielded more information than multiple choice items, especially in earth science, physics, chemistry, and life science. This study also showed that free response items were appropriate for students in high science ability. Also, free response items estimated students' science ability more accurately than multiple choice items with smaller number of free response items.

• Research in Vestibular Science
• /
• v.17 no.4
• /
• pp.152-159
• /
• 2018

Objectives: The Korean Dizziness Handicap Inventory (KDHI), which includes 25 patient-reported items, has been used to assess self-reported dizziness in Korean patients with Parkinson disease (PD). Nevertheless, few studies have examined the KDHI based on item-response theory within this population. The aim of our study was to address the feasibility and clinimetric properties of the KDHI instrument using polytomous Rasch measurement analysis. Methods: The unidimensionality, scale targeting, separation reliability, item difficulty (severity), and response category utility of the KDHI were statistically assessed based on the Andrich rating scale model. The utilities of the orderedresponse categories of the 3-point Likert scale were analyzed with reference to the probability curves of the response categories. The separation reliability of the KDHI was assessed based on person separation reliability (PSR), which is used to measure the capacity to discriminate among groups of patients with different levels of balance deficits. Results: Principal component analyses of residuals revealed that the KDHI had unidimensionality. The KHDI had satisfactory PSR and there were no disordered thresholds in the 3-point rating scale. However, the KDHI showed several issues for inappropriate scale targeting and misfit items (items 1 and 2) for Rasch model. Conclusions: The KDHI provide unidimensional measures of imbalance symptoms in patients with PD with adequate separation reliability. There was no statistical evidence of disorder in polytomous rating scales. The Rasch analysis results suggest that the KDHI is a reliable scale for measuring the imbalance symptoms in PD patients, and identified parts for possible amendments in order to further improve the linear metric scale.

• Journal of The Korean Association For Science Education
• /
• v.36 no.2
• /
• pp.295-302
• /
• 2016

In this study, we investigated a learning progression focusing on $5^{th}$ to $9^{th}$ graders' performances with dissolution and solution concepts using the construct modeling approach. We designed a construct map describing hypothetical pathways of the concept development of dissolution and solution by analyzing both National Science Curricula and related studies. A conceptions test consisting of ordered multiple-choice items was developed and administered to 826 students. A revised construct map was derived from analyses of the results based on the partial credit model, a branch of polytomous item response theory. The sequence of dissolution and solution concepts presented in the current science curriculum was found to correspond with the learning progression of the students. However, the lower anchor, the concept of the homogeneity of particles in solution, and the factors affecting solubility were not consistent with the expected levels of the construct map. After revising the construct map, we proposed a learning progression for dissolution and solution concepts with five levels: Students of level 1 (the lower anchor) recognize the particles in the solution but misunderstand various concepts; Students of level 2 understand the homogeneity of particles in solution; Students of level 3 understand solubility and the conservation of particles during dissolution; Students of level 4 partially understand the interaction between particles; and Students of level 5 (the upper anchor) understand the interaction between particles and the factors affecting solubility.