Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지

Development of an Item Selection Method for Test-Construction by using a Relationship Structure among Abilities

  • Kim, Sung-Ho (Division of Applied Mathematics, KAIST) ;
  • Jeong, Mi-Sook (Hannam University, Part-time lecturer) ;
  • Kim, Jung-Ran (Statistical Training Center, National Institute of Professional Administration)
  • Published : 2001.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

When designing a test set, we need to consider constraints on items that are deemed important by item developers or test specialists. The constraints are essentially on the components of the test domain or abilities relevant to a given test set. And so if the test domain could be represented in a more refined form, test construction would be made in a more efficient way. We assume that relationships among task abilities are representable by a causal model and that the item response theory (IRT) is not fully available for them. In such a case we can not apply traditional item selection methods that are based on the IRT. In this paper, we use entropy as an uncertainty measure for making inferences on task abilities and developed an optimal item selection algorithm which reduces most the entropy of task abilities when items are selected from an item pool.

Keywords

References

  1. Paper presented at the 1989 NCME annual meeting An alternative methodology for creating parallel test forms using the IRT information function Ackerman,T.
  2. New Directions for Testing and Measurement. Measuring Achievement: Progress Over A Decade Validity on parole: How can we go straight? Cronbach,L.J.;William B.Schrader(ed.)
  3. Psychological Bulletin v.93 no.1 Construct validity: construct representation versus nomothetic span Embretson,S.
  4. Test Design: Developments in Psychology and Psychometrics Multicomponent latent trait models for test design Embretson,S.;Susan E. Embretson(ed.)
  5. Annuals Review of Psychology v.30 Personnel selection and classification systems Dunnette,M.C.;Borman,W.C.
  6. Applied Psychological Measurement v.1 Content validity, the source of my discontent Guion,R.M.
  7. Personnel Psychology v.31 Content validity in moderation Guion,R.M.
  8. American Psychologist v.30 The standard problem: Meaning and values in measurement and evaluation Messick,S.A.
  9. European Journal of Psychological Assessment v.10 no.1 Foundations of validity: Meaning and consequences in psychological assessment. Messick,S.A.
  10. Psychometrika v.59 no.4 Evidence and inference in educational assessment. Mislevy,R.J.
  11. Probabilistic Reasoning in Intelligence Systems: Networks of Plausible Inference Pearl,J.
  12. Applied Psychological Measurement v.17 A method for severely constrained item selection in adaptive testing Stocking,M.L.;Swanson,L.
  13. Applied Psychological Measurement v.17 A model and heuristi for solving very large item selection problems Swanson,L.;Stocking,M.L.
  14. Personnel Psychology v.30 Content-construct confusion Tenopyr,M.L.
  15. Biometrika v.70 no.3 Graphical and recursive models for contingency tables Wermuth,N.;Lauritzen,S.L.
  16. Graphical Moldels in Applied Multivariate Statistics Whittaker,J.