• English Language & Literature Teaching
• /
• 제16권4호
• /
• pp.153-184
• /
• 2010

On the bases of the 5 principles and the 4 criteria for designing and developing of the listening and the reading test of National English Ability Test (NEAT), this study presents Item-Types Decision-Making Model as a blueprint for designing and constructing the two tests. It sets up the criteria for validating item types, designs a modular type of test specifications, constructs an item-types bank, and specifies a complementary type of test specifications of the two tests. To gather all these threads up, it constructs Item-Types Decision-Making Model which consists of such components as the item-type pool, the validity criteria and the procedures of testing item types, the item-types bank, the modular and the complementary type test specification. Thus, it shows how the Model works in developing and constructing the two level-differentiated listening and reading tests (the 2nd and the 3rd rank) of NEAT. Finally, it discusses some implications and applications of the Model to the two level-differentiated tests (the A and the B type) of 2014 CSAT (College Scholastic Ability Test) systems, National Assessment of Educational Achievement (NAEA), and classroom testing. In conclusion, Item-Types Decision-Making Model functions as a testing template in an item development system and as a matrix in an item-types bank system.

• Analyses & Alternatives
• /
• 제5권1호
• /
• pp.3-24
• /
• 2021

This paper introduces a multilevel item-response-theory (IRT) model as a unifying model for hypothesis testing using legislative voting data. This paper shows that a probit or logit model is a special type of multilevel IRT model. In particular, it is demonstrated that, when a probit or logit model is applied to multiple votes, it makes unrealistic assumptions and produces incorrect coefficient estimates. The advantages of a multilevel IRT model over a probit or logit model are illustrated with a Monte Carlo experiment and an example from the U.S. House. Finally, this paper provides a practical guide to fitting this model to legislative voting data.

• Journal of Fisheries and Marine Sciences Education
• /
• 제27권6호
• /
• pp.1546-1555
• /
• 2015

This study was performed to analyze the item characteristics of competency inventory for designer (CID), which Gil (2011) developed for measurement of design competency. To accomplish the purpose of this study, general partial credit (GPC) model based on polytomous item response theory was applied. The findings were as follows: First, CID is a reliable instrument for measuring design competency. Second, most items of CID have low item discrimination and average item difficulty according to the GPC model. Especially, there are some problems to have low item discrimination in view of validation. To improve the goodness of CID, we will need to examine why CID has low item discrimination.

• Journal of Distribution Science
• /
• 제18권3호
• /
• pp.25-36
• /
• 2020

Purpose: Based on previous researches on social factors of digital item purchase in digital contents distribution platforms such as SNS, we aim to develop the integrated model that accounts for the dynamic and interactive relationship between social structure indicators and digital item purchase. Research design, data and methodology: A PVAR model was used to capture endogenous and dynamic relationships between digital item purchase and network indicators. Results: We find that there exist considerable endogenous and dynamic relationships between digital item purchase and network structure variables. Not only lagged in-degree and out-degree but also in-closeness and out-closeness centrality have significant and positive impacts on digital item purchase. Lagged clustering has a significant and negative effect on digital item purchase. Lagged purchase has a significant and positive impact just on the present in-closeness and out-closeness centrality; but there is no significant effect of lagged purchase on the other two degree variables and clustering coefficient. We also find that both closeness centralities have much higher carryover effect on digital item purchase and that the elasticity of both closeness centralities on the purchase of digital items is even higher than that of other network structure variables. Conclusions: In-closeness and out-closeness are the most influential factors among social structure variables of this study on digital item purchase.

• Physical Therapy Korea
• /
• 제21권4호
• /
• pp.56-66
• /
• 2014

For maintaining adequate psychometric properties when reducing the number of items from an instrument, item level psychometrics is crucial. Strategies such as low item correlation or factor loadings, using classical test theory, have traditionally been advocated. The purpose of this study is to describe the development of a new short form assessing the impact of low back pain on physical activity. Rasch measurement model has been applied to the International Classification of Functioning, Disability and Health Activity Measure (ICF-AM). One hundred and one individuals with low back pain aged 19-89 years (mean age: $48.1{\pm}17.3$) who live in the community were participated in the study. Twenty-seven items of lifting/carrying construct of the ICF-AM were analyzed. Ten items were selected from the construct to create a short form. Item elimination criteria include: 1) high or low mean square (out of the range: .6-1.4 for the fit statistics), 2) similar item calibrations to adjacent items, 3) person separation value, and item-person map for potential gap in person ability continuum. All 10 items of the short form fit to the Rasch model except one item (i.e., carrying toddler on back). Despite its high infit and outfit statistics (1.90/2.17), the item had to be reinstated due to potential gaps at the upper extreme of person ability level. The short form had a slightly better spread of person ability continuum compared to the entire set of item. The created short form separated individuals with low back pain into nearly 4 groups, while the entire set of items separated the individuals into 6 groups. The findings prompted multidimensional models for better explanation of the lifting/carrying domain. The item level psychometrics based on the Rasch model can be useful in developing short forms with rationally retained items.

• Educational Technology International
• /
• 제23권2호
• /
• pp.157-181
• /
• 2022

Scale scores for cognitive domains have been used as an important indicator for both academic achievement and clinical diagnosis. For example, in education, Cognitive Abilities Test (CogAT) has been used to measure student's capability in academic learning. In a clinical setting, Cognitive Impairment Screening Test utilizes items measuring cognitive ability as a dementia screening test. We demonstrated a procedure of generating cognitive ability test items similar as in CogAT but the theory associated with the generation is totally different. When creating cognitive test items, we applied automatic item generation (AIG) that reduces errors in predictions of cognitive ability but attains higher reliability. We selected two cognitive ability test items, categorized as a time estimation item for measuring quantitative reasoning and a paper-folding item for measuring visualization. As CogAT has widely used as a cognitive measurement test, developing an AIG-based cognitive test items will greatly contribute to education field. Since CLASS is the only LMS including AIG technology, we used it for the AIG software to construct item models. The purpose of this study is to demonstrate the item generation process using AIG implemented within CLASS, along with proving quantitative and qualitative strengths of AIG. In result, we confirmed that more than 10,000 items could be made by a single item model in the quantitative aspect and the validity of items could be assured by the procedure based on ECD and AE in the qualitative aspect. This reliable item generation process based on item models would be the key of developing accurate cognitive measurement tests.

• Journal of Korean Society for Quality Management
• /
• 제20권2호
• /
• pp.33-43
• /
• 1992

Items are assumed to fail by degradation. An appropriate stochastic model of such item is a cumulative process in which an item can fail only when the total amount of wear exceeds a prespecified failure level. This paper presents replacement policy in which an item is replaced at a certain level of wear before failure or at failure, whichever occurs first. Yet, when measuring the item wear level is very expensive, destructive or time-consuming, it may be economical to use substitutive characteristics that are correlated with the item wear level and relatively inexpensive to measure. The item's wear level could usually be estimated by monitoring such substitutive characteristics only except for a breakdown, which may be observed immediately at its occurrence. The purpose of this paper is to find an optimal periodic replacement policy based on such substitutive characteristics that balance the cost of replacement with the cost of failure and result in a minimum total long-run average cost per unit time. The optimal level of substitutive characteristics to replace the item is obtained. Numerical example illustrate how the model can be used to determine the optimal replacement policy.

• The Mathematical Education
• /
• 제61권4호
• /
• pp.581-595
• /
• 2022

The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

• Physical Therapy Korea
• /
• 제20권3호
• /
• pp.89-99
• /
• 2013

The purposes of this study were: 1) to show the item difficulty hierarchy of walking/moving construct of the International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM), 2) to evaluate the item-level psychometrics for model fit, 3) to describe the relevant physical activity defined by level of activity intensity expressed as Metabolic Equivalent of Tasks (MET), and 4) to explore what extent the empirical activity hierarchy of the ICF-AM is linked to the conceptual model based on the level of energy expenditure described as MET. One hundred and eight participants with lower extremity impairments were examined for the present study. A newly created activity measure, the ICF-AM using an item response theory (IRT) model and computer adaptive testing (CAT) method, has a construct on walking/moving construct. Based on the ICF category of walking and moving, the instrument comprised items corresponding to: walking short distances, walking long distances, walking on different surfaces, walking around objects, climbing, and running. The item difficulty hierarchy was created using Winstep software for 20 items. The Rasch analyses (1-parameter IRT model) were performed on participants with lower extremity injuries who completed the paper and pencil version of walking/moving construct of the ICF-AM. The classification of physical activity can also be performed by the use of METs that is often preferred to determine the level of physical activity. The empirical item hierarchy of walking, climbing, running activities of the ICF-AM instrument was similar to the conceptual activity hierarchy based on the METs. The empirically derived item difficulty hierarchy of the ICF-AM may be useful in developing MET-based activity measure questionnaires. In addition to convenience of applying items to questionnaires, implications of the finding could lead to the use of CAT method without sacrificing the objectivity of physiologic measures.

• Journal of the Korean Operations Research and Management Science Society
• /
• 제36권3호
• /
• pp.91-105
• /
• 2011

In this paper, we analyze a logistic system involving a supplier who produces and delivers multiple types of items and a buyer who receives and sells the products to end customers. The buyer controls the inventory level by replenishing each product item up to a given order-up-to-level to cope with stochastic demand of end customers. In response to the buyer's order, the supplier produces or outsources the ordered item and delivers them at the start of each period. For the system described above, a mathematical model for a single type of item was developed from the buyer's perspective. Based on the model, an efficient method to find the cycle length and safety factor which correspond to a local minimum solution is proposed. This single product model was extended to cover a multiple item situation. From the model, algorithms to decide the base cycle length and order interval of each item were proposed. The results of the computational experiment show that the algorithms were able to determine the global optimum solution for all tested cases within a reasonable amount of time.