• The Mathematical Education
• /
• v.43 no.2
• /
• pp.151-162
• /
• 2004

For the past several years, performance assessment has been widely used by mathematics teachers. The superiority of performance assessment items compare to multiple choice items has been discussed by many researchers, however these discussions tend to be lack of empirical data. Thus, this study aims to examine the effectiveness of tree response items in comparison with multiple choice items. Using the information function in Item Response Theory(IRT), item information of free response items and multiple choice items from the Third International Mathematics and Science Study-Repeat(TIMSS-R) were obtained and compared. Test informations of the whole mathematics area as well as each content area of mathematics were computed. On average, tree response items yielded more information than multiple choice items, especially in measurement and data interpretation. This study also revealed that free response items estimated students' mathematics ability more accurately than multiple choice items with smaller number of items.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.122-131
• /
• 2002

Recently, performance assessment that makes growing use of free response items in a large scale assessment has been emphasized. This study is an empirical examination of the effectiveness of free response items in comparison with multiple choice items. Using the information function in Item Response Theory (IRT) framework, item information of free response items and multiple-choice items from the Third International Mathematics and Science Study-Repeat (TlMSS-R) were obtained. Test information of the whole science area as well as each area of science contents was computed. On average, free response items yielded more information than multiple choice items, especially in earth science, physics, chemistry, and life science. This study also showed that free response items were appropriate for students in high science ability. Also, free response items estimated students' science ability more accurately than multiple choice items with smaller number of free response items.

• International Journal of Contents
• /
• v.4 no.2
• /
• pp.19-23
• /
• 2008

This paper presents a novel method to construct a personalized e-Learning system based on dynamic estimations of item parameters and learners' abilities, where the learning content objects are of the same intrinsic quality or homogeneously distributed and the estimations are carried out using IRT(Item Response Theory). The system dynamically connects the test and the corresponding learning procedures. Test results are directly applied to estimate examinee's ability and are used to modify the item parameters and the difficulties of learning content objects during the learning procedure is being operated. We define the learning unit 'Node' as an amount of learning objects operated so that new parameters can be re-estimated. There are various content objects in a Node and the parameters estimated at the end of current Node are directly applied to the next Node. We offer the most appropriate learning Node for a person's ability throughout the estimation processes of IRT. As a result, this scheme improves learning efficiency in web-base e-Learning environments offering the most appropriate learning objects and items to the individual students according to their estimated abilities. This scheme can be applied to any e-Learning subject having homogeneous learning objects and unidimensional test items. In order to construct the system, we present an operation scenario using the proposed system architecture with the essential databases and agents.

• Korean Journal of Comparative Education
• /
• v.28 no.5
• /
• pp.1-19
• /
• 2018

The purpose of educational assessments such as the Trends in International Mathematics and Science Study (TIMSS) is to compare groups such as countries. When the unit of measurement is above the student level, group-level diagnostic assessment based on multilevel item response theory (ML-IRT) can be considered just as cognitive diagnosis models are developed from item response theory. This study suggests an ML-IRT-based group-level diagnostic assessment model by modifying an item feature model by Park and bolt (2008). The model is illustrated on the recently released TIMSS 2015 Grade 8 mathematics assessment. The results provide skill profiles for the studied countries and the nine cognitive attributes; that is, the attribute effects can be compared across the countries and also across the attributes. By controlling unexplained variance, the suggested model may provide more reliable and more informative group-level comparisons. The results are interpreted using an example. Limitations and directions for future research are also discussed.

• Physical Therapy Korea
• /
• v.20 no.3
• /
• pp.89-99
• /
• 2013

The purposes of this study were: 1) to show the item difficulty hierarchy of walking/moving construct of the International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM), 2) to evaluate the item-level psychometrics for model fit, 3) to describe the relevant physical activity defined by level of activity intensity expressed as Metabolic Equivalent of Tasks (MET), and 4) to explore what extent the empirical activity hierarchy of the ICF-AM is linked to the conceptual model based on the level of energy expenditure described as MET. One hundred and eight participants with lower extremity impairments were examined for the present study. A newly created activity measure, the ICF-AM using an item response theory (IRT) model and computer adaptive testing (CAT) method, has a construct on walking/moving construct. Based on the ICF category of walking and moving, the instrument comprised items corresponding to: walking short distances, walking long distances, walking on different surfaces, walking around objects, climbing, and running. The item difficulty hierarchy was created using Winstep software for 20 items. The Rasch analyses (1-parameter IRT model) were performed on participants with lower extremity injuries who completed the paper and pencil version of walking/moving construct of the ICF-AM. The classification of physical activity can also be performed by the use of METs that is often preferred to determine the level of physical activity. The empirical item hierarchy of walking, climbing, running activities of the ICF-AM instrument was similar to the conceptual activity hierarchy based on the METs. The empirically derived item difficulty hierarchy of the ICF-AM may be useful in developing MET-based activity measure questionnaires. In addition to convenience of applying items to questionnaires, implications of the finding could lead to the use of CAT method without sacrificing the objectivity of physiologic measures.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.321-327
• /
• 2013

Impaired naming difficulty is common in normal elderly as well as in patients with neurological impairment. The 60-item Korean version-Boston Naming Test(K-BNT) is one of the most commonly used test for measuring confrontational naming ability. However, age-related cognitive decline may make the elderly difficult concentrating during the 60-item test, therefore, item reduction of the K-BNT would improve test validity and reliability. Thus, the purpose of this study was to develop a short form of the K-BNT based on Item Response Theory(IRT). Considering item-fit index, sex factor, and item difficulty through Rasch analysis, the 15-item K-BNT(i.e., K-BNT-15) was developed. Via administration of the K-BNT-15, we observed age-related decline in naming ability and significantly different performance between the normal elderly and patients with mild cognitive impairment. This study demonstrates the utility of IRT for developing a short-form language evaluation tool. The K-BNT-15 can be effective as a language screening tool to differentiate between normal aging and pathological diseases.

• Psychiatry investigation
• /
• v.15 no.11
• /
• pp.1053-1063
• /
• 2018

Objective This study evaluated the psychometric properties of the Korean Anxiety Screening Assessment (K-ANX) developed for screening anxiety disorders. Methods Data from 613 participants were analyzed. The K-ANX was evaluated for reliability using Cronbach's alpha, item-total correlation, and test information curve, and for validity using focus group interviews, factor analysis, correlational analysis, and item characteristics based on item response theory (IRT). The diagnostic sensitivity and specificity of the K-ANX were compared with those of the Beck Anxiety Inventory (BAI) and Generalized Anxiety Disorder 7-item scale (GAD-7). Results The K-ANX showed excellent internal consistency (${\alpha}=0.97$) and item-total coefficients (0.92-0.97), and a one-factor structure was suggested. All items were highly correlated with the total scores of the BAI, GAD-7, and Penn State Worry Questionnaire. IRT analysis indicated the K-ANX was most informative as a screening tool for anxiety disorders at the range between 0.8 and 1.6 (i.e., top 21.2 to 5.5 percentiles). Higher sensitivity (0.795) and specificity (0.937) for identifying anxiety disorders were observed in the K-ANX compared to the BAI and GAD-7. Conclusion The K-ANX is a reliable and valid measure to screen anxiety disorders in a Korean sample, with greater sensitivity and specificity than current measures of anxiety symptoms.

• Proceedings of the Korean Statistical Society Conference
• /
• 2003.10a
• /
• pp.149-154
• /
• 2003

문항반응이론(item response theory, IRT)에서는 문항이 가지고 있는 특성을 기초로 피험 자의 능력을 추정 하고 동시 에 각 문항별 문항특성곡선(item characteristics curve; ICC)을 이용하여 문항모수를 추정하게 된다. 이러한 추정알고리즘은 이미 외국에서는 상용화되 어 활용되고 있는바, 국내 에서 개 발한 Any Assess의 활용 가능성을 모의 실험을 통하여 그 결과의 신뢰성을 검증해 보았다.

• Journal of Internet Computing and Services
• /
• v.11 no.2
• /
• pp.165-172
• /
• 2010

In Web-based learning systems, the techniques, as self-regulated learning, self-directed learning, are used to improve the effect of learner's study. These techniques are methods considering learner's study level but to consider the learner's study ability properly, the tailored course for learner should be applied. In this research, the learning system considering learner's study ability was proposed. To decide a learner's study ability, IRT(Item Response Theory) was applied and learning contents and question items were developed and applied by the degree of difficulty.

• Journal of the Korean Society for Library and Information Science
• /
• v.47 no.3
• /
• pp.296-320
• /
• 2013

The primary purpose of this study is to understand academic library service as a brand and a set of brand offerings. Based on previous studies, the study has built a classification of three distinctive perceptual aspects of library services; perceptual aspect of the service, experiential aspect of the service, and functional aspect of service. Eleven measurement items and 45 questions that are subject to the items are studied and employed from previous studies, each of the items were allocated through Item Response Theory (IRT) test and cluster analysis to filter in items of substantial contribution to the constructs as well as filtering out less contributable ones. The study shows there are 27 effective items to understand and measure library service as a brand.