• Title/Summary/Keyword: Item response theory

Search Result 99, Processing Time 0.023 seconds

Development of Estimation Algorithm of Latent Ability and Item Parameters in IRT (문항반응이론에서 피험자 능력 및 문항모수 추정 알고리즘 개발)

  • Choi, Hang-Seok;Cha, Kyung-Joon;Kim, Sung-Hoon;Park, Chung;Park, Young-Sun
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.3
    • /
    • pp.465-481
    • /
    • 2008
  • Item response theory(IRT) estimates latent ability of a subject based on the property of item and item parameters using item characteristics curve(ICC) of each item case. The initial value and another problems occurs when we try to estimate item parameters of IRT(e.g. the maximum likelihood estimate). Thus, we propose the asymptotic approximation method(AAM) to solve the above mentioned problems. We notice that the proposed method can be thought as an alternative to estimate item parameters when we have small size of data or need to estimate items with local fluctuations. We developed 'Any Assess' and tested reliability of the system result by simulating a practical use possibility.

Analysis of the Characteristics of Multiple-Choice Test Items Used in Integrated Science Assessment: Focused on the Case of Four High School (융합형 '과학' 평가에 사용된 선다형 문항의 특성 분석 : 4개 고등학교의 사례)

  • Lee, Ki-Young;Cho, Hee-Hyung;Kwon, Suk-Min;Kim, Hee-Kyong;Yoon, Heesook
    • Journal of Science Education
    • /
    • v.37 no.2
    • /
    • pp.278-293
    • /
    • 2013
  • The purpose of this study was to analyze the characteristics of multiple-choice test items used in assessment of high school integrated science according to 2009 revised curriculum. For the analysis of the tendency of item setting, we devised an analytic framework specific to integrated science, and analyzed the characteristics of items by applying the devised framework and item response theory. The results of the tendency of item setting revealed that most of items run counter to the intent of integrated science in terms of item resource, integration extent, and cognitive level, which means teachers are stick to separative method in teaching-learning and assessment of integrated science. The results of the analysis applying item response theory showed that item difficulty was appropriate and item discrimination was considerably high. However, there was no relevance between the tendency of item setting and qualitative characteristics of the items. We also discussed some agendas to improve the teaching-learning and assessment of integrated science based on the results of this study.

  • PDF

Introducing an Online Measurement System Using Item Response Theory and Computer Adaptive Testing Methods for Measuring the Physical Activity of Community-Dwelling Frail Older Adults

  • Choi, Bong-sam
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.106-114
    • /
    • 2019
  • Background: It is difficult to assess whether community-dwelling frail older adults may remain pre-frail status or improve into a robust state without being directly checked by health care professionals. The health information perceived by older adults is considered to be one of best sources of potential concerns in older adult population. An online measurement system combined with item response theory (IRT) and computer adaptive testing (CAT) methods is likely to become a realistic approach to remotely monitor physical activity status of frail older adults. Objects: This article suggests an approach to provide a precise and efficient means of measuring physical activity levels of community-dwelling frail older adults. Methods: Article reviews were reviewed and summarized. Results: In comparison to the classical test theory (CTT), the IRT method is empirically aimed to focus on the psychometric properties of individual test items in lieu of the test as a whole. These properties allow creating a large item pool that can capture the broad range of physical activity levels. The CAT method administers test items by an algorithm that select items matched to the physical activity levels of the older adults. Conclusion: An online measurement system combined with these two methods would allow adequate physical activity measurement that may be useful to remotely monitor the activity level of community-dwelling frail older adults.

Psychological Well-being Measurement: A Comparative Study of Korean and American Adults

  • An Jeong-shin;Lambert Michael C.;Han Gyoung-hae;Cha Seung-eun
    • International Journal of Human Ecology
    • /
    • v.5 no.2
    • /
    • pp.13-29
    • /
    • 2004
  • Ryff's(1989) psychological well-being measure is used to assess and sometimes compare Korean and American adults, however, there is no information regarding whether its dimensions are psychometrically invariant across, whether its items provide sufficient information for, and whether each item measures identical trait levels in, the two nations. Confirmatory factor analysis on response 1,696 Korean and 3,669 American adults, gave to the measure revealed lack of fit and absence of factorial invariance across the two nations. Item response theory revealed significant variance for items on each factor across two countries that most items yielded limited psychometric information. And that each item measure different trait levels, suggesting that in its present form, the measure might lead to misleading results for, and across the two nations.

Design and Implementation of Diagnostic Module for Web based Tutoring System using Item Response Theory (문항 반응 이론을 이용한 웹기반 교수 시스템의 진단 모듈의 설계 및 구현)

  • Lee, Chul-Hwan;Han, Sung-Gwan
    • Journal of The Korean Association of Information Education
    • /
    • v.5 no.2
    • /
    • pp.268-278
    • /
    • 2001
  • This study is design and implementation of diagnosis module using item response theory to assess level of student's knowledge in web-based instruction systems. Item response theory uses responses to items on a test or survey questionnaire to simultaneously locate both the items on the latent trait defined by the set of items while simultaneously scaling each item on the very same dimension. Existing method of measurement in web-based instruction system provided dichromatic learning after to be assess just with the total scores of exam. This measurement has an error that do not consider the level of student's knowledge. Moreover, this method can't perform an exact diagnosis of student knowledge and make student modeling to construct intelligent tutoring system. In this study, we present that design and implement a diagnosis module using item response theory to assess level of student's knowledge in web-based instruction systems

  • PDF

A Structure of Personalized e-Learning System Using On/Off-line Mixed Estimations Based on Multiple-Choice Items

  • Oh, Yong-Sun
    • International Journal of Contents
    • /
    • v.5 no.1
    • /
    • pp.51-55
    • /
    • 2009
  • In this paper, we present a structure of personalized e-Learning system to study for a test formalized by uniform multiple-choice using on/off line mixed estimations as is the case of Driver :s License Test in Korea. Using the system a candidate can study toward the license through the Internet (and/or mobile instruments) within the personalized concept based on IRT(item response theory). The system accurately estimates user's ability parameter and dynamically offers optimal evaluation problems and learning contents according to the estimated ability so that the user can take possession of the license in shorter time. In order to establish the personalized e-Learning concepts, we build up 3 databases and 2 agents in this system. Content DB maintains learning contents for studying toward the license as the shape of objects separated by concept-unit. Item-bank DB manages items with their parameters such as difficulties, discriminations, and guessing factors, which are firmly related to the learning contents in Content DB through the concept of object parameters. User profile DB maintains users' status information, item responses, and ability parameters. With these DB formations, Interface agent processes user ID, password, status information, and various queries generated by learners. In addition, it hooks up user's item response with Selection & Feedback agent. On the other hand, Selection & Feedback agent offers problems and content objects according to the corresponding user's ability parameter, and re-estimates the ability parameter to activate dynamic personalized learning situation and so forth.

A Dimensionality Assessment for Polytomously Scored Items Using DETECT

  • Kim, Hae-Rim
    • Communications for Statistical Applications and Methods
    • /
    • v.7 no.2
    • /
    • pp.597-603
    • /
    • 2000
  • A versatile dimensionality assessment index DETECT has been developed for binary item response data by Kim (1994). The present paper extends the use of DETECT to the polytomously scored item data. A simulation study shows DETECT performs well in differentiating multidimensional data from unidimensional one by yielding a greater value of DETECT in the case of multidimensionality. An additional investigation is necessary for the dimensionally meaningful clustering methods, such as HAC for binary data, particularly sensitive to the polytomous data.

  • PDF

Development of Short Form of the Korean Version- the Boston Naming Test (K-BNT-15) Based on Item Response Theory (문항반응이론을 적용한 한국판 보스톤 이름대기 검사 단축형(K-BNT-15) 개발)

  • Kim, HyangHee;Kim, Soo Ryon
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.12
    • /
    • pp.321-327
    • /
    • 2013
  • Impaired naming difficulty is common in normal elderly as well as in patients with neurological impairment. The 60-item Korean version-Boston Naming Test(K-BNT) is one of the most commonly used test for measuring confrontational naming ability. However, age-related cognitive decline may make the elderly difficult concentrating during the 60-item test, therefore, item reduction of the K-BNT would improve test validity and reliability. Thus, the purpose of this study was to develop a short form of the K-BNT based on Item Response Theory(IRT). Considering item-fit index, sex factor, and item difficulty through Rasch analysis, the 15-item K-BNT(i.e., K-BNT-15) was developed. Via administration of the K-BNT-15, we observed age-related decline in naming ability and significantly different performance between the normal elderly and patients with mild cognitive impairment. This study demonstrates the utility of IRT for developing a short-form language evaluation tool. The K-BNT-15 can be effective as a language screening tool to differentiate between normal aging and pathological diseases.

Item analysis of the Korean version of the Intensive Care Experience Questionnaire: Using the Rasch Model based on Item Response Theory (Rasch 모형을 이용한 한국어판 중환자실경험 측정도구의 문항 분석)

  • Kang, Jiyeon;Kim, Minhui
    • Journal of Korean Critical Care Nursing
    • /
    • v.15 no.3
    • /
    • pp.37-50
    • /
    • 2022
  • Purpose : This study aimed to examine the item characteristics of the Korean version of the intensive care experience questionnaire (K-ICEQ) using the Rasch analysis model of the item response theory. Methods : In this methodological study, the validity of the scale was examined, and a secondary analysis was conducted using cohort data of patients who were discharged from the intensive care units (ICU). Data from 891 patients who responded to the K-ICEQ upon ICU discharge were analyzed. The WINSTEP program was used to analyze item characteristics, including item difficulty, fit indices, appropriateness scale, and separation reliability. Results : The difficulty level of all 26 items of the K-ICEQ was appropriate, and the fit indices of the 25 items, except for item 18, were good. The 5-point scale of the K-ICEQ was not appropriate in the three subscales. The item separation reliability was good in all subscales, but did not meet the criteria in terms of respondents. Conclusion : The results of examining the item characteristics of the K-ICEQ revealed a good degree of difficulty, fitness, and item separation reliability. To increase the validity of the K-ICEQ, we suggest the rearrangement of the overall item order, modification of the item description of the "recall of experience" subscale, and reduction of the scale response level.

The effects of scanning position on evaluation of cerebral atrophy level: assessed by item response theory

  • Mahsin, Md;Zhao, Yinshan
    • Communications for Statistical Applications and Methods
    • /
    • v.23 no.6
    • /
    • pp.531-541
    • /
    • 2016
  • Cerebral atrophy affects the brain and is a common feature of patients with mild cognitive impairment or Alzheimer's diseases. It is evaluated by the radiologist or reader based on patient's history, age and the space between the brain and the skull as indicated by magnetic resonance (MR) images. A total of 70 patients were scanned in the supine and prone positions before three radiologist assessed their atrophy level. This study examined the radiologist's assessment of the cerebral atrophy level using a graded response model of item response theory (IRT). A graded response model (GRM) is fitted to our data and then item-fit and person-fit statistics are evaluated to assess the fitted model. Our analysis found that the cerebral atrophy level is better discriminated by readers in the prone position because all item slopes were greater than 2 at this position, versus the supine position where all the slope parameters were less than 1. However, the thresholds are very similar for the first reader and are quite different for the second and third readers because the scanning position affects readers differently as the category threshold estimates vary considerably between the readers..