• Journal of Technologic Dentistry
• /
• v.44 no.3
• /
• pp.104-110
• /
• 2022

Purpose: This study analyzes the difficulty and discrimination of the paper-based test (PBT) and the computer-based test (CBT) according to item response theory, focusing on the National Dental Technician Examination. Methods: A mock test was conducted from September 15 to 23, 2020, and the final 179 (1 out of 180 absentees)people were the subjects of this study. Both frequency analysis and factor analysis were performed. The collected data were analyzed using IBM SPSS Statistics ver. 18.0 (IBM) and jMetrik programs. The significance level was set to 0.05. Results: The difficulty of the mock test was more easily responded to in CBT. It was also predicted that the CBT could better measure the ability of test takers than the PBT could. Conclusion: The difficulty, discrimination, and reliability of the questions were not affected by the examination method through the mock test. The feasibility of a future change to the CBT was confirmed by the National Dental Technician Examination.

• Journal of Internet Computing and Services
• /
• v.8 no.6
• /
• pp.127-133
• /
• 2007

The u-learning environment has been developed through a number of iterations, and has now been formally evaluated, through analysis of student learning results and the use of quantitative and qualitative measures, Generally, for advance learning effect and analysis of student learning results, the most learning system be use to the item analysis method. But, nowadays, it has using the IRT(Item Response Theory) instead of the item analysis method, The IRT adopts explicit models for the probability of each possible response to a test. Therefore, I proposed the lightweight component based u-learning system using the IRT. Applied device of u-learning is PDA which is in Windows mobile 5.0 environments.

• Korean Journal of Social Welfare
• /
• v.59 no.4
• /
• pp.273-296
• /
• 2007

In this Study, to reconstruct the disability identity scale(Lee and Shin, 2006)), Rasch rating scale model was applied to the four sub-dimensions of the Disability Identity Scale in a sample of spinal cord injuries(N=397). The Disability Identity Scale was verified by explorative factor analysis and confirmatory factor analysis. However, factor analytic procedures can't evaluate item-fit indices, item difficulty, and appropriate scale category. A number of limitations posed by confirmatory factor analytic procedures can be averted with the use of Rasch rating scale model which is in the item response theory(IRT). So in this study, Rasch model was applied to the Disability Identity Scale. Results revealed that (A) 20 items were selected from Rasch model, (B) the difficulty level of the Disability Identity Scale was the average level, (C) 4-point rating scale was appropriate for the Disability Identity Scale. Finally, we could suggest that the sub-dimensions concepts of the disability identity became clearer and items were to the good fitting.

• Physical Therapy Korea
• /
• v.19 no.3
• /
• pp.124-131
• /
• 2012

Most conventional instruments measuring disability rely on total score by simply adding individual item responses, which is dependent on the items chosen to represent the underlying construct (test-dependent) and a test statistic, such as coefficient alpha for the estimate of reliability, varying from sample to sample (sample-dependent). By contrast, item response theory (IRT) method focuses on the psychometric properties of the test items instead of the instrument as a whole. By estimating probability that a respondent will select a particular rating for an item, item difficulty and person ability (or disability) can be placed on same linear continuum. These estimates are invariant regardless of the item used (test-free measurement) and the ability of sample applied (sample-free measurement). These advantages of IRT allow the creation of invariantly calibrated large item banks that precisely discriminate the disability levels of individuals. Computer adaptive testing (CAT) method often requiring a testing algorithm promise a means for administering items in a way that is both efficient and precise. This method permits selectively administering items that are closely matched to the ability level of individuals (measurement precision) and measuring the ability without the loss of precision provided by the full item bank (measurement efficiency). These measurement properties can reasonably be achieved using IRT and CAT method. This article aims to investigate comprehensive overview of the existing disability instrument for back pain and to inform physical therapists of an alternative innovative way overcoming the shortcomings of conventional disability instruments. An understanding of IRT and CAT method will equip physical therapist with skills in interpreting the measurement properties of disability instruments developed using the methods.

• Physical Therapy Korea
• /
• v.20 no.3
• /
• pp.89-99
• /
• 2013

The purposes of this study were: 1) to show the item difficulty hierarchy of walking/moving construct of the International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM), 2) to evaluate the item-level psychometrics for model fit, 3) to describe the relevant physical activity defined by level of activity intensity expressed as Metabolic Equivalent of Tasks (MET), and 4) to explore what extent the empirical activity hierarchy of the ICF-AM is linked to the conceptual model based on the level of energy expenditure described as MET. One hundred and eight participants with lower extremity impairments were examined for the present study. A newly created activity measure, the ICF-AM using an item response theory (IRT) model and computer adaptive testing (CAT) method, has a construct on walking/moving construct. Based on the ICF category of walking and moving, the instrument comprised items corresponding to: walking short distances, walking long distances, walking on different surfaces, walking around objects, climbing, and running. The item difficulty hierarchy was created using Winstep software for 20 items. The Rasch analyses (1-parameter IRT model) were performed on participants with lower extremity injuries who completed the paper and pencil version of walking/moving construct of the ICF-AM. The classification of physical activity can also be performed by the use of METs that is often preferred to determine the level of physical activity. The empirical item hierarchy of walking, climbing, running activities of the ICF-AM instrument was similar to the conceptual activity hierarchy based on the METs. The empirically derived item difficulty hierarchy of the ICF-AM may be useful in developing MET-based activity measure questionnaires. In addition to convenience of applying items to questionnaires, implications of the finding could lead to the use of CAT method without sacrificing the objectivity of physiologic measures.

• Journal of KIISE:Software and Applications
• /
• v.32 no.5
• /
• pp.438-448
• /
• 2005

This paper proposes an adaptive tutoring system that provides learning materials dynamically according to the learners' teaming character and ability. Our system, in which a learning phase and a test phase are linked together, supports the personalized instruction-learning by providing the teaming materials by level in the learning phase according to the teaming ability estimated in the test phase. We design and implement a tutoring system consisted of an evaluation component and a learning component. An evaluation component uses a computerized adaptive test(CAT) based on item response theory to evaluate learners' ability while a learning component employs fuzzy level set theory so that teaming contents are provided to learners according to learners' level.

• Proceedings of the IEEK Conference
• /
• 2003.07d
• /
• pp.1681-1684
• /
• 2003

We propose the intelligent tutoring system for the mobile english learning. The proposed system is based on the item response theory to analyze the level of learner. We define the types of item, teaching method and item disposition according to contents modeling. The system estimates the learner level and it gives the learning contents, the evaluation results, and feedback. The system gives those by inference engine which consists of learner's level estimation value, method diagnostic value and disposition diagnostic value.

• Journal of Internet Computing and Services
• /
• v.11 no.2
• /
• pp.165-172
• /
• 2010

In Web-based learning systems, the techniques, as self-regulated learning, self-directed learning, are used to improve the effect of learner's study. These techniques are methods considering learner's study level but to consider the learner's study ability properly, the tailored course for learner should be applied. In this research, the learning system considering learner's study ability was proposed. To decide a learner's study ability, IRT(Item Response Theory) was applied and learning contents and question items were developed and applied by the degree of difficulty.

• Journal of Engineering Education Research
• /
• v.26 no.6
• /
• pp.40-50
• /
• 2023

This study is to examine the validity of assessing basic-level proficiency in physics among incoming engineering freshmen through item analysis and standard setting. For empirical analysis, we examined the physics subject taken by the freshman class of 2021 at K University, considering its significance for engineering students. In this study, we initially performed item analysis utilizing both classical test theory and item response theory. Subsequently, leveraging the item and test information, we employed a modified Angoff method and the Bookmark method for standard setting. Consequently, the difficulty level initially set during item development was found to be higher than the actual performance level exhibited by the students. This study highlights a discernible disparity between the expected university standard and the real proficiency level of incoming freshmen in terms of basic academic ability in physics. Based on these research findings, a comprehensive discussion on the fundamental academic competence of engineering students was conducted, underscoring the necessity for formulating a tailored learning approach leveraging the outcomes from the basic ability test.

• Journal of Fisheries and Marine Sciences Education
• /
• v.27 no.6
• /
• pp.1546-1555
• /
• 2015

This study was performed to analyze the item characteristics of competency inventory for designer (CID), which Gil (2011) developed for measurement of design competency. To accomplish the purpose of this study, general partial credit (GPC) model based on polytomous item response theory was applied. The findings were as follows: First, CID is a reliable instrument for measuring design competency. Second, most items of CID have low item discrimination and average item difficulty according to the GPC model. Especially, there are some problems to have low item discrimination in view of validation. To improve the goodness of CID, we will need to examine why CID has low item discrimination.