• Korean Journal of Social Welfare
• /
• v.59 no.4
• /
• pp.273-296
• /
• 2007

In this Study, to reconstruct the disability identity scale(Lee and Shin, 2006)), Rasch rating scale model was applied to the four sub-dimensions of the Disability Identity Scale in a sample of spinal cord injuries(N=397). The Disability Identity Scale was verified by explorative factor analysis and confirmatory factor analysis. However, factor analytic procedures can't evaluate item-fit indices, item difficulty, and appropriate scale category. A number of limitations posed by confirmatory factor analytic procedures can be averted with the use of Rasch rating scale model which is in the item response theory(IRT). So in this study, Rasch model was applied to the Disability Identity Scale. Results revealed that (A) 20 items were selected from Rasch model, (B) the difficulty level of the Disability Identity Scale was the average level, (C) 4-point rating scale was appropriate for the Disability Identity Scale. Finally, we could suggest that the sub-dimensions concepts of the disability identity became clearer and items were to the good fitting.

• Journal of Internet Computing and Services
• /
• v.10 no.5
• /
• pp.145-152
• /
• 2009

Applications such as study guides and adaptive tutoring must rely on a fine grained student model to tailor their interaction with the user. They are useful for Computer Adaptive Testing (CAT), for example, where the test items can be administered in order to maximize the information. I study how to design learner tailoring question process for recommendation. And this process can be applied the CAT and I use the formal language such as CSP in each process development for efficient process design. I use the item difficulty of item response theory for question recommendation process and learner can choice the difficulty step for learning change to control the difficulty of question in next learning. Finally, this method displayed the structural difference to compare between existent and this process.

• Journal of Korean Academy of Nursing
• /
• v.45 no.1
• /
• pp.107-117
• /
• 2015

Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

• The Journal of Korean Association of Computer Education
• /
• v.6 no.2
• /
• pp.1-8
• /
• 2003

In existing the learner testing system, it has a weak point to determine differently the difficulty of each question which has been estimated by teacher's view and the subjective stand point. In this paper, we develops the learner testing system which supports the estimation of the individual ability of learner, provides the questions for suitable to the individual learner level, and able to estimate the question of individual that used by three parameters such as the difficulty parameter, discrimination parameter, and guessing parameter. Also, it is applied to three-parameters logistic model of IRT(Item Response Theory) for using CAT(Computer Adaptive Testing) technique.

• Physical Therapy Korea
• /
• v.19 no.3
• /
• pp.91-97
• /
• 2012

The primary aim of this study was to compare responsiveness of self-report by worker and therapist-scored functional capacity instrument. Self-report and therapist-scored interval-level person measures and item difficulties were compared at admission and discharge. Therapist and worker ratings were collected on 230 clients from 27 rehabilitation sites using the newly developed Occupational Rehabilitation Data Base (ORDB) functional capacity instrument. ORDB comprises several subscales measuring relevant variables of "a return-to-work model" in work-related rehabilitation clinics. The functional capacity scale deals with 10 DOT job factors. The rating scale categories were 1-severely impaired, 2-moderately impaired, 3-mildly impaired, and 4-not impaired. Only data from clients with low back pain (n=98) with complete data (both admission and discharge scores) were used for the present study. Therapists and workers completed the functional capacity instrument at admission and discharge. Rasch analysis [1-parameter item response theory model (IRT)] was applied to calibrate item difficulty and person ability measure of therapist and workers ratings. Effect sizes for therapist and self-report ratings were slightly different, .69 and .30, respectively. Therapist and worker ratings were more consistent at discharge (r=.54) than at admission (r=.32). Workers have a tendency to be more severe in their ratings (show higher item difficulties) than therapists at admission and discharge. Therapists and workers report similar magnitudes of improvement following treatment program. These findings challenge the belief that injured workers may unreliable source for monitoring therapeutic outcomes. Self-report measures have the advantage of conserving therapist time for treatment (versus evaluation). While the therapist and self-report ratings are comparable at discharge, there is less consistency at admission. Comparable therapist-worker ratings may be achieved by controlling for rating severity using IRT methodologies.

• Korean Journal of English Language and Linguistics
• /
• v.3 no.4
• /
• pp.571-588
• /
• 2003

The purpose of this study is to investigate into the various ways that the computer technology is used for language testing. Three uses of computer technology are mentioned: 1) computer-adaptive language testing and computer-based language testing, 2) the scoring of performance-based language assessment, and 3) the development and use of psychometric tools for analyzing the scoring results. Although the various uses of computer technology could provide expanded possibilities for language testing development, the developers should be reminded that they are currently subject to indepth research which could support their validity. In this regard, the advantages and limitations of some uses of computer technology for language testing are discussed.

• Korean Medical Education Review
• /
• v.14 no.2
• /
• pp.102-108
• /
• 2012

This study developed a test entitled Clinical Critical Thinking Skills (CCTS) by using item response theory (IRT) and examined its validity. In the development stage, data obtained from a convenience sample of 627 undergraduate nursing students were analyzed using a discrimination and difficulty index with the TestAn 1.0 program. In the evaluation stage, data from a convenience sample of 284 nursing and non-nursing students were analyzed using a discrimination and difficulty index with the BILOG-MG program. Criterion validity was verified by the group comparison method. Five items received low discrimination index scores according to the IRT results. In terms of the criterion validity, CCTS scores differed according to major (t=2.21, p=0.028), location of high school (F=4.35, p=0.014), clinical experience (t=5.66, p=0.004), and grade point average (F=7.17, p< 0.001). The CCTS can be used to measure critical thinking skills in the clinical setting.

• The Korean Journal of Elementary Counseling
• /
• v.9 no.2
• /
• pp.143-162
• /
• 2010

The purpose of this study is to construct Parent Attachment Scale for Children. Adapting the item consisting method used in Experiences in Close Relationships-Revised(ECR-R), Parent Attachment Scale for Children was constructed to measure child's attachment style with their parent, reliably and validly. Also, reliability and item trait informations based on item response theory were reviewed. First preliminary items were derived from the original items of ECR-R and existing Attachment Inventories. These items were modified and complemented to be easier and keep the original meaning of each item. Second preliminary items were administrated to 4~6th grades students(N=576). Finally, Parent Attachment Scale for Children were consisted with 30 items based on two-parameter graded response model. Internal consistency ranges of the scales of Parent Attachment Scale for Children are as follows : Avoidance scale is .94~.96; Anxiety scale is .85~.88. Test-retest reliability ranges are as follows; Avoidance scale is .71~.80; Anxiety scale is .53~.68. Item discrimination and item information value were within an appropriated range. Hierarchical cluster analysis with Ward's Method revealed four types of attachment style : Secure, Dismissing, Preoccupied, Fearful. Other implications and limitations of this study were discussed.

• Women's Health Nursing
• /
• v.27 no.2
• /
• pp.69-74
• /
• 2021

Structural validity, internal consistency, and cross-cultural validity/measurement invariance are psychometric properties of the internal structure of an instrument. In psychometric studies published in Korean nursing journals, structural validity has mainly been assessed using confirmatory factor analysis. Cross-cultural validity/measurement invariance has rarely been evaluated. It is recommended for Korean nursing researchers to evaluate the internal structure of instruments using a greater variety of methods, such as item response theory, Rasch analysis, multi-group confirmatory factor analysis, and differential item functioning.

• The Journal of Korean Medicine
• /
• v.43 no.2
• /
• pp.27-41
• /
• 2022

Objectives: There should be an objective analysis on the academic competency for incorporating Computer-based Test (CBT) in the education of traditional Korean medicine (TKM). However, the Item Response Theory (IRT) for analyzing latent competency has not been introduced for its difficulty in calculation, interpretation and utilization. Methods: The current study analyzed responses of 390 students of 8 years to the herbology test with 14 items by utilizing Rasch model, and the characteristics of test and items were evaluated by using characteristic curve, information curve, difficulty, academic competency, and test score. The academic competency of the students across gender and years were presented with scale characteristic curve, Kernel density map, and Wright map, and examined based on T-test and ANOVA. Results: The estimated item, test, and ability parameters based on Rasch model provided reliable information on academic competency, and organized insights on students, test and items not available with test score calculated by the summation of item scores. The test showed acceptable validity for analyzing academic competency, but some of items revealed difficulty parameters to be modified with Wright map. The gender difference was not distinctive, however the differences between test years were obvious with Kernel density map. Conclusion: The current study analyzed the responses in the herbology test for measuring academic competency in the education of TKM using Rasch model, and structured analysis for competency-based Teaching in the e-learning era was suggested. It would provide the foundation for the learning analytics essential for self-directed learning and competency adaptive learning in TKM.