• The Journal of Korean Association of Computer Education
• /
• v.10 no.4
• /
• pp.39-49
• /
• 2007

The purpose of this study is to provide analysis resources to develop high standard questions by analyzing item characteristics and item usability of 'Basic course of Information Technology' in the College Scholastic Ability Test, For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty, item discrimination, item reliability, and distracters. As a result of analyzing tests in 2005 and 2006, questions were equally extracted from educational contents. However, the standard of questions were in need of revision. The development of high quality contents in Vocational Education Section was needed in order to meet to the College Scholastic Ability Test standards. Therefore, it is required to develop various difficulties and acceptable distinguishable questions.

• Physical Therapy Korea
• /
• v.24 no.1
• /
• pp.41-50
• /
• 2017

Background: The Pediatric Balance Scale (PBS) was developed to assess of balance ability in children with balance problem. The PBS was translated into Korean and its reliability had been studied. However, it had need to be verified using psychometric characteristics including item fit and rating scale. Objects: The purpose of this study was to investigate the item fit, item difficulty, and rating scale of the Korean version of PBS using Rasch analysis. Methods: In total, 40 children with cerebral palsy (CP) (boy=17, girl=23) who were diagnosed with level 1 or 2 according to the Gross Motor Function Classification System participated in this study. The PBS was performed, and was verified regarding the item fit, item difficulty, rating scale, and separation index and reliability using Rasch analysis. Results: In this study, the 'transfer', and 'turning to look behind left and right shoulders while standing still' item showed misfit statistics. in total 40 children with CP. Also, 'transfer', 'standing unsupported with feet together' and 'standing with one foot in front' items showed misfit statistics in diplegia CP group. Regardless of the classification of CP, the most difficult item was 'standing on one foot', whereas the easiest item was 'sitting with back unsupported and feet supported on the floor'. The 4 rating scale categories of PBS were acceptable with all criteria. Both item and person separation indices and reliability showed acceptable values. Conclusion: The PBS has been proven reliable, valid and is an appropriate tool, but it needs to modify the items of PBS according to CP classification.

• Physical Therapy Korea
• /
• v.30 no.1
• /
• pp.32-40
• /
• 2023

Background: Equating is a statistical procedure used to create a common measurement scale across two instruments. Item-level information should be taken into consideration so that scores can communicate interchangeably across the instruments. Objects: To investigate a common measurement scale across two health-related quality of life questionnaires (HRQOL) applied to various cancer survivors who underwent palliative care in healthcare institutions. Methods: A total of 139 cancer survivors who underwent palliative care were recruited from two rehabilitation hospitals and an oriental medicine hospital. Participants consisted of various cancer survivors who presented to the sites for palliative care. They were asked to fill out Korean versions of the World Health Organization Quality of Life (WHOQOL-BREF) and EuroQOL-5 dimension (EQ-5D) questionnaires following the palliative care. For the item level comparison, the Rasch rating scale model was used to investigate how participants regarded individual test items of two instruments in relation to item difficulty calibrations. Results: All items except the three items fit the Rasch model. One item (anxiety/depression) of the EQ-5D and two items (dependence on medical aids and negative feelings) of the WHOQOL-BREF are misfit. The WHOQOL-BREF targets the survivors well, while the EQ-5D is able to target the survivors with lower HRQOL levels with some ceiling effects. By inspecting the item difficulty calibrations of the two instruments, five items of the WHOQOL-BREF are selected as common items in relation to the EQ-5D. These five items are considered compatible with each other. Differential item functioning (DIF) analysis reveals that the healthcare item of the WHOQOL-BREF vs the self-care item of the EQ-5D exhibits significant DIF. Conclusion: Findings suggest that one paired item should be taken into consideration when equating the WHOQOL-BREF and the EQ-5D applied to cancer survivors who underwent palliative care.

• Journal of Internet Computing and Services
• /
• v.10 no.5
• /
• pp.145-152
• /
• 2009

Applications such as study guides and adaptive tutoring must rely on a fine grained student model to tailor their interaction with the user. They are useful for Computer Adaptive Testing (CAT), for example, where the test items can be administered in order to maximize the information. I study how to design learner tailoring question process for recommendation. And this process can be applied the CAT and I use the formal language such as CSP in each process development for efficient process design. I use the item difficulty of item response theory for question recommendation process and learner can choice the difficulty step for learning change to control the difficulty of question in next learning. Finally, this method displayed the structural difference to compare between existent and this process.

• Research in Mathematical Education
• /
• v.7 no.3
• /
• pp.163-189
• /
• 2003

The purpose of this study is to develop a test, which can be used in creative problem solving ability in mathematics of the mathematically gifted and the regular students. This test tool is composed of three categories; fluency (number of responses), flexibility (number of different kinds of responses), and originality (degree of uniqueness of responses) which are the factors of the creativity. After applying to 462 middle school students, this test was analyzed into item analysis. As a results of item analysis, it turned out to be meaningful (reliability: 0.80, validity: item 1(1.05), item 2(1.10), item 3(0.85), item 4(0.90), item 5(1.08), item difficulty: item 1(-0.22), item 2(-0.41), item 3(0.23), item 4(0.40), item 5(-0.01), item discriminating power: item 1(0.73), item 2(0.73), item 3(0.67), item 4(0.51), item 5(0.56), over the level of a standard basis. This means that the test tool was useful in the test process of creative problem solving ability in mathematics

• Therapeutic Science for Rehabilitation
• /
• v.11 no.3
• /
• pp.65-80
• /
• 2022

Objective : This study examined the psychometric properties of the 12-item Coping Orientation to Problems Experienced Scale (COPE) using Rasch analysis. COPE is one of the instruments used to measure stress-coping skills. Methods : The study participants were 480 community-dwelling older adults. We tested the instrument's unidimensionality assumption using principal component analysis (PCA). Item fit was examined using infit-and-outfit mean-square (MnSq) and standardized fit statistics (ZSTD). The precision and item difficulty hierarchies of the instrument were examined. The item-difficulty hierarchy was investigated to identify the easy and difficult items. We tested differential item functioning (DIF) for sex and age groups. Results : PCA revealed that the instrument met the unidimensionality assumption (eigenvalue = 1.78). Among the 12 items, item 2 was removed because of misfit (Infit MnSq = 1.33, Infit ZSTD = 5.05, Outfit MnSq = 1.56, Outfit ZSTD = 7.15). The remaining 11 items demonstrated a conceptual item-difficulty hierarchy. The person strata value was 3.10, which is equivalent to a reliability index value of 0.81. There was no DIF for the sex and age groups (DIF contrast <0.27). Conclusion : The findings indicated that the revised COPE-11 has adequate item-level psychometric properties and can accurately measure stress coping skills.

• KSCI Review
• /
• v.8 no.2
• /
• pp.33-42
• /
• 2001

The purpose of this study was to help retrieve and assess only what learner wants. The multiple-choice and short-answer types were selected. and a sort of a question bank was organized in consideration of the degree of difficulty and frequency of being questioned in such a way to have a discriminating power. For item retrieval the stored information was converted into XML data, instead of simply searching information from database. and that data were retrieved through Xpath. And it's designed to show the retrieval output by using XML on browser. Concerning item evaluation. evaluation items were produced by inputting the degree of difficulty and frequency of being questioned of the subject and unit learner wants. and then by inputting the number of individual item type. The learning outcome was offered in real time to learner. and learner could repeatedly drill what they gave a wrong answer.

• Physical Therapy Korea
• /
• v.15 no.3
• /
• pp.26-34
• /
• 2008

The purposes of this study were to assess and modify the original classification categories of the modified Oswestry Low Back Pain Disability Questionnaire (ODQ) and to determine the unidimensionality of the modified ODQ applying Rasch Analysis. The data were obtained from 108 work-related low back pain patients by physical therapists. Construct validity of the scale using the Rasch model required the structure of the rating scale to be modified from 6 response levels to 4 response levels. Eight items from the modified ODQ fit the Rasch model. The items, "pain intensity" and "social life" showed misfit statistics. In general, the order of item difficulty of the remaining 8 items showed a logical item difficulty hierarchy with the "changing degree of pain" item being the most difficult and the "walk" item being the easiest. The results showed that further study is needed to expand the construct of ODQ including additional higher-level items related to work activities. This study may be useful for establishing a standard method to assess the functionality of low back pain patients.

• The KIPS Transactions:PartA
• /
• v.17A no.1
• /
• pp.45-52
• /
• 2010

The National Assessment of Educational Achievement has been conducted in the form of sampling assessment until 2007, but it was converted into sampling assessment one hundred percent working with relevant whole students in 2008. Therefore, the necessity of new study on the national assessment system of educational achievement was on the rise. The National Assessment System of Educational Achievement, which was implemented in this thesis was designed to analyze educational achievement status all over the province, total score and score frequency distribution per subject, item difficulty and item discrimination, degree of attraction of wrong answers, educational achievement per subject, gender, region, office of education, school, individual and status of students with high educational achievement.

• Journal of Fisheries and Marine Sciences Education
• /
• v.27 no.6
• /
• pp.1546-1555
• /
• 2015

This study was performed to analyze the item characteristics of competency inventory for designer (CID), which Gil (2011) developed for measurement of design competency. To accomplish the purpose of this study, general partial credit (GPC) model based on polytomous item response theory was applied. The findings were as follows: First, CID is a reliable instrument for measuring design competency. Second, most items of CID have low item discrimination and average item difficulty according to the GPC model. Especially, there are some problems to have low item discrimination in view of validation. To improve the goodness of CID, we will need to examine why CID has low item discrimination.