• Title/Summary/Keyword: rasch analysis

Search Result 91, Processing Time 0.019 seconds

Assessing the EORTC QLQ-BM22 Module Using Rasch Modeling and Confirmatory Factor Analysis across Countries: a Comprehensive Psychometric Evaluation in Patients with Bone Metastases

  • Lin, Chung-Ying;Pakpour, Amir H
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.3
    • /
    • pp.1405-1410
    • /
    • 2016
  • Background: The European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Bone Metastases Module (EORTC QLQ-BM22) is a recently designed supplement to EORTC Quality of Life Questionnaire-C30 (EORTC QLQ-C30). Additional psychometric properties, especially using confirmatory factor analysis (CFA) and the Rasch model, are warranted. Materials and Methods: A total of 573 patients with bone metastases were enrolled from eight countries with a mean${\pm}$SD age of $55.8{\pm}13.7years$. Slightly more than two thirds of them were female (n=383; 66.8%). CFA was used to examine the BM22 framework; Rasch models were applied to understand misfit items and differential item functioning (DIF). Results: The fit indices were satisfactory in CFA (comparative fit index=0.972, Tucker-Lewis index=0.964, root mean square error of approximation=0.076, and standardized root mean square residual=0.045). All items fit well in the Rasch models (mean square values were between 0.5 and 1.5), and only one item (number 17) displayed DIF across gender. However, there were six DIF items across Canada and Taiwan, ten across Canada and Iran, and six across Taiwan and Iran. Conclusions: The BM22 has satisfactory psychometric properties, and could assess the QoL of patients with bone metastases specifically focusing on their symptoms. Clinicians may want to use it to capture the underlying QoL for patients with bone metastases. However, the score of item 17 should be interpreted with caution when comparing male and female patients. In addition, researchers should note that variation in DIF items may occur when conducting an international study.

An Analysis of Elementary Students' Understanding of the Equal Sign by Using Rasch Model (Rasch 모델을 통한 초등학교 학생들의 등호 이해 분석)

  • Kim, JeongWon;Pang, JeongSuk;Choi, JiYoung
    • The Mathematical Education
    • /
    • v.55 no.1
    • /
    • pp.1-19
    • /
    • 2016
  • Given the importance of understanding the equal sign in developing early algebraic thinking, this paper investigated how a total of 695 students in grades 2~6 understood the equal sign. The students completed a questionnaire with three types of items (equation structure, equal sign definition, and open equation solving) based on the construct map by four different levels of understanding the equal sign. The questionnaire was analyzed by Rasch model. The results showed that about 80% of the students were at least Level 3 which means a basic relational understanding of the equal sign. However, the success rates varied across grades and it was noticeable that about 70% of the second graders remained at Level 1 or 2 which maintains an operational understanding of the equal sign. The results of item types demonstrated that item difficulty for the advanced relational thinking was the highest and this is the same even for the Level 4 students. This paper is expected to investigate elementary school students' understanding of the equal sign and provide implications of how to deal with the equal sign in the elementary school.

Rasch Analysis to Neck disability Index with Neck Pain Subjects (경부통증대상자에 대한 경부장애지수의 Rasch분석)

  • Kim, Tae-Ho;Kim, Joong-Hwi;Gong, Won-Tae
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.3
    • /
    • pp.1-8
    • /
    • 2009
  • Purpose: The purpose of this study was to examine the functional category, the item structure and the model-data fit of the neck disability index (NDI) of neck pain subjects by performing a Rasch rating scale analysis. Methods: The data was obtained from the assessments of 71 college students (males: 27, females: 44) with neck pain. The data of the NDI was applied to the Rasch's rating scale model to estimate the difficulty of items, the goodness-of-fit of each item, the separation reliability and index, and the rating scale. Results: The 'sleep' item showed misfit and nine items were founds to be fits for self-reporting of disability due to neck pain. The most difficult item of the remaining 9 items was 'work' and the easiest item was 'headache'. The transformation formula score=(logit score+7.10)/(7.10+0.11)$\times$100. The 6 response levels of the NDI were validated according to the structure of the rating scale. The item and subject reliability of the separation reliability was 0.97 and 0.85, respectively. Conclusion: We proved that the NDI for self-reporting of disability of daily activities due to mild neck pain was valid and reliable. This study suggests that individuals with mild neck pain may be assessed by using the modified NDI that does not include the 'sleep' item in the 10 items of NDI.

  • PDF

Study on the validity of PEAS for analyzing doping attitude and disposition of Korean elite player through Rasch model (엘리트 선수의 도핑 사고성향 분석을 위한 한국형 PEAS의 타당도 검증: Rasch 모형 적용)

  • Kim, Tae Gyu;Kim, Sae Hyung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.3
    • /
    • pp.567-578
    • /
    • 2014
  • PEAS (performance enhancement attitude scale) has been used to measure attitude and disposition toward doping in elite athlete. It is constructed of 17-item, 6-point scale. The purpose of this study was to verify validity of the PEAS for Korean elite player through Rasch model. The scale was administered to 438 Korean elite players. Principal component analysis was used to verify unidimensionality using SPSS program. Rasch measurement computer program, WISTEPS, was used to estimate goodness-of-fit of items and category structure. Differenctial item functioning by gender was also estimated by the WINSTEPS program. All alpha level was set at 0.05. First, principal component analysis showed that unidimensionality is satisfied as over 20.0% of variance of eigenvalue. Second, category probabilities curve showed 5-point scale was better than 6-point scaled statistically. Third, seven items (1, 9, 10, 12, 13, 14, 17) in the 17-item were not good model fit and three items (3, 12, 13) were estimated as the differential item functioning. This study showed that 9-item, 5-point scale is better PEAS to Korean elite player.

Selecting Common Items for Linking the Oswestry Low Back Pain Questionnaire and a Short Form of Self-Reported Activity Measure for Low Back Pain

  • Choi, Bong-sam
    • Physical Therapy Korea
    • /
    • v.22 no.3
    • /
    • pp.61-70
    • /
    • 2015
  • To develop an effective and efficient measurement system for tracking changes of functional status across two measures, it is essential to integrate information and communicate scores across two measures. The lack of communication between two measures leads to score incompatibility. A potential solution would be the development of a crosswalk table between those measures. Prior to creating a crosswalk table, selecting common items between two measures is critical. By using the Oswestry low back pain disability questionnaire (Oswestry) and a short form measuring disability resulting from low back pain, item level statistics as well as differential item functioning (DIF) using the Rasch measurement were investigated. Eighty-two participants with known group validity were recruited. Based on the application of the Rasch measurement model, item difficulties across the two measures were logically and hierarchically ordered. Ceiling effects for both measures were detected, which were not be able to be effectively measured with the two measures. The DIF analysis across the two measures confirmed that five paired items were found to have DIF and five common items were selected for common items. Although five paired items function differently across the Oswestry and the short form, all items of both measures were well targeted study participants. The common items selected by the Rasch measurement model may be effective when creating a crosswalk table between the Oswestry and the short form.

Item Goodness-of-fit and Difficulty of Childhood Autism Rating Scale(CARS) - Application of Rasch Model - (아동기 자폐증 평정척도(CARS)의 문항 적합도 및 난이도 -Rasch 모형의 적용-)

  • Kim, Tae Hyung;Seo, Eunchul
    • 재활복지
    • /
    • v.20 no.4
    • /
    • pp.135-156
    • /
    • 2016
  • The purpose of this study was to investigate item goodness-of-fit of Childhood Autism Rating Scale(CARS), Rasch rating scale model was applied to 15 items of the CARS in a sample of pervasive development disorder(n=238). An assumption to test Rasch Model, which is satisfaction of unidimensionality, is regarded through PCAR analysis, and jMetrik 4.03 program is used to test the goodness-of-fit of items. The results of this study were: First, 5-point rating scale was appropriate for the CARS rather than 7-point original rating scale. Second, the result of examining the CARS questions goodness-of-fit, there was a overfitting or misfitting items according to the classified groups. Only in particular Q11 item in diagnosis subject of integration population of autism has become inappropriate. Therefore, it is necessary to provide education for the CARS more systematically. Thirdly, the result of comparing the personal attributes score and difficulty of a CARS question, Q2, Q3, Q10, Q11 items are necessary to distinguish conceptually defined in more detail. Fourth, the results of investigating the difficulty of CARS question, it was found to exhibit a verbal communication is most serious problem for the population of autism.

Study on the Academic Competency Assessment of Herbology Test using Rasch Model (라쉬 모델을 사용한 본초학 시험의 학업역량 분석 연구)

  • Chae, Han;Lee, Soo Jin;Han, Chang-ho;Cho, Young Il;Kim, Hyungwoo
    • The Journal of Korean Medicine
    • /
    • v.43 no.2
    • /
    • pp.27-41
    • /
    • 2022
  • Objectives: There should be an objective analysis on the academic competency for incorporating Computer-based Test (CBT) in the education of traditional Korean medicine (TKM). However, the Item Response Theory (IRT) for analyzing latent competency has not been introduced for its difficulty in calculation, interpretation and utilization. Methods: The current study analyzed responses of 390 students of 8 years to the herbology test with 14 items by utilizing Rasch model, and the characteristics of test and items were evaluated by using characteristic curve, information curve, difficulty, academic competency, and test score. The academic competency of the students across gender and years were presented with scale characteristic curve, Kernel density map, and Wright map, and examined based on T-test and ANOVA. Results: The estimated item, test, and ability parameters based on Rasch model provided reliable information on academic competency, and organized insights on students, test and items not available with test score calculated by the summation of item scores. The test showed acceptable validity for analyzing academic competency, but some of items revealed difficulty parameters to be modified with Wright map. The gender difference was not distinctive, however the differences between test years were obvious with Kernel density map. Conclusion: The current study analyzed the responses in the herbology test for measuring academic competency in the education of TKM using Rasch model, and structured analysis for competency-based Teaching in the e-learning era was suggested. It would provide the foundation for the learning analytics essential for self-directed learning and competency adaptive learning in TKM.

A Comparison of Three Low Back Disability Questionnaires With Rasch Analysis (라쉬분석을 이용한 세 가지 요통 장애 설문지의 비교)

  • Kim, Gyoung-Mo;Park, So-Yeon;Yi, Chung-Hwi
    • Physical Therapy Korea
    • /
    • v.18 no.3
    • /
    • pp.94-102
    • /
    • 2011
  • The purpose of this study was to review existing assessment tools for patients with low back pain and improve them through combination. A total of 314 patients with low back pain participated. Their condition was assessed using the Oswestry Disability Questionnaire (ODQ), the Quebec Back Pain Disability Scale (QBPD), and the Back Pain Functional Scale (BPFS). Rasch analysis was applied to identify inappropriate items, item difficulties, and the separation index. In this study, the 'sex life' item of the ODQ (10 items) and the 'sleeping' item of the BPFS (12 items) showed misfit statistics, whereas all items of the QBPD (20 items) were appropriate. After combining the ODQ, QBPD and BPFS, Rasch analysis was applied. The 'pain intensity', and the 'sex life' item of the ODQ and the 'throw a ball' item of QBPD showed misfit statistics. These 3 items were retained for further analysis. The remaining 42 combined ODQ-QBPD-BPFS items were arranged according to difficulty. For all subjects, the most difficult item was 'pain intensity', whereas the easiest was 'take food out of the refrigerator'. As the separation index of 42 combined ODQ-QBPD-BPFS was higher than that of the three questionnaires separately, difficulty of items varied with some need for rearrangement. The results of this study confirmed the possibility and need for a new back pain disability assessment tool, and produced one. Further study is needed to refine the questionnaire in consideration of psychosocial and occupational factors.

Item Response Analysis of Energy as a Cross-Cutting Concept for Grades 3 to 9 (기초공통개념으로서 에너지에 대한 3~9학년 학생들의 문항 반응 분석)

  • Kim, Youngmin;Kang, Nam-Hwa;Kang, Hunsik;Maeng, Seungho;Lee, Jun-Ki
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.6
    • /
    • pp.815-833
    • /
    • 2016
  • This study investigated children's (grade 3 to 9) responses to assessment items on energy as a cross-cutting concept in order to get basic information for a learning progression. The assessment consisted of 8 ordered multiple-choice items at the contexts of electric circuit, mechanical energy of falling objects, phase change of matter, dissolution, biological phenomena of a lizard, food chain, radiative equilibrium between Sun and Earth, and the system of water cycling. Children's responses to each item were analyzed with using cross-tabulations in terms of grades and item option levels and Wright map and Differential item functioning based on Rasch modeled item response analysis. The results offered empirical evidence of children's development of understanding energy from relation between energy and its phenomena, types of energy, transfer and conversion of energy, towards conservation and equilibrium of energy for all of eight contexts. Children of each grade did not fully understand energy conservation. As grade goes up, their understandings of energy transfer and conversion were differentiated across the contexts and topics of energy. According to Rasch analysis, children had easier understanding of energy on dissolution and poorer understanding of energy on water cycling than that on other contexts. It was discussed and suggested that the results of this study help us organize science topics with regard to energy when developing new national science curriculum.

Cross-Sectional Item Response Analysis of Geocognition Assessment for the Development of Plate Tectonics Learning Progressions: Rasch Model (판구조론의 학습발달과정 개발을 위한 지구적 인지과정 평가의 횡단적 문항 반응 분석: Rasch 모델)

  • Maeng, Seungho;Lee, Kiyoung
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.1
    • /
    • pp.37-52
    • /
    • 2015
  • In this study, assessment items to examine geocognition on plate tectonics were developed and applied to middle and high school students and college students. Conceptual constructs on plate tectonics are Earth interior structure, specific geomorphology, and geologic phenomena at each plate boundary. Construct for geocognition included temporal reasoning, spatial reasoning, retrospective reasoning, and system thinking. Pictorial data in each item were all obtained from GeoMapApp. Students' responses to the items were analyzed and measured cross-sectionally by Rasch model, which distinguishes persons' ability levels based on their scores for all items and compared them with item difficulty. By Rasch model analysis, Wright maps for middle and high school students and college students were obtained and compared with each other. Differential Item Functioning analysis was also implemented to compare students' item responses across school grades. The results showed: 1) Geocognition on plate tectonics was an assessable construct for middle and high school students in current science curriculum, 2) The most distinguished geocognition factor was spatial reasoning based on cross sectional analysis across school grades, 3) Geocognition on plate tectonics could be developed towards more sophisticated level through scaffolding of relevant instruction and earth science content knowledge, and 4) Geocognition was not a general reasoning separated from a task content but a content-specific reasoning related to the content of an assessment item. We proposed several suggestions for learning progressions for plate tectonics and national curriculum development based on the results of the study.