• Title/Summary/Keyword: the Rasch Model

Search Result 87, Processing Time 0.033 seconds

Application of Rasch Analysis to the Activities-Specific Balance Confidence (ABC) Scale (Activities-Specific Balance Confidence(ABC)척도에 대한 라쉬분석의 적용)

  • Hwang, Su-Jin;Yi, Chung-Hwi;Park, So-Yeon
    • Physical Therapy Korea
    • /
    • v.14 no.1
    • /
    • pp.37-45
    • /
    • 2007
  • This study was designed to examine, applying Rasch analysis based on item response theory, the questionnaires of the Activities-Specific Balance Confidence (ABC) scale for the elderly. The subjects were 99 institutional older adults and clients of social welfare facilities. The subjects (17 men, 72 women) ranged in age from 65 to 94 years (mean age 76.5 yrs). The Winsteps software was used to assess whether the ABC scale fits the Rasch model, to estimate the score and to refine the rating scale. The results are as follows. Twenty-two subjects were excluded as misfit persons. Four items were found to be misfits and the order of difficulty of the remaining 12 items was rearranged. Their balance confidence is indicated by -.64~1.12 logit, and the transformation formula is score=[(logit score+2.76)/(2.76+3.48)]${\times}$100. The most difficult item was "Walk outside in icy sidewalks" and the easiest item was "Walk around house." In conclusion, the ABC scale for the elderly has been proven reliable and valid. Therefore, it is expected to be used as an effective examination tool for treatment planning and screening for older adults.

  • PDF

Cross-Sectional Item Response Analysis of Geocognition Assessment for the Development of Plate Tectonics Learning Progressions: Rasch Model (판구조론의 학습발달과정 개발을 위한 지구적 인지과정 평가의 횡단적 문항 반응 분석: Rasch 모델)

  • Maeng, Seungho;Lee, Kiyoung
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.1
    • /
    • pp.37-52
    • /
    • 2015
  • In this study, assessment items to examine geocognition on plate tectonics were developed and applied to middle and high school students and college students. Conceptual constructs on plate tectonics are Earth interior structure, specific geomorphology, and geologic phenomena at each plate boundary. Construct for geocognition included temporal reasoning, spatial reasoning, retrospective reasoning, and system thinking. Pictorial data in each item were all obtained from GeoMapApp. Students' responses to the items were analyzed and measured cross-sectionally by Rasch model, which distinguishes persons' ability levels based on their scores for all items and compared them with item difficulty. By Rasch model analysis, Wright maps for middle and high school students and college students were obtained and compared with each other. Differential Item Functioning analysis was also implemented to compare students' item responses across school grades. The results showed: 1) Geocognition on plate tectonics was an assessable construct for middle and high school students in current science curriculum, 2) The most distinguished geocognition factor was spatial reasoning based on cross sectional analysis across school grades, 3) Geocognition on plate tectonics could be developed towards more sophisticated level through scaffolding of relevant instruction and earth science content knowledge, and 4) Geocognition was not a general reasoning separated from a task content but a content-specific reasoning related to the content of an assessment item. We proposed several suggestions for learning progressions for plate tectonics and national curriculum development based on the results of the study.

Goodness of fit of martial arts training satisfaction scale applying Many-Facets Rasch model (Many-Facets Rasch 모형을 적용한 무도수련만족 척도의 적합도 - 경호무도 수련자를 중심으로 -)

  • Kim, Woo-Jin;Kim, Hye-Seon
    • Korean Security Journal
    • /
    • no.42
    • /
    • pp.37-57
    • /
    • 2015
  • The purpose of this study was to verify goodness-of-fit by Many-Facets Rasch model for applying martial arts training satisfaction scale to security martial arts trainees. To achieve the purpose, 255 security martial arts trainees' data were used in the analysis. In addition, In addition, the AMOS 20.0 program was used for unidimensionality validation, and take advantage of the Facets 3.61 program for goodness-of-fit verification. Specific results are as follows: First, Unidimensionali test results showed that model fit, reliability and standardized ${\beta}$ value are suitable. Second, the analysis results of goodness-of-fit, items 1, 2, 3 are inadequate, 4, 8, 11, 13, 14 items once found to be over-fit questions. Also, analysis of item difficulty, item 1 has highest difficulty and item 7 was lowest. Third, According Facets item difficulty and response difference verification result, female group exhibited a high level of item difficulty compared to the male group, goodness-of-fit was all accurate. As the result of item difficulty and response difference verification based on Martial arts training flow, there is no response difference according to the training experience. On the other hands, less than 4 years to 5 years and less than 5 years to 6 years trainees represented over-fit features. Results of item difficulty and response difference verification by grade level, first grade was the most highly recognized the item difficulty and fourth grade was also recognized the lowest of item difficulty Fourth, the response category analysis showed that the six points response categories are not appreciate.

  • PDF

Assessing the EORTC QLQ-BM22 Module Using Rasch Modeling and Confirmatory Factor Analysis across Countries: a Comprehensive Psychometric Evaluation in Patients with Bone Metastases

  • Lin, Chung-Ying;Pakpour, Amir H
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.3
    • /
    • pp.1405-1410
    • /
    • 2016
  • Background: The European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Bone Metastases Module (EORTC QLQ-BM22) is a recently designed supplement to EORTC Quality of Life Questionnaire-C30 (EORTC QLQ-C30). Additional psychometric properties, especially using confirmatory factor analysis (CFA) and the Rasch model, are warranted. Materials and Methods: A total of 573 patients with bone metastases were enrolled from eight countries with a mean${\pm}$SD age of $55.8{\pm}13.7years$. Slightly more than two thirds of them were female (n=383; 66.8%). CFA was used to examine the BM22 framework; Rasch models were applied to understand misfit items and differential item functioning (DIF). Results: The fit indices were satisfactory in CFA (comparative fit index=0.972, Tucker-Lewis index=0.964, root mean square error of approximation=0.076, and standardized root mean square residual=0.045). All items fit well in the Rasch models (mean square values were between 0.5 and 1.5), and only one item (number 17) displayed DIF across gender. However, there were six DIF items across Canada and Taiwan, ten across Canada and Iran, and six across Taiwan and Iran. Conclusions: The BM22 has satisfactory psychometric properties, and could assess the QoL of patients with bone metastases specifically focusing on their symptoms. Clinicians may want to use it to capture the underlying QoL for patients with bone metastases. However, the score of item 17 should be interpreted with caution when comparing male and female patients. In addition, researchers should note that variation in DIF items may occur when conducting an international study.

Identifying Travel Satisfaction in Mega Commuting Trip Using Rasch Modelling (Rasch 모형을 적용한 광역교통서비스의 서비스 수준 평가 분석)

  • On, Seojun;Kim, Suji;Jang, Kitae;Kim, Junghwa
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.43 no.5
    • /
    • pp.639-650
    • /
    • 2023
  • Economic development has resulted in the concentration of population and industry in the metropolitan area. Additionally, the Republic of Korea is experiencing this phenomenon, with more than half of the population living in the Seoul capital area. To alleviate this concentration of population, the Korean government implemented the new town development policy. Unfortunately, this has led to an increase in the commuting population, causing an imbalance in transportation services due to financial and policy differences in each region. This paper analyzes the level of user satisfaction with mega commuting in three aspects: mobility, accessibility, and connectivity. To objectively assess the level of user satisfaction, which is qualitative data, the Rasch Model is used to analyze the collinearity of user data. The results indicate that the level of user satisfaction differs by region, and service satisfaction with mobility is lower than that with accessibility and connectivity. Therefore, prior to the introduction of new town policies, it is necessary to develop metropolitan transportation infrastructure.

An English Essay Scoring System Based on Grammaticality and Lexical Cohesion (문법성과 어휘 응집성 기반의 영어 작문 평가 시스템)

  • Kim, Dong-Sung;Kim, Sang-Chul;Chae, Hee-Rahk
    • Korean Journal of Cognitive Science
    • /
    • v.19 no.3
    • /
    • pp.223-255
    • /
    • 2008
  • In this paper, we introduce an automatic system of scoring English essays. The system is comprised of three main components: a spelling checker, a grammar checker and a lexical cohesion checker. We have used such resources as WordNet, Link Grammar/parser and Roget's thesaurus for these components. The usefulness of an automatic scoring system depends on its reliability. To measure reliability, we compared the results of automatic scoring with those of manual scoring, on the basis of the Kappa statistics and the Multi-facet Rasch Model. The statistical data obtained from the comparison showed that the scoring system is as reliable as professional human graders. This system deals with textual units rather than sentential units and checks not only formal properties of a text but also its contents.

  • PDF

Applying Rasch Analysis for Validation of School Function Assessment (학교기능평가(School Function Assessment)도구의 구성타당도 검증을 위한 라쉬분석의 적용)

  • Park, Kyoung-Young
    • The Journal of the Korea Contents Association
    • /
    • v.14 no.3
    • /
    • pp.269-276
    • /
    • 2014
  • The purpose of this study is to investigate validation of the School Function Assessment(SFA) for Korean Version using Rasch analysis. The subjects were recruited 98 students with disabilities in Seoul, Kyoung-Ki, Chung-cheung. The data were analysed using Rasch analysis to investigate unidimensionality and rating scale model. The 4 items out of SFA Part II were found to be misfts. The 18 items out of physical tasks, the 14 items out of cognitive/behavioral tasks in Part III were found to be misfit. All rating scale in SFA was appropriate. Further studies are needed to investigate validity and criterion cut-off score for many students with disabilities.

Exploring a Learning Progression for Eight Core Concepts of Middle School Science Using Constructed Response Items in the National Assessment of Educational Achievement (NAEA) (국가수준 학업성취도 평가의 서답형 문항을 이용한 중학교 과학 8개 핵심 개념에 대한 학습발달과정 탐색)

  • Lee, Kiyoung;Dong, Hyokwan;Choi, Wonho;Kwon, Gyeongpil;Lee, Inho;Kim, Yong-Jin
    • Journal of Science Education
    • /
    • v.41 no.3
    • /
    • pp.382-404
    • /
    • 2017
  • This study aims to explore a learning progression for eight core concepts of middle school science using constructed response items in the national assessment of educational achievement (NAEA). For this purpose, a total of 7,390 responses of the 9th graders on 8 constructed response items in NAEA conducted in 2015 were inputted by computer and the inputted answers were analyzed and classified into different levels. After completing this process, five levels were set for each construct and a construct map was created according to the levels. In this study, the construct map was written in a progression-based rubric format, which was used as a criterion for leveling the answers of all students. In addition, the Rasch model was applied to measure the scores and achievements of the respondents by means of statistical analysis to correlate the scores of the students with the achievement levels of the constructs. Lastly, a preliminary learning progression was created by revising the construct map reflecting the results of Rasch model application. This study was meaningful in that it explored the possibility of developing the learning process by using constructed response items in NAEA. However, the preliminary learning progression developed in this study is still hypothetical and inferential because it is not longitudinally traced to individual students. Therefore, it is necessary to continually revise and supplement through iterative research process.

Psychometric Properties of the Vocational Ability Scale in Individuals with Intellectual Disabilities

  • Park, Eun-Young
    • International Journal of Contents
    • /
    • v.15 no.3
    • /
    • pp.1-6
    • /
    • 2019
  • The purpose of this study was to identify the psychometric properties of the vocational ability scale used in the 8th Panel Survey of Employment for the Disabled in Korea by using the Rasch model. The sample data was collected from 398 individuals with intellectual disabilities. Item fitness, item difficulty, the appropriateness of the rating scale, and the separation index of the vocational ability scale were evaluated. All 15 items show an appropriate fitness level. The analysis of item difficulty indicate that modifications are required. Specifically, the need for the addition of less difficult question items is identified. The use of a 5-point rating scale is shown to decrease the test difficulty in terms of clarity and readability when appropriate and a 4-point modification is also determined as appropriate. With respect to the outcomes of the analysis, the person separation reliability value and separation index are high, and the reliability of the items is also high.

A Proposal of Curriculum and Teaching Sequence for Seasonal Change by Exploring a Learning Progression (학습 발달과정 탐색을 통한 계절의 변화 교육과정 및 교수 계열 제안)

  • Heo, Jaewan;Lee, Kiyoung
    • Journal of the Korean earth science society
    • /
    • v.39 no.3
    • /
    • pp.260-274
    • /
    • 2018
  • The purpose of this study was to propose curriculum and teaching sequence for seasonal change by exploring a learning progression. For the purpose, 4 steps of construct modeling approach (specifying construct, item design, outcome space, and measurement model) proposed by Wilson (2005) was applied. In the stage of specifying construct, 'length of shadow according to seasons', 'position of constellation according to seasons', 'seasons of the southern hemisphere and northern hemisphere', 'cause and phenomenon of seasonal change' were selected as the subconstructs of seasonal changes, and constructed a construct map showing the level of development from level 1 to level 4 for each subconstruct based on the results of the previous research. In the item design stage, we developed five assessment items consisting of 3 items in the form of C-E (choose and explain) and two items in the form of CR (constructed response), applied it to 383 elementary, middle and high school students. In the outcome space stage, the students' responses to the assessment items were categorized based on the construct map. The categories were classified into 4 levels according to student ability and scores of 1-4 were given. In the measurement model stage, we applied the partial credit model of the Rasch model and compared whether the learning pathway created from the results of students' response coincides with the construct map. Based on the results of the research, we modified the construct map and finally created hypothetical learning progression on seasonal change. Finally, we proposed an orientation of curriculum amendment and effective teaching sequence for seasonal change.