• Title/Summary/Keyword: rasch analysis

Search Result 91, Processing Time 0.021 seconds

Developing and Assessing a Learning Progression for the Ecosystem (생태계에 대한 학습발달과정의 개발과 평가)

  • Yeo, Chaeyeong;Lee, Hyonyong
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.29-43
    • /
    • 2016
  • There have been much efforts to reconstruct the science curriculum focusing on Disciplinary Core Ideas(DCI) in many countries such as America and Europe, the most practical effort has been to design a curriculum with learning progressions(LPs). LPs describe stepwise how students can systematically move toward the understanding of more sophisticated ideas or scientific activities and explain in succession the process of understanding the ideas while the students learn. In this study, a LP for ecosystems has been developed, and the developed LP is then evaluated accordingly. The Ecosystem is one of the DCI of the life science in Next Generation Science Standards(NGSS). The development process of the LP was set at step 4(Development, Assessment, Analysis, and Amendment), and developed through an iterative process of sequences. As a result of analyzing the developed LP, an assessment based on the LP provides reliable information to identifying student ability. This study proposes the development process of the LP and its methodological aspects to use Core Achievement Standards, Ordered Multiple-Choice items and the Rasch model. In addition, using the empirically proven LP suggests a way of strengthening curriculum linked to educational content, teaching methods and assessment. Utilizing the proposed development process in this study will be to present the standard into the direction of becoming part of the curriculum. Currently, the state of domestic research for the LP is still lacking. This study determined the development process of the LP and the need to conduct future research on the LPs.

Construct Validation of the Sensory Profile for Children with Congenital Cerebral Palsy (뇌성마비 아동을 대상으로 한 감각프로파일(Sensory Profile)의 구성타당도 연구)

  • Yoo, Doo Han;Hong, Deok Gi;Hwang, Sun Jung
    • 재활복지
    • /
    • v.18 no.4
    • /
    • pp.315-330
    • /
    • 2014
  • The purpose of this study was to verify the construct validity of the Sensory Profile for children with congenital cerebral palsy. Parents of 87 children(the ages of 3 to 10) with congenital cerebral palsy participated in this study. The data were analyzed through Winstep version 3.81 using the Rasch model to examine the uni-dimensionality of the fit of each item, the distribution of difficulty of each item, and the reliability and appropriateness of the rating scale. Based on a Rasch analysis, four out of the 87 children were considered to be inappropriate participants, and 15 item of the Sensory Profile was determined to be an inappropriate item. The items of high-level difficulty are needed as new items of the Korean Sensory Profile. The rating scale of three categories were appropriate than those of the five categories. The person and item separation reliability of three categories was above 0.90, which is a relatively excellent value. Finally, it will be need to verify of validity for Korean version of Sensory Profile, to develop new item of a high level of difficulty and convert into three point rating scale.

Psychometric Evaluation of Uterine Cervical Cancer Screening Embarrassment Questionnaire among Korean Women: Complementary Use of Rasch Model

  • Cho, Eun-Jung;Chung, Bok-Yae;Lee, Kwan;Consedine, Nathan S.;Lee, Won-Kee
    • Women's Health Nursing
    • /
    • v.17 no.5
    • /
    • pp.463-473
    • /
    • 2011
  • Purpose: Cervical cancer can be prevented by regular cervical screening. Embarrassment has been reported as one important barrier to cervical screening uptake. The absence of appropriate instrumentation, however, has limited our understanding of the links between embarrassment and health care outcomes. The purpose of this study was to evaluate psychometric attributes of the uterine cervical cancer screening embarrassment questionnaire. Methods: A convenience sample for field study was recruited from four gynecological clinics in Gyeongju, Korea. Within a cross-sectional descriptive design, 339 women who had cervical screening completed self-administered measures of embarrassment including a visual analogue, general medical embarrassment, dispositional embarrassment, and Pap smear related negative emotion. Results: Rasch analysis of items demonstrated the evidence of one-dimensional construct and good 7-point rating scales functioning. Factor analysis revealed that uterine cervical cancer screening embarrassment was comprised of two domains-bodily manifestations and perceiving an undesirable social face. Construct validity was demonstrated by a high subscale-to-subscale correlation. Convergent and discriminant validity was evidenced by significant correlations with a 100 mm VAS scale, general medical embarrassment, and Pap smear related negative emotion. Known-group validity was established by comparing women with high versus low trait embarrassment. Both two sub-scales and overall scale demonstrated good internal reliability. Conclusion: The Uterine uterine cervical cancer screening questionnaire is a reliable and valid instrument suited to assessing the manifestations of embarrassment during screening. The use of instrument can be extended to understand the client's embarrassment undergoing health examinations which require the exposure of their private parts.

A FACETS Analysis of Rater Characteristics and Rater Bias in Measuring L2 Writing Performance

  • Shin, You-Sun
    • English Language & Literature Teaching
    • /
    • v.16 no.1
    • /
    • pp.123-142
    • /
    • 2009
  • The present study used multi-faceted Rasch measurement to explore the characteristics and bias patterns of non-native raters when they scored L2 writing tasks. Three raters scored 254 writing tasks written by Korean university students on two topics adapted from the TOEFL Test of Written English (TWE). The written products were assessed using a five-category rating scale (Content, Organization, Language in Use, Grammar, and Mechanics). The raters only showed a difference in severity with regard to rating categories but not in task types. Overall, the raters scored Grammar most harshly and Organization most leniently. The results also indicated several bias patterns of ratings with regard to the rating categories and task types. In rater-task bias interactions, each rater showed recurring bias patterns in their rating between two writing tasks. Analysis of rater-category bias interaction showed that the three raters revealed biased patterns across all the rating categories though they were relatively consistent in their rating. The study has implications for the importance of rater training and task selection in L2 writing assessment.

  • PDF

Psychometric Properties of the WeeFIM in Korean Children With Cerebral Palsy

  • Park, So-Yeon;Park, Eun-Young
    • Physical Therapy Korea
    • /
    • v.17 no.4
    • /
    • pp.41-48
    • /
    • 2010
  • The WeeFIM is an outcome measure used worldwide to evaluate the functional abilities of children. The aim of this study was to evaluate the psychometric properties of WeeFIM in Korean children with cerebral palsy (CP) using the Rasch model. The mean age of the participants (92 boys and 53 girls) was 10.6 years (SD=2.3, range 5~15 years). The Winsteps software was used for analyzing the internal construct validity and reliability of WeeFIM. For analyzing the internal validity the motor and cognitive area items of the WeeFIM were analyzed both together and separately. When all 18 items were analyzed 4 were considered to be misfits; upper extremity dressing, lower extremity dressing, toileting, and comprehension. When only the 13 motor items were analyzed, toileting, bladder management, and bowel management were considered misfits. In addition, only comprehension was considered as a misfit among the 5 cognitive items. The most difficult motor items were stair climbing, and bathing. The simple ones were eating, bowel management, and bladder management. The most difficult cognitive item was problem solving, and the simplest one was comprehension. The person separation indexes and reliability for combined and divided instruments were reported as excellent. These results demonstrated the applicability of WeeFIM to Korean CP children with satisfactory reliability and validity. Further studies should include young children with CP and compare item difficulty among the different types of CP. In addition, the Korean normative data of nondisabled children should be used to compare the cultural differences between Korea and other countries.

A Comparative Study of Item Difficulty Hierarchy of Self-Reported Activity Measure Versus Metabolic Equivalent of Tasks

  • Choi, Bong-Sam
    • Physical Therapy Korea
    • /
    • v.20 no.3
    • /
    • pp.89-99
    • /
    • 2013
  • The purposes of this study were: 1) to show the item difficulty hierarchy of walking/moving construct of the International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM), 2) to evaluate the item-level psychometrics for model fit, 3) to describe the relevant physical activity defined by level of activity intensity expressed as Metabolic Equivalent of Tasks (MET), and 4) to explore what extent the empirical activity hierarchy of the ICF-AM is linked to the conceptual model based on the level of energy expenditure described as MET. One hundred and eight participants with lower extremity impairments were examined for the present study. A newly created activity measure, the ICF-AM using an item response theory (IRT) model and computer adaptive testing (CAT) method, has a construct on walking/moving construct. Based on the ICF category of walking and moving, the instrument comprised items corresponding to: walking short distances, walking long distances, walking on different surfaces, walking around objects, climbing, and running. The item difficulty hierarchy was created using Winstep software for 20 items. The Rasch analyses (1-parameter IRT model) were performed on participants with lower extremity injuries who completed the paper and pencil version of walking/moving construct of the ICF-AM. The classification of physical activity can also be performed by the use of METs that is often preferred to determine the level of physical activity. The empirical item hierarchy of walking, climbing, running activities of the ICF-AM instrument was similar to the conceptual activity hierarchy based on the METs. The empirically derived item difficulty hierarchy of the ICF-AM may be useful in developing MET-based activity measure questionnaires. In addition to convenience of applying items to questionnaires, implications of the finding could lead to the use of CAT method without sacrificing the objectivity of physiologic measures.

Exploring the Progression of Meta-Modeling Knowledge (MMK) and Relationship between MMK Progression Level and Actual Practice for Science Gifted (과학영재 학생들의 메타모델링 지식(MMK) 발달 및 MMK 발달수준과 실제 수행과의 관계 탐색)

  • Kim, Jung-Eun;Kim, Sungki;Paik, Seoung-Hey
    • Journal of the Korean Chemical Society
    • /
    • v.64 no.2
    • /
    • pp.111-118
    • /
    • 2020
  • The purpose of this study is to explore the progression of MMK and the relationship between MMK progression level and actual practice. First, the Rasch model was used to measure MMK progression level of 51 students twice during the interval of one year. Thereafter, chi-squared test was used to determine whether there was a significant change in MMK progression. As a result of chi-squared test, there was no statistically significant change in MMK progression (p>.05). Secondly, we analyzed the relationship between MMK progression level and practice for 7 gifted students. As a result of the analysis, it was confirmed that the student's response in practice can not exceed MMK progression level. There were also cases where students have high MMK progression level showed low response in practice. The results of these two studies show that gifted education programs are needed to increase MMK progression and to provide gifted education that can connect knowledge and practice.

Equating Two Health-related Quality of Life Instruments Applied to Cancer Survivors Who Underwent Palliative Care

  • Bongsam Choi;Heesu Kim;Sunhwi Bang;Byunggwan Kim;Jaekwang Shim
    • Physical Therapy Korea
    • /
    • v.30 no.1
    • /
    • pp.32-40
    • /
    • 2023
  • Background: Equating is a statistical procedure used to create a common measurement scale across two instruments. Item-level information should be taken into consideration so that scores can communicate interchangeably across the instruments. Objects: To investigate a common measurement scale across two health-related quality of life questionnaires (HRQOL) applied to various cancer survivors who underwent palliative care in healthcare institutions. Methods: A total of 139 cancer survivors who underwent palliative care were recruited from two rehabilitation hospitals and an oriental medicine hospital. Participants consisted of various cancer survivors who presented to the sites for palliative care. They were asked to fill out Korean versions of the World Health Organization Quality of Life (WHOQOL-BREF) and EuroQOL-5 dimension (EQ-5D) questionnaires following the palliative care. For the item level comparison, the Rasch rating scale model was used to investigate how participants regarded individual test items of two instruments in relation to item difficulty calibrations. Results: All items except the three items fit the Rasch model. One item (anxiety/depression) of the EQ-5D and two items (dependence on medical aids and negative feelings) of the WHOQOL-BREF are misfit. The WHOQOL-BREF targets the survivors well, while the EQ-5D is able to target the survivors with lower HRQOL levels with some ceiling effects. By inspecting the item difficulty calibrations of the two instruments, five items of the WHOQOL-BREF are selected as common items in relation to the EQ-5D. These five items are considered compatible with each other. Differential item functioning (DIF) analysis reveals that the healthcare item of the WHOQOL-BREF vs the self-care item of the EQ-5D exhibits significant DIF. Conclusion: Findings suggest that one paired item should be taken into consideration when equating the WHOQOL-BREF and the EQ-5D applied to cancer survivors who underwent palliative care.

Exploring the Latent Trait and the Measurement Properties of Korean World Health Organization Quality of Life-BREF Measure Applied to Cancer Survivors

  • Bongsam Choi
    • Physical Therapy Korea
    • /
    • v.30 no.2
    • /
    • pp.120-127
    • /
    • 2023
  • Background: In general, measurement qualities of cross-culturally adapted quality of life (QOL) measures are altered in many aspects, although versions of them are well-validated measures. The latent trait and measurement qualities of the QOL measures for cancer-related samples should be considered when developing cross-culturally adapted measures. Objects: To investigate the latent trait of the translated into Korean World Health Organization Quality of Life-BREF (WHOQOL-BREF) administered to different cancer survivors who had palliative rehabilitation care service (PRCS). Methods: A cross-sectional study with 139 cancer survivors who had an experience of cancer survivorship with PRCS were conducted with a two-step analytic procedure including exploratory factor analysis (EFA) to confirm the latent trait and Rasch rating scale modeling to investigate the measurement qualities of the cross-culturally adapted WHOQOL-BREF measure. Results: While the original WHOQOL-BREF measure constitutes a 4-latent trait, the EFA reveals that 24 items constitute six substantial factors. The item loadings are predominantly spread over factors 1 through 4 in a mixed manner of the latent traits, while the loadings of 'physical health' and 'environmental health' latent traits show similarity to what the original measure intended to assess. The latent trait of the cross-culturally adapted WHOQOL-BREF measure administered to different cancer survivors is likely to reveal more dimensions than the original WHOQOL-BREF measure. Person reliability (i.e., analogous to Cronbach's alpha) and separation are measured with 0.92 and 3.48, respectively. All items except the one item (medical treatment item) fit the Rasch rating model. Conclusion: Findings suggest that the latent trait and the measurement qualities of the cross-culturally adapted WHOQOL-BREF measure should be taken into consideration when applying versions of it to various populations.

Development and Validation of a Learning Progression for Astronomical Systems Using Ordered Multiple-Choice Items (순위 선다형 문항을 이용한 천문 시스템 학습 발달과정 개발 및 타당화 연구)

  • Maeng, Seungho;Lee, Kiyoung;Park, Young-Shin;Lee, Jeong-A;Oh, Hyunseok
    • Journal of The Korean Association For Science Education
    • /
    • v.34 no.8
    • /
    • pp.703-718
    • /
    • 2014
  • This study sought to investigate learning progressions for astronomical systems which synthesized the motion and structure of Earth, Earth-Moon system, solar system, and the universe. For this purpose we developed ordered multiple-choice items, applied them to elementary and middle school students, and provided validity evidence based on the consequence of assessment for interpretation of learning progressions. The study was conducted according to construct modeling approach. The results showed that the OMCs were appropriate for investigating learning progressions on astronomical systems, i.e., based on item fit analysis, students' responses to items were consistent with the measurement of Rasch model. Wright map analysis also represented that the assessment items were very effective in examining students' hypothetical pathways of development of understanding astronomical systems. At the lower anchor of the learning progression, while students perceived the change of location and direction of celestial bodies with only two-dimensional earth-based view, they failed to connect the locations of celestial bodies with Earth-Moon system model, and they could recognized simple patterns of planets in the solar system and milky way. At the intermediate levels, students interpreted celestial motion using the model of Earth rotation and revolution, Earth-Moon system, and solar system with space-based view, and they could also relate the elements of astronomical structures with the models. At the upper anchor, students showed the perspective change between space-based view and earth-based view, and applied it to celestial motion of astronomical systems, and they understood the correlation among sub-elements of astronomical systems and applied it to the system model.