• Title/Summary/Keyword: the Rasch Model

Search Result 87, Processing Time 0.032 seconds

Exploring Concurrent Validity and Item Level Analysis for Two Korean Versions of Health-Related Quality of Life Instrument: EQ-5D vs. WHOQOL-BREF

  • Choi, Bongsam
    • Physical Therapy Korea
    • /
    • v.27 no.4
    • /
    • pp.233-240
    • /
    • 2020
  • Background: Cross-culturally adapted questionnaires may not be comparable to their original version. Objects: To examine concurrent validity of two health-related quality of life (HRQOL) instruments for the Korean versions of EuroQOL-5 Dimension (EQ-5D) and the abbreviated version of the World Health Organization Quality of Life (WHOQOL-BREF) instrument. Methods: A total of 139 cancer survivors from two rehabilitation institutes was recruited. All participants were registered for palliative rehabilitation care. Both instruments were concurrently administered by health care providers following the second bout of the rehabilitation cares. Rasch partial credit model and Spearman's correlation analysis were used to investigate: 1) dimensionality, 2) hierarchical item difficulty, and 3) concurrent validity using correlations between two instruments. Results: For the WHOQOL-BREF, all items except negative feeling, pain, dependence of medical aid, were found to be acceptable, while all items of EQ-5D were acceptable. There was an evidence of negative correlations between EQ-5D and 4 domains of WHOQOL-BREF. Two correlations were strong (EQ-5D vs. physical health domain, ρ = -0.610, 95% CI = -0.716 to -0.475) and moderate (EQ-5D vs. psychosocial domain, ρ = -0.402, 95% CI = -0.546 to -0.236). Other two correlations were weak (EQ-5D vs. social relationship and environmental domains, ρ = -0.242, 95% CI = -0.401 to -0.075 and ρ = -0.364, 95% CI = -0.514 to -0.207, respectively). Item difficulty calibrations of the two measurements were ranged from -0.84 to 0.86 for the EQ-5D and -1.07 to 1.06 for the WHOQOL-BREF. Conclusion: The study provides some supports for the concurrent validity of the two Korean versions of HRQOL instrument, with evidences of weak to strong correlations between the EQ-5D and four domains of the WHOQOL-BREF applied to various cancer survivors. Additionally, the cancer survivors appeared to have more of a tendency to view the EQ-5D items as being slightly more challenging than the WHOQOL-BREF items.

A Study on Graduate Attributes Assessment for K-EP (K-Engineering Professional) Qualification (K-EP(K-Engineering Professional) 자격을 위한 졸업생역량 평가방안 연구)

  • Choi, Se Hyu;Kang, Sang Hee;Kim, Jung Soo;Yoon, Jiyoung
    • Journal of Engineering Education Research
    • /
    • v.24 no.6
    • /
    • pp.30-39
    • /
    • 2021
  • The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

Goodness-of-Fit of Job Burnout Scale in Private Security Guards (민간경비원을 위한 직무소진 척도 문항의 적합도)

  • Lee, Jun-Woo;Lee, Jong-Hwan;Kim, Eui-Young
    • Korean Security Journal
    • /
    • no.39
    • /
    • pp.161-183
    • /
    • 2014
  • The job burnout of the private security guards who provide services through contact with customers can affect the overall the private security industry. So the managers need to make efforts to diagnose and evaluate the job burnout and provide continuous provision for the repatriation effect. However, up to the present, the job burnout measure for the private security guards has not been provided, so the objectivity of the information is questionable. For this reason, in order to establish the goodness of fit of the job burnout scale for private security guards based on the contents of the job burnout scale that was being provided to other service employees, this research aims to provide the scale to provide objective information compared with that of the past by applying the Rasch model of the item response theory. To achieve this purpose, the data on 379 private security guards working for the private security guard companies in the Gyeonggi region were collected, and the data were processed to suit the research purpose using SPSS 18.0 and AMOS 18.0, Winsteps programs. Through these research procedures, the following conclusion was obtained. With regard to the private security guards' measure of job burnout, as a result of factor analysis through the collected data, 4 questions were deleted, and as a result of the analysis of the goodness of the fit based on 18 questions, 4 questions were found to be inappropriate questions that did not satisfy the standard value, and the scope of the difficulty level of the questions from - 98 to 1.30 and the response reaction of a 5-point scale were found to suit the final private security guards' job burnout scale. In other words, the conclusion that it is appropriate to measure the private security guards job burnout scale with 3 factors and 13 questions was obtained. So if private security guards companies collect systematic data using the scale established in this research, and practice refresher training accordingly, they can reduce the private security guards' job burnout.

  • PDF

The Development and Validation of Instrument for Measuring High School Students' STEM Career Motivation (고등학생들을 위한 이공계 진로동기 검사도구 개발 및 타당화)

  • Shin, Sein;Ha, Minsu;Lee, Jun-Ki
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.75-86
    • /
    • 2016
  • The purpose of the present study is to develop and validate an instrument to assess STEM career motivation. We developed 32 items for 7 constructs (i.e. education experience, career value, academic self-efficacy, career self-efficacy, career interest, parents' support, and career motivation) on STEM career motivation based on Social Cognitive Career Theory (SCCT; Lent et al.,1994). 767 first year high school students participated in this study. The items were validated by Messick's framework (1995). In this study, we examined the validity of items in four aspects (i.e. content, substantive, structural and generalizability of validity). Methodologically, we used Rasch analysis, Exploratory factor analysis, confirmative factor analysis based on structural equation modelling. We confirmed that our instrument with 32 items as valid and reliable for measuring the STEM career motivation. In addition, we tested the STEM career motivation model based on SCCT. Our model explained the data well, suggesting that external factors (education experience and parents' support) and cognitive factors (perception of value, self-efficacy and interest) were significantly related to STEM career motivation.

The Classification Ability with Naked Eyes According to the Understanding Level about Rocks of Pre-service Science Teachers (예비 과학교사들의 암석에 대한 이해수준에 따른 육안분류 능력)

  • Park, Kyeong-Jin;Cho, Kyu-Seong
    • Journal of the Korean earth science society
    • /
    • v.35 no.6
    • /
    • pp.467-483
    • /
    • 2014
  • This study aimed to investigate the classification ability with naked eyes according to the understanding level about rocks of pre-service science teachers. We developed a questionnaire concerning misconception about minerals and rocks. The participants were 132 pre-service science teachers. Data were analyzed using Rasch model. Participants were divided into a master group and a novice group according to their understanding level. Seventeen rocks samples (6 igneous, 5 sedimentary, and 6 metamorphic rocks) were presented to pre-service science teachers to examine their classification ability, and they classified the rocks according to the criteria we provided. The study revealed three major findings. First, the pre-service science teachers mainly classified rocks according to textures, color, and grain size. Second, while they relatively easily classified igneous rocks, participants were confused when distinguishing sedimentary and metamorphic rocks from one another by using the same classification criteria. On the other hand, the understanding level of rocks has shown a statistically significant correlation with the classification ability in terms of the formation mechanism of rocks, whereas there was no statistically significant relationship found with determination of correct name of rocks. However, this study found that there was a statistically significant relationship between the classification ability with regard to formation mechanism of rocks and the determination of correct name of rocks.

Analyzing Korean Pre-service Biology Teachers' Understanding of the Concept of Natural Selection in Comparison with Chinese, American, and German Biology Majors (중국, 미국, 독일의 생물전공자와 비교한 한국 생물예비교사의 자연선택개념 이해 수준 분석)

  • Ha, Minsu
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.5
    • /
    • pp.729-737
    • /
    • 2016
  • Natural selection is the core idea of evolution that pre-service biology teachers need to understand to solve diverse biological problem. This study aims to investigate the level of Korean pre-service biology teachers' understanding of natural selection by comparing their knowledge with their Chinese, American, and German biology major undergraduate counterparts. In particular, this study focuses on two conceptual components of natural selection (i.e., ecology and genetics). This study used a total 1226 pre-service biology teachers and biology majors' data. The instrument measuring the understanding of natural selection concepts was Conceptual Inventory of Natural Selection, which consists of ten ecology concept items and ten genetics concept items. The Rasch model analysis, multivariate analysis of variance, and univariate analysis of variance were used for the statistical tests. The result reveals that the level of Korean pre-service biology teachers' understanding of natural selection were similar with Chinese undergraduates' understanding and significantly lower than American and German undergraduates.' In the first year student data, the level of genetics concept of Korean pre-service biology teachers were significantly lower than Chinese and German students. In the fourth year student data, the level of ecology concept of Korean pre-service biology teachers were significantly lower than American and German students. Based on these results, the ecology concept education and balanced natural selection concept education are discussed.

Present States, Methodological Features, and an Exemplar Study of the Research on Learning Progressions (학습 발달과정 연구의 현황, 방법론적 특징 및 연구 사례)

  • Maeng, Seungho;Seong, Yeonseon;Jang, Shinho
    • Journal of The Korean Association For Science Education
    • /
    • v.33 no.1
    • /
    • pp.161-180
    • /
    • 2013
  • The purpose of this paper is to introduce the current studies and research methods about Learning Progressions disseminated to several countries including the U.S. since 2006. It also provides a methodological base to investigate learning progressions in science by introducing a case study of learning progression conducted in Korea. For this study, we described several features of current studies on learning progressions in the U.S., and reported the common ways and sequences employed in examining learning progressions especially with respect to assessment for learning. Learning progressions are descriptions of developmental pathways of learning a topic, in which science knowledge is used in students' engaging in science practices. Each learning progression consists of upper anchor, lower anchor, and intermediate steps that connect both anchors. In investigating a learning progression, researchers usually utilize Wilson's four building blocks of assessment system based on the assessment triangle. This kind of method was also applied in investigating the learning progression for water cycle in this study. We discussed implication and consideration for the future research on learning progressions in science in Korea.