• Title/Summary/Keyword: Item Reliability

Search Result 987, Processing Time 0.026 seconds

Development of Korean Osteoarthritis Impact Measurement Scale(KAIMS) : from data collection to item development in the first study (한국형 골관절염영향측정도구 개발 - 자료수집에서 1차 문항개발까지 -)

  • Yi, Seung-Ju;Kim, Yeon-Ju
    • Journal of Korean Physical Therapy Science
    • /
    • v.19 no.1
    • /
    • pp.17-25
    • /
    • 2012
  • Purpose : The aim of this study was from data collection to item development in the first study before developing a valid and reliable instrument reflecting Korean's own language expression and culture. Methods : The fist survey was 140 osteoarthritis(OA) patients in 2 Cites was studied from November to December 2009. Open-ended questionnaire was decided 39 items from the first open survey. Questionnaire on the Korean Osteoarthritis Impact Measurement Scale(KAIMS) was recruited 2 professors and 5 physical therapists. Second survey was applied to 133 OA patients. Results : OA patients's average age${\pm}$standard deviation was $66.08{\pm}11.10$ years. The internal consistency reliability of 3 items. As estimated by Cronbach's alpha coefficient(${\alpha}$), was high(range, 0.86~0.96). 0.43~0.91 ${\alpha}$ coefficient for the internal consistency reliability of item-each scale was also high. However, item-discriminant validity on 3 items was low(${\alpha}$, 0.92~0.97). The construct validity by factor analysis was a little low. Conclusion : This study revealed that we confirmed a generation for 39 items on KAIMS reflecting Korean's own language expression and culture. Also, those of reliability were a little high. And, we will have to study the last instrument development (3rd study) by more subjects in the future.

  • PDF

Development of a lesbian, gay, bisexual, and transgender cultural competence scale for nurses in South Korea: a methodological study

  • Min Kyung Kim;Hye Young Kim
    • Women's Health Nursing
    • /
    • v.30 no.2
    • /
    • pp.107-116
    • /
    • 2024
  • Purpose: This study was conducted to develop a cultural competence scale for nurses regarding the lesbian, gay, bisexual, and transgender (LGBT) community and to test its validity and reliability. Methods: The study adhered to the 8-step process outlined by DeVellis, with an initial set of 25 items derived through a literature review and individual interviews. Following an expert validity assessment, 24 items were validated. Subsequently, a preliminary survey was conducted among 23 nurses with experience caring for LGBT patients. Data were then collected from a final sample of 322 nurses using the 24 items. Item analysis, item-total score correlation, examination of construct and convergent validity, and reliability testing were performed. Results: The item-level content validity index exceeded .80, and the explanatory power of the construct validity was 63.63%. The factor loadings varied between 0.57 and 0.80. The scale comprised five factors: cultural skills, with seven items; cultural awareness, with five items; cultural encounters, with three items; cultural pursuit, with three items; and cultural knowledge, with three items; totaling 21 items. Convergent validity demonstrated a high correlation, affirming the scale's validity. Internal consistency analysis yielded an overall reliability coefficient of 0.97, signifying very high reliability. Each item is scored from 1 to 6 (total score range, 21-126), with higher scores reflecting greater cultural competence in LGBT care. Conclusion: This scale facilitates the measurement of LGBT cultural competence among nurses. Therefore, its use should provide foundational data to support LGBT-focused nursing education programs.

An Analysis of Assessment Item on the Fraction Computation Ability for Fifth Grade Student (초등학교 5학년 학생들의 분수 연산능력 평가 문항에 대한 분석)

  • Lee Kang Sup;Kim Kyou Sang
    • Education of Primary School Mathematics
    • /
    • v.8 no.2 s.16
    • /
    • pp.61-68
    • /
    • 2004
  • The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

  • PDF

Development of a Teacher Rating Scale of Childcare Adaptation for Infants and Toddlers (교사용 영아 어린이집 적응 척도 개발)

  • Shin, Nary;Yun, Hyun Jeong
    • Korean Journal of Child Studies
    • /
    • v.37 no.6
    • /
    • pp.35-56
    • /
    • 2016
  • Objective: This study aimed to develop and validate the Childcare Adaptation Scale for Infants and Toddlers (CASIT), which is rated by teachers of Korean children. Methods: The participants consisted of 326 childcare teachers working with infants (ages 0-2 years). Content validity, discriminant validity, convergent validity, concurrent validity, internal consistency, inter-rater reliability, and item discrimination were examined using PASW 18.0 and AMOS 19.0. Results: The results of an exploratory factor analysis identified the 29-item scale and six dimensions of the scale, including group life adaptation, negative behaviors, positive affect, regular routines, activity/interest, and peer interaction. Convergent validity was examined via confirmatory factor analysis, average variation extracted (AVE), and construct reliability, and acceptable evidences of convergent validity was established. The scales were shown to be highly consistent internally and among raters. Also, the mean between the upper group and lower group of each item regarding item discrimination showed a significant difference. Conclusion: It was concluded that the CASIT, which is a quick and convenient tool for teachers to use, is a valid and reliable instrument.

Test Analysis of the 「General Computer」 in College Scholastic Ability Test (대학수학능력시험 직업탐구영역의 「컴퓨터 일반」 교과 문항 분석)

  • Kim, JongHye;Kim, Yong;Kim, JaMee;Lee, WonGyu
    • The Journal of Korean Association of Computer Education
    • /
    • v.9 no.6
    • /
    • pp.11-18
    • /
    • 2006
  • The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

  • PDF

The Development of Maternal Conflict Scale- for mothers whose over toddler ~below preschool child - (모성갈등 도구개발 - 유아기에서 학령전기 자녀가 있는 어머니를 대상으로 -)

  • Lee Seon-Ah
    • Child Health Nursing Research
    • /
    • v.8 no.3
    • /
    • pp.291-301
    • /
    • 2002
  • This study was performed to develop a scale of maternal conflict based on already established scales and the literature review. The major purpose of this study was to develop a scale of which contains difficulties which mother can feel to rearing her child and can be applied to mothers at home or employed mothers. 68 items were developed. For content validity test, the items were examined by 7 experts panel with Likert 4 scale. The 39 items were selected as high validity from 86% of the experts. The item number of each area and the misunderstanding words were corrected by advices of experts. 10 mothers again examined 39 items in order to correct the misunderstanding words and the long sentences. For reliability and factor analysis of 39 items, 496 mothers participated. 34 items were chosen because 5 items that corrected item-total correlation coefficient were lower than 0.2 were excluded by the result of reliability analysis. Factor analysis was done with 34items. 6 factors were classified higher than eigen value 1.0, 28 items were chosen because 6 items that factor loadings were lower than 0.4 were excluded. These factors were named as employment and caring for child(6 items), child education(5 items), support system for caring for child(4 items), interaction with mother and child(4 items), view of maternal role(5 items) and me as human being(4 items). Reliability analysis was done with 28 items. 1 item(36 number of factor 1) was excluded because corrected item-total correlation coefficient were lower than 0.2. Therefore, 27 items were chosen. Maternal Conflict Scale was contained 27 items. The corrected item-total correlation coefficient of 27 items were ranged from .2345 to .5240 and Cronbach alpha coefficient of those was .8207 by the results of reliability analysis. It can be evaluated that this scale had a high validity and reliability because of passing through an objective process of test.

  • PDF

Reliability and Validity of The Korean Version Scale of Impact of Weight on Quality of Life in $Kids^{(C)}$ (한국어 버전 청소년의 체중 관련 삶의 질 측정도구의 신뢰도와 타당도 검증)

  • Kim, Jeoung-Hyun;Chun, Sungsoo;Choi, Han-Sik
    • The Journal of Korean Society for School & Community Health Education
    • /
    • v.15 no.3
    • /
    • pp.105-125
    • /
    • 2014
  • Background: The purpose of this study was to evaluate reliability and validity of a 27-item Korean Version of the Impact of Weight on Quality of Life in adolescents ($IWQOL-Kids^{(C)}$: Korean Version). Methods: This instrument was administered to 872 adolescents (mean z-BMI: 2.61, mean $age{\pm}SD$: $13.9{\pm}1.2$, male: 51.9%). Reliability was tested by internal consistency method and item analysis, validity test was performed by index of content validity, exploratory factor analysis, confirmatory factor analysis and concurrent validity. Sensitivity was tested by ANOVA and t-test. Analyses were performed using SPSS and Amos 18.0. Results: By an exploratory factor analysis, 4 factors were extracted; 'Body esteem' consisted of 9 items with 35.9% of variance (social life: 6 items, 10.23%, physical comfort: 6 items, 8.21%, family relations: 6 items, 7.0%). Four factors explained 61.34% of total variance. Internal consistency coefficients ranged from .766 to .929 for scales on 27 items and equal to .920 for total score for both the 26-item and 27-item tools. A confirmatory factor analysis was conducted for the convergent validity and discriminant validity. The standardized factor loadings to test the convergent validity showed more than .5(C.R<1.965) on all paths after deletion of item PC1 (avoid stairs). The average variances extracted were more than .50 and the construct reliabilities were more than .70. The average variances extracted were stronger than the squares of correlation coefficient of inter-latent variables. Conclusions: These results support that the $IWQOL-Kids^{(C)}$: Korean Version with a 26-item is a reliable and valid tool in Korean obese adolescents.

  • PDF

Validity and Reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in Knee Osteoarthritis Patients (골관절염영향측정척도(AIMS-SF)의 타당도 및 신뢰도 - 일부 슬관절 골관절염 환자를 대상으로 -)

  • Yi, Seung-Ju;Nam, Tae-Ho
    • The Journal of Korean Physical Therapy
    • /
    • v.19 no.5
    • /
    • pp.29-41
    • /
    • 2007
  • Purpose: The aim of this study was to examine the validity and reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in patients with knee osteoarthritis(OA). Methods: The sample consisted of 62 patients who had received physical therapy at the physical therapy units of the Andong Medical Center, Sungso Hospital, Ahn Orthopedic Surgery Clinic, and St. Luke Clinic in Andong city in June 2006. Questionnaire on the AIMS-SF was recruited by 5 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, Pearson's relation coefficient. To explore construct validity we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. Results: 62 OA patients's an average $age{\pm}standard$ deviation was $53.8{\pm}14.4$ years (range: $40{\sim}81$ yr). The internal consistency reliability of 11 items, as estimated by Cronbach's ${\alpha}$ coefficient, was high ranging $0.60{\sim}0.78$ (except for 0.40 for mobility level and -0.48 for mood). The internal consistency reliability of item-each scale was also high $0.82{\sim}0.93$ (except for 0.48 for mood). Of 11 items, the item-discriminant validity on 6 items was high (${\alpha}$ coefficient range: $0.11{\sim}0.25$), however, others (0.57 for tension level, 0.48 for arthritis pain, 0.41 for walking and bending, and 0.40 for work) were a little low. The construct validity by factor analysis was a little low. Conclusion: In conclusion, the results reported here confirm the validity and reliability of the AIMS-SF in patients with OA of the knee. The Collection of information on health status using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

  • PDF

Self-esteem item goodness-of-fit in sports talented children (스포츠영재들의 자아존중감 문항적합도)

  • Kim, Eung-Joon;Kim, Jong-Kyu;Lee, Nam-Ju;Lee, Mi-Sook
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.3
    • /
    • pp.487-494
    • /
    • 2011
  • The purpose of this study was to investigate self-esteem item goodness-of-fit in sports talented children with socio-psychological aspect, which may be a basis of developing global sports leaders. Fifty children who were selected by 2010 sports talent identification program at Korea National Sport University participated in this study. All participants were asked to answer the questionnaire using Rogenberg (1965) self-esteem scale. Total 8 questions were used with 4 point Likert scale and high point stands for higher self-esteem status. Reliability of Cronbach's ${\alpha}$ was.785 in this study. Frequency analysis, descriptive statistics, and reliability analysis were conducted with SPSS 18.0. WINSTEPS 3.70 (Linacre, 2010) was used for calculating item goodness-of-fit and subject reliability, scale propriety, item goodness-of-fit and item level of difficulty, and level of difficulty were calculated. Statistical analysis showed results as follows. First, it was reported to be suitable for subject reliability in self-esteem as 1.01~1.03 and item reliability as 1.01~1.01. Second, 4 scale was suitable for scale propriety resulting from stage index judgment. Third, 2,7,8 and 3 question showed problems in item goodness-of-fit and item level of difficulty. Finally, scale propriety was reported to be inappropriate for considering sports talented children's ability distribution and scale level of difficulty.

Validity and Reliability of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC)-VA3.0 in Hip and Knee Osteoarthritis Patients (WOMAC-VA3.0의 타당도 및 신뢰도 -일부 슬관절 및 고관절 골관절염환자를 대상으로-)

  • Yi, Seung-Ju;Lee, Hyun-Ju;Woo, Young-Keun
    • Physical Therapy Korea
    • /
    • v.15 no.2
    • /
    • pp.20-29
    • /
    • 2008
  • The purpose of this study was to examine the validity and reliability of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC)-VA3.0 in patients with hip and knee osteoarthritis (OA). The sample consisted of 301 patients who had received treatments at the physical therapy units of 5 medical institutions in Andong City in june 2006. Questionnaires on the WOMAC were recruited by 12 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency (Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, and Pearson's relation coefficient. To explore construct validity, we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. The average age of the patients was 62.1 years. All WOMAC subscales (pain, stiffness, and physical function) were internally consistent with Cronbach's coefficients of .81, .91, and .80, respectively. The internal consistency reliability of item-each scale were also internally consistent with Cronbach's coefficient of .89 (Pearson's correlation coefficient: .71~.84), .93 (.89~.91), and .96 (.67~.91), respectively. However, high correlation was found among 3 items (.66~.83, .66~.67, and .67~.83), so the item-discriminant validity was low (${\alpha}$ coefficient: .81, .91, .80, respectively). The construct validity by factor analysis was low because it was not consistent With WOMAC-VA3.0. In conclusion, the results reported here confirm the reliability of the WOMAC in patients with OA of the hip and knee. The collection of information on the hip and knee osteoarthritis using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

  • PDF