• 제목/요약/키워드: Item Reliability

검색결과 982건 처리시간 0.029초

한국어판 욕창예방지식도구의 고전검사이론과 문항반응이론을 적용한 문항분석, 타당도와 신뢰도 (Item Analysis using Classical Test Theory and Item Response Theory, Validity and Reliability of the Korean version of a Pressure Ulcer Prevention Knowledge)

  • 강명자;김명수
    • Journal of Korean Biological Nursing Science
    • /
    • 제20권1호
    • /
    • pp.11-19
    • /
    • 2018
  • Purpose: The purposes of this study were to perform items analysis using the classical test theory (CTT) and the item response theory (IRT), and to establish the validity and reliability of the Korean version of pressure ulcer prevention knowledge. Methods: The 26-item pressure ulcer prevention knowledge instrument was translated into Korean, and the item analysis of the 22 items having an adequate content validity index (CVI), was conducted. A total of 240 registered nurses in 2 university hospitals completed the questionnaire. Each item was analyzed applying CTT and IRT according to 2-parameter logistic model. Response alternatives quality, item difficulty and item discrimination were evaluated. For testing validity and reliability, Pearson correlation coefficient and Kuder Richardson-20 (KR-20) were used. Results: Scale CVI was .90 (Item-CVI range= .75-1.00). The total correct answer rate for this study population was relatively low as 52.5%. The quality of response alternatives was found to be relatively good (range= .02-.83). The item difficulty of the questions ranged form .10 to .86 according to CTT and -12.19 to 29.92 according to the IRT. This instrument had 12-low, 2-medium and 8-high item difficulty applying IRT. The values for the item discrimination ranged .04-.57 applying CTT and .00-1.47 applying IRT. And overall internal consistency (KR-20) was .62 and stability (test-retest) was .82. Conclusion: The instrument had relatively weak construct validity, item discrimination according to the IRT. Therefore, the cautious usage of a Korean version of this instrument would be recommended for discrimination because there are so many attractive response alternatives and low internal consistency.

뇌졸중 환자를 대상으로 실시한 한글판 기능적 보행평가의 타당도 (Validation of the Korean Functional Gait Assessment in Patients With Stroke)

  • 박소연
    • 한국전문물리치료학회지
    • /
    • 제23권2호
    • /
    • pp.35-43
    • /
    • 2016
  • Background: The Functional Gait Assessment (FGA) was developed to measure of gait-related activities. The FGA was translated in Korean but only a few psychometric characteristics had been studied. Objects: The purpose of this study was to evaluate the validity and reliability of the Korean version of FGA scale using Rasch analysis. Methods: The study included 120 patients with stroke (age range=30~83 years; mean${\pm}$standard deviation=$58.3{\pm}11.1$). The FGA and Berg Balance Scale were performed, and were analysed for dimensionality of the scale, item difficulty, scale reliability and separation, and item-person map using Rasch analysis. Results: The 4 rating scale categories of FGA were satisfied with optimal rating scale criteria. The most items of the FGA showed sound item psychometric properties except 2 items ('gait with the horizontal head turns', and 'gait with narrow base of support'), and the 2 misfit items were excluded for all further analyses. The 8 items were arranged in order of difficulty. The most difficult item was 'gait with eyes closed', the middle difficult item was 'gait level surface', and the easiest item was 'gait with vertical head turns.' A person separation reliability was .93 and the person separation index was 3.57. Conclusion: This study suggests that the 8-item Korean FGA are valid measure of assess the gait-related balance performance, and to set the goal of rehabilitation plan in patient with stroke.

Rasch 모형을 이용한 한국어판 중환자실경험 측정도구의 문항 분석 (Item analysis of the Korean version of the Intensive Care Experience Questionnaire: Using the Rasch Model based on Item Response Theory)

  • 강지연;김민희
    • 중환자간호학회지
    • /
    • 제15권3호
    • /
    • pp.37-50
    • /
    • 2022
  • Purpose : This study aimed to examine the item characteristics of the Korean version of the intensive care experience questionnaire (K-ICEQ) using the Rasch analysis model of the item response theory. Methods : In this methodological study, the validity of the scale was examined, and a secondary analysis was conducted using cohort data of patients who were discharged from the intensive care units (ICU). Data from 891 patients who responded to the K-ICEQ upon ICU discharge were analyzed. The WINSTEP program was used to analyze item characteristics, including item difficulty, fit indices, appropriateness scale, and separation reliability. Results : The difficulty level of all 26 items of the K-ICEQ was appropriate, and the fit indices of the 25 items, except for item 18, were good. The 5-point scale of the K-ICEQ was not appropriate in the three subscales. The item separation reliability was good in all subscales, but did not meet the criteria in terms of respondents. Conclusion : The results of examining the item characteristics of the K-ICEQ revealed a good degree of difficulty, fitness, and item separation reliability. To increase the validity of the K-ICEQ, we suggest the rearrangement of the overall item order, modification of the item description of the "recall of experience" subscale, and reduction of the scale response level.

부모-영아 놀이 상호작용 관찰척도 개발을 위한 연구 (Developing the Parent Play Interaction Observation Scale (PPIOS) for Toddlers)

  • 김지연;김명순;이신희;박정원
    • 한국보육지원학회지
    • /
    • 제19권6호
    • /
    • pp.39-54
    • /
    • 2023
  • Objective: This study aimed to develop a parent play interaction observation scale (PPIOS-Toddler) and analyze it in terms of item discrimination, reliability, and validity. Methods: The subjects of the study were 97 toddlers and mothers. This scale consisted of three categories, six domains and 22 items on a 5-point scale. For the item discrimination of the observation scale, an independent standard t-test was conducted to analyze the significant difference in average between the upper and lower groups for each item. The reliability of the observation scale was calculated by Cronbach's α, the intra-item agreement, and the validity was examined through content validity, the correlation between subdomains and total scores, and official validity using PICCOLO. Results: In item discrimination analysis, all items exhibited differences between upper and lower groups. The overall internal agreement for the observation scale was 0.95, with factor-specific internal agreement ranging from 0.83 to 0.95. The observation scale demonstrated notable correlations between total scores and sub-factors (0.45 to 0.93) and significant correlations with PICCOLO total scores (0.66 to 0.86). Conclusion/Implications: The study successfully verified the item discrimination, reliability, and validity of the Parent Play Interaction Observation Scale (PPIOS-Toddler).

양육태도검사 예비형의 문항검사―재검사 신뢰도의 분석 (Analysis of Test-retest Reliability of Individual Items in a Preliminary From of Child-rearing Attitude Scale)

  • 차재호
    • 대한가정학회지
    • /
    • 제20권2호
    • /
    • pp.135-140
    • /
    • 1982
  • As a step preliminary to the factor-analysis of a child-rearing attitude scale under construction, its preliminary form containing a total of 368 self-answered questions was administerd to 88 married women with one or more children in the grade school age. all graduates of colleges and in possession of a home telephone and a house, twice from one week apart. The test-retest correlation coefficients, calculated for each test item based on the subject's choice among the three response alternatives on two test ocasions, ranged from .80 to .10. The cut-off point of r=.41 or lower led to the elimination of 48 items. As a point of incidental interest, the rate of response concordance. The namber of subjects giving the same categroy response on two occasions was calculated for each item and it was correlated with its test. retest correlation coefficient. The two different indices of item test-retest reliability were found not related to each other. Empirical evidence, as well as rational justifications, was presented to show that the correlation coefficient is the better of the tow indices of item test-retest reliability.

  • PDF

세계보건기구 기능제약평가목록 2.0 : 12항목-버전의 한글도구 개발과 신뢰도 검사 (Cultural Adaptation and Reliability Testing of Korean Version of the World Health Organization Disability Assessment Schedule 2.0 : 12-item versions)

  • 이해정;김다정
    • 대한물리의학회지
    • /
    • 제6권4호
    • /
    • pp.475-488
    • /
    • 2011
  • Purpose: The aims of the study were to develop and to establish reliability in Korean versions of World Health Organization Disability Assessment Schedule 2.0(KWHODAS 2.0): 12 item-self(12-self) and 12 item-interviewer(12-interviewer) versions. Methods: KWHODAS 2.0: 12-item versions were developed in idiomatic modern Korean with a process involving independent translation, synthesis of the translations, independent back translation, and review by an expert committee to achieve equivalence with the original English. 88 participants were included in the study. 33 of participants filled the 12-self version twice to examine test-retest reliability and 55 of participants were assessed simultaneously by four interviewers using the 12-interviewer version. Intra-rater reliability was evaluated using the intra-class correlation coefficient(ICC) and inter-rater reliability was evaluated using both the ICC and k statistic. Results: Test-retest reliability for the 12-self version was excellent with $ICC_{(2,1)}$ value ranged from 0.94(CI 0.88-0.98) to 0.96(CI 0.90-0.98). Inter-rater reliability for the 12-interviewer version showed excellent agreement with $ICC_{(2,1)}$ from 0.94(CI 0.91-0.96) to 1(CI 1.0-1.0). K value was observed from 0.95 to 1. Conclusion: KWHODAS 2.0: 12-self and 12-interviewer versions were successfully translated and both scales showed excellent reliability. It is now suitable for use in clinical and research applications.

Availability of a Maintained System

  • Jung, Hai-Sung
    • International Journal of Reliability and Applications
    • /
    • 제3권4호
    • /
    • pp.185-198
    • /
    • 2002
  • In the traditional life testing model, it is assumed that a certain number of identical items are tested under identical condition. This is due to statistical rather than practical considerations. The proportional hazards model can be used to develop a realistic approach to determine the performance of an item. That is also capable of modeling the failure rates of accelerated life testing when the covariates are applied stresses. The proportional hazards model is typically applied for a group of items to assess the importance of factors that may influence the reliability of an item. In this paper we considered the interarrival times of an item rather than the time to first failure for grouped items and provided the availability estimation for the determination of maintenance policy and overhaul time. In order to demonstrate the proposed approach, an example is presented.

  • PDF

뇌성마비 아동을 대상으로 실시한 한국어판 아동 균형 척도의 라쉬분석 (Application of Rasch Analysis to the Korean Version of the Pediatric Balance Scale in Children With Cerebral Palsy)

  • 김경모
    • 한국전문물리치료학회지
    • /
    • 제24권1호
    • /
    • pp.41-50
    • /
    • 2017
  • Background: The Pediatric Balance Scale (PBS) was developed to assess of balance ability in children with balance problem. The PBS was translated into Korean and its reliability had been studied. However, it had need to be verified using psychometric characteristics including item fit and rating scale. Objects: The purpose of this study was to investigate the item fit, item difficulty, and rating scale of the Korean version of PBS using Rasch analysis. Methods: In total, 40 children with cerebral palsy (CP) (boy=17, girl=23) who were diagnosed with level 1 or 2 according to the Gross Motor Function Classification System participated in this study. The PBS was performed, and was verified regarding the item fit, item difficulty, rating scale, and separation index and reliability using Rasch analysis. Results: In this study, the 'transfer', and 'turning to look behind left and right shoulders while standing still' item showed misfit statistics. in total 40 children with CP. Also, 'transfer', 'standing unsupported with feet together' and 'standing with one foot in front' items showed misfit statistics in diplegia CP group. Regardless of the classification of CP, the most difficult item was 'standing on one foot', whereas the easiest item was 'sitting with back unsupported and feet supported on the floor'. The 4 rating scale categories of PBS were acceptable with all criteria. Both item and person separation indices and reliability showed acceptable values. Conclusion: The PBS has been proven reliable, valid and is an appropriate tool, but it needs to modify the items of PBS according to CP classification.

임신 위험 증상 지각 측정도구 개발 (Development of Pregnancy Risk Symptom Perception Scale)

  • 김미혜;최소영
    • 여성건강간호학회지
    • /
    • 제24권3호
    • /
    • pp.297-309
    • /
    • 2018
  • Purpose: To develop Pregnancy Risk symptom Perception Scale (PRPS) and evaluate its validity and reliability. Methods: A preliminary 30-item version of PRPS was developed through literature review, in-depth interview, and Content Validity. Each item was scored on a four-point Likert scale. The preliminary scale was developed based on 301 pregnant women who visited a hospital. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson's correlation coefficients, and Cronbach's ${\alpha}$ (0.90 for total item, 0.80 to 0.88 for factors). Results: The PRPS consisted of 27 items. Three factors (physical, environmental, and emotional factors) explained 55% of the total variance. Cronbach's Criterion validity was supported by comparison with the Perception of Pregnancy Risk Questionnaire (r=0.34). In reliability test, the reliability coefficient of pregnancy risk symptom perception was high at 0.90. Conclusion: These results suggest that the pregnancy risk symptom perception scale developed in this study comprises items that can assess the level of pregnant women's pregnancy risk symptom perception in Korea. Its validity and reliability were proven. PRPS can be utilized to measure pregnant women's risk symptom perception during pregnancy. PRPS will contribute to the development of systematic prenatal care and effective risk management.

한국형 골관절염영향측정도구 개발 - 자료수집에서 1차 문항개발까지 - (Development of Korean Osteoarthritis Impact Measurement Scale(KAIMS) : from data collection to item development in the first study)

  • 이승주;김연주
    • 대한물리치료과학회지
    • /
    • 제19권1호
    • /
    • pp.17-25
    • /
    • 2012
  • Purpose : The aim of this study was from data collection to item development in the first study before developing a valid and reliable instrument reflecting Korean's own language expression and culture. Methods : The fist survey was 140 osteoarthritis(OA) patients in 2 Cites was studied from November to December 2009. Open-ended questionnaire was decided 39 items from the first open survey. Questionnaire on the Korean Osteoarthritis Impact Measurement Scale(KAIMS) was recruited 2 professors and 5 physical therapists. Second survey was applied to 133 OA patients. Results : OA patients's average age${\pm}$standard deviation was $66.08{\pm}11.10$ years. The internal consistency reliability of 3 items. As estimated by Cronbach's alpha coefficient(${\alpha}$), was high(range, 0.86~0.96). 0.43~0.91 ${\alpha}$ coefficient for the internal consistency reliability of item-each scale was also high. However, item-discriminant validity on 3 items was low(${\alpha}$, 0.92~0.97). The construct validity by factor analysis was a little low. Conclusion : This study revealed that we confirmed a generation for 39 items on KAIMS reflecting Korean's own language expression and culture. Also, those of reliability were a little high. And, we will have to study the last instrument development (3rd study) by more subjects in the future.

  • PDF