• Title/Summary/Keyword: Test-Retest

Search Result 448, Processing Time 0.024 seconds

A Validation Study of the Questionnaire of Sasang Constitution Classification(QSCC) (사상체질분류검사(四象體質分類檢査)(QSCC)의 타당화연구(妥當化硏究))

  • Kim, Sun Ho;Ko, Byung-Hee;Song, Il-Byung
    • Journal of Sasang Constitutional Medicine
    • /
    • v.5 no.1
    • /
    • pp.67-85
    • /
    • 1993
  • The Purpose of this study was to evaluate the reliability and the validation of four scales of Questionnaire for Sasang Constitution Classification (QSCC), newly constructed through statistical item analysis and to examine their diagnostic discrimination power. QSCC was administered to 105 inpatient at Kyung-Hee Oriental Medicine Hospital and local oriental clinics and 136 undergraduated students. 2 weeks later, QSCC was readministered to 220 same subjects. Data were collected during about 2 months from february to Apr. 20, 1992. For the purposes of this study, the collected data were analyzed by internal consistancy, test-retest reliability, ANOVA, Pearson correlation and discrimination analysis of spss pc+ v3.0 program. The results were as follows: 1. The reliability of four scales of QSCC was relatively favorable. The internal consistancy and test-retest reliability of Tae-Yaung-In(太陽人) scale were respectively Cronbach's ${\alpha}=0.9$ and r=0.89. Those of So-Yaung-In(少陽人) scale were respectively ${\alpha}=0.81$ and r=0.93. Those of Tae-Em-In(太陰人) scale were respectively ${\alpha}=0.72$ and r=0.74. Those of So-Em-In(少陰人) scale were respectively ${\alpha}=0.81$ and r=0.93. 2. The diagnostic discrimination abilities(Hit-ratio=56%)of QSCC were found to have more about 20% improvement than propotional chance criteria(37%). Especially, Hit-ratios for So-Yaung-In(63%) and Tae-Em-In(60%) were more high than that for So-Em-In(48%) 3. For male subjects, the construct validity of QSCC was founded to be relatively favorable. But that of QSCC for females was poor.

  • PDF

Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems

  • Shirali, Gholamabbas;Shekari, Mohammad;Angali, Kambiz Ahmadi
    • Safety and Health at Work
    • /
    • v.9 no.3
    • /
    • pp.296-307
    • /
    • 2018
  • Background: Safety culture, acting as the oil necessary in an efficient safety management system, has its own weaknesses in the current conceptualization and utilization in practice. As a new approach, resilience safety culture (RSC) has been proposed to reduce these weaknesses and improve safety culture; however, it requires a valid and reliable instrument to be measured. This study aimed at evaluating the reliability and validity of such an instrument in measuring the RSC in sociotechnical systems. Methods: The researchers designed an instrument based on resilience engineering principles and safety culture as the first instrument to measure the RSC. The RSC instrument was distributed among 354 staff members from 12 units of an anonymous petrochemical plant through hand delivery. Content validity, confirmatory, and exploratory factor analysis were used to examine the construct validity, and Cronbach alpha and test-retest were employed to examine the reliability of the instrument. Results: The results of the content validity index and content validity ratio were calculated as 0.97 and 0.83, respectively. The explanatory factor analysis showed 14 factors with 68.29% total variance and 0.88 Kaiser-Meyer-Olkin index. The results were also confirmed with confirmatory factor analysis (relative Chi-square = 2453.49, Root Mean Square Error of Approximation = 0.04). The reliability of the RSC instrument, as measured by internal consistency, was found to be satisfactory (Cronbach ${\alpha}=0.94$). The results of test-retest reliability was r = 0.85, p < 0.001. Conclusion: The results of the study suggest that the measure shows acceptable validity and reliability.

Reliability and Validity Analysis of an Instrument for Pattern Identification and Evaluation in Chemotherapy-Induced Peripheral Neuropathy (항암제 유발 말초신경병증 변증평가도구의 신뢰도 및 타당도 평가)

  • Park, Ji-hye;Jung, In-chul;Lee, Seo-hyun;Lee, Suk-hoon;Choi, Seok-cheol;Yoo, Hwa-seung
    • The Journal of Internal Korean Medicine
    • /
    • v.37 no.4
    • /
    • pp.631-644
    • /
    • 2016
  • Objectives: The purpose of this study was to evaluate the reliability and validity of an instrument for pattern identification and evaluation in chemotherapy-induced peripheral neuropathy (CIPN).Methods: The study consisted of 66 patients with CIPN (visual analog scale ≥30 mm, Eastern Cooperative Oncology Group ≤2). The test-retest reliability of the instrument for pattern identification and evaluation in CIPN was tested twice with the same patients in one week.Results: Pearson’s coefficient test-retest reliability of the instrument was 0.601-0.777. The internal reliability of each part was 0.619-0.811. To confirm the validity of the instrument for pattern identification and evaluation for CIPN, the correlation between the score for each identification pattern and that of other CIPN instruments was analyzed. The results revealed a positive correlation between the Functional Assessment of Cancer Therapy-General and CIPN-20.Conclusion: The reliability of the instrument for pattern identification and evaluation in CIPN was moderate, and the validity analysis revealed a positive correlation.

Reliability and Validity Analysis of the Instrument of Oriental Medical Evaluation for Hwa-Byung (화병 한의 평가도구의 신뢰도, 타당도 평가)

  • Lee, Hun-Soo;Choi, Woo-Chang;Yu, Yun-Seon;Kang, Wee-Chang;Jung, In-Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.25 no.4
    • /
    • pp.351-358
    • /
    • 2014
  • Objectives: This study was performed to evaluate the reliability and validity of the instrument of oriental medical evaluation for Hwa-byung. Methods: 97 participants diagnosed with Hwa-byung divided into 5 pattern identifications by the instrument on pattern identifications for Hwa-byung were tested by the instrument of oriental medical evaluation for Hwa-byung twice a week. Results: The intraclass correlation coefficient of the test-retest analysis of oriental medical evaluation for Hwa-byung had over moderate agreement. The intraclass correlation coefficient of test-retest analysis of evaluation index of symptoms had moderate agreement for the total symptoms, and fair agreement for the physical and mental symptoms. The validity analysis of the instrument represented a positive correlation in the pattern identification of stagnation of liver Gi, malfunction of gallbladder due to phlegm stagnation, and disharmony between heart and kidneys. Conclusions: The results showed that the reliability analysis of the instrument of oriental medical evaluation for Hwa-byung showed over moderate agreement, and validity analysis represented a positive correlation except for the pattern identification of flare-up of liver fire and deficiency of both Gi and blood.

Validity and Reliability of Korean Version of the Aging Voice Index (KAVI) (한국어판 노인음성지수의 신뢰도와 타당도)

  • Bae, In-Ho;Sung, Eui-Suk;Lee, Jin-Choon
    • Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
    • /
    • v.30 no.1
    • /
    • pp.21-27
    • /
    • 2019
  • Background and Objectives : Voice disorder is recognized as a major problem because it negatively affects the elderly's social participation and quality of life. The purpose of this study was to examine the validity and reliability of Korean aging voice index (KAVI), which assesses the quality of life related to the voice of the elderly. Materials and Method : This study was conducted on 211 elderly people aged 65 years or older : 111 patients with voice disorder (mean age 69.8, range 65-80 years) and 100 nomorphonic participants (mean age 70.6, range 65-82 years). Aging voice index was translated into Korean and used and Korean voice-related quality of life (KVQOL) was conducted to verify KAVI. The validity (item validity, concurrent validity, and construct validity) and reliability (test-retest reliability and internal consistency reliability) of KAVI. Results : The item validity (ICC=0.895) and construct validity (r=0.765) showed a high correlation, respectively. And concurrent validity (r=0.748), test-retest reliability (0.851), and internal consistency reliability (${\alpha}=0.832$) were statistically significant in voice disorder group. In addition, there was a significant difference between the voice disorder and the nomorphonic group in AVI total score. Conclusion : KAVI is a validated and reliable quality of life tool that will be useful for assessing the presence and effectiveness of interventions in clinical settings.

Validity and Reliability of the Korean Version of the Partners In Health Scale (PIH-K) (한국어판 자기관리 측정도구(Partners In Health scale)의 타당도 및 신뢰도 분석)

  • Jeon, Mi-Kyeong;Ahn, Jung-Won;Park, Yeon-Hwan;Lee, Mi-Kyoung
    • Journal of Korean Critical Care Nursing
    • /
    • v.12 no.2
    • /
    • pp.1-12
    • /
    • 2019
  • Purpose : The purpose of this study was to validate the Korean version of Partners In Health scale (PIH-K) which is used to measure the self-management of patients with chronic illnesses in Korea. Methods : Translation of the 12-item PIH-K was conducted according to the World Health Organization guidelines. Data from 306 participants who took medicines over 3 months by doctor's prescription were collected from October to November 2017. Validity such as content validity, construct validity, and concurrent validity were conducted using content validity index (CVI), exploratory and confirmatory factor analyses (CFA). To evaluate concurrent validity, the correlation coefficients between the PIH-K and concurrent scales (Self-As-Carer Inventory) were calculated. The reliability of the PIH-K was examined using the internal consistency and test-retest reliability tests. Results : The CVI of the PIH-K was 0.91. According to the CFA, factor loadings for four factors ranged from .64 to .97, which explained 67.5% of the total variance. The PIH-K was significantly correlated with concurrent variables such as those on the Self-As-Carer Inventory. The Cronbach's ${\alpha}$ was .86 and the intraclass correlation coefficient for the two-week test-retest reliability was .88. Conclusion : Findings show that the PIH-K is reliable and valid in measuring self-management of patients with chronic illnesses.

Development of the Cultural Competence Scale for Registered Nurses (CCS-RN) (간호사의 문화간호역량 측정도구의 개발)

  • Kim, Kyung Won;Kim, Sun-Hee;Kim, Young Hee;Kim, Hyun Kyoung;Park, Hae Sook;Lee, Sun Hee;Jeong, Geum Hee
    • Research in Community and Public Health Nursing
    • /
    • v.30 no.3
    • /
    • pp.281-294
    • /
    • 2019
  • Purpose: This study is to develop the Cultural Competence Scale for Registered Nurses (CCS-RN) and to examine its validity and reliability. Methods: The item pool was generated based on related scales, a wide review of the literature, and in-depth interviews with nurses according to Purnell's cultural competence model. Content validity was verified by nursing experts. Construct validity using exploratory factor analysis, convergent validity using correlation coefficients, discriminant validity, internal consistency reliability, and test-retest reliability were examined. Results: The CCS-RN consists of a 35-item/7-factor solution with 54.1% of the total variance explained. The convergent validity of CCS-RN was supported. Cronbach's ${\alpha}$ was .94 for the total scale and ranged from .77 to .90 for the seven factors. Test-retest reliability was moderate. Conclusion: The evaluation of the psychometric properties of the CCS-RN shows that this scale is expected to be a valid and reliable measure of cultural competence among nurses. This scale may be useful for assessing nurses' own cultural competence and thus contribute to strengthening cultural competence.

Development of the Self-Care Non-adherence Risk Assessment Scale for Patients with Chronic Illness (만성질환자의 자가간호 불이행 위험 사정도구 개발)

  • Jo, Mirae;Oh, Heeyoung
    • Research in Community and Public Health Nursing
    • /
    • v.32 no.4
    • /
    • pp.415-429
    • /
    • 2021
  • Purpose: The purpose of this study was to develop the Self-Care Non-adherence Risk Assessment Scale (SCNRAS) for patients with chronic illness in South Korea. Methods: This study was conducted from April to July, 2020 and utilized a convenience sampling method to recruit 336 patients with chronic illness from three hospitals located in South Korea. The content, factorial structure, item-convergent/discriminant validity, convergent validity, internal consistency reliability, and test-retest reliability of the scale were evaluated. The data were analyzed using exploratory and confirmatory factor analyses, Pearson's correlation coefficient, Cronbach's α, and intra-class correlation coefficient. Results: The exploratory and confirmatory factor analyses yielded six-factors. Convergent validity was demonstrated using measures of defining issues. Internal consistency reliability and test-retest reliability were found to be acceptable, as indicated by a Cronbach's α of .65~.81 and an intra-class correlation coefficient of .93~.98. The Self-Care Non-adherence Risk Assessment Scale for patients with chronic illness is a new instrument that comprehensively measures the knowledge, skill, physical function status, access to health care, social support, motivation, and confidence. It comprises 18 items scored on a 5-point Likert scale. The validity and reliability of the scale were verified. Conclusion: The scale developed through this study is expected to screen those who need nursing intervention early by predicting the self-care non-adherence risk group.

Development and Validation of a Korean Nursing Work Environment Scale for Critical Care Nurses (한국형 중환자실 간호근무환경 측정도구 개발 및 평가)

  • Lee, Hyo Jin;Moon, Ji Hyun;Kim, Se Ra;Shim, Mi Young;Kim, Jung Yeon;Lee, Mi Aie
    • Journal of Korean Clinical Nursing Research
    • /
    • v.27 no.3
    • /
    • pp.279-293
    • /
    • 2021
  • Purpose: The purpose of this study was to develop a Korean nursing work environment scale for critical care nurses (KNWES-CCN) and verify its validity and reliability. Methods: A total of 46 preliminary items were selected using content validity analysis of experts on 64 candidate items derived through literature reviews and in-depth interviews with critical care nurses. 535 critical care nurses from 21 hospitals responded to the preliminary questionnaire from February to March 2021. The collected data were analysed using construct, convergent and discriminant validities, and internal consistency and test-retest reliability. Results: The 23 items in 4 factors accounted for 55.6% of the total variance were identified through item analysis and exploratory factor analysis (EFA). EFA was performed with maximum likelihood method including direct oblimin method. In the confirmatory factor analysis, KNWES-CCN consisted of 21 items in 4 factors by deleting the items that were not meet the condition that the factor loading over .50 or the squared multiple correlation over .30. This model was considered to be suitable because it satisfied the fit index and acceptable criteria of the model [𝒳2=440.47 (p<.001), CMIN/DF=2.41, GFI=.86, SRMR=.06, RMSEA=.07, TLI=.90, CFI=.91]. The item total correlation values ranged form .32 to .73 and its internal consistency was Cronbach's α=.92. The reliability of the test-retest correlation coefficient was .72 and the intra-class correlation coefficient was .83. Conclusion: The KNWES-CCN showed good validity and reliability. Therefore, it is expected that the use of this scale would measure and improve nursing work environment for critical care nurses in Korea.

The validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale for nursing students (한국어판 간호대학생의 인공지능에 대한 태도 측정도구 신뢰도 및 타당도 검증)

  • Seo, Yon Hee;Ahn, Jung-Won
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.28 no.4
    • /
    • pp.357-367
    • /
    • 2022
  • Purpose: The aim of the study was to verify the validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale (GAAIS-K) for nursing students. Methods: Data from 235 participants were collected from April 12 to April 26, 2022. A total of 230 participants' data were analyzed. The data were analyzed for content, discriminant, known-groups, and construct validity using content validity index, correlation coefficient, and confirmatory factor analyses. The reliability of the GAAIS-K was examined using internal consistency and test-retest analyses. Results: The expert-rated content validity index was ≥.80. The sub-scales of the GAAIS-K were moderately correlated with attitude toward accepting technology, indicative of its discriminant validity. The male students' positive attitude score was significantly higher than that of the female students, satisfying the known-groups validity. Cronbach's α for the scale was .86 (positive) and .74 (negative), and the intra-class correlation coefficient for the two-week test-retest reliability was .86 (positive) and .60 (negative). The scores for positive and negative attitudes were 3.68±0.46 and 3.05±0.55. Conclusion: This study shows that the GAAIS-K is a valid and reliable instrument for assessing nursing students. Additional research is recommended to continue the evaluation of the GAAIS-K with a focus on healthcare settings.