• Title/Summary/Keyword: Validity analysis

Search Result 7,176, Processing Time 0.036 seconds

Validity and Reliability of the Korean Version of Person-Centered Practice Inventory-Staff for Nurses (간호사 대상 한국어판 인간중심돌봄 측정도구의 타당도와 신뢰도)

  • Kim, Sohyun;Tak, Sunghee H
    • Journal of Korean Academy of Nursing
    • /
    • v.51 no.3
    • /
    • pp.363-379
    • /
    • 2021
  • Purpose: The purpose of this study was to evaluate the validity and reliability of the Korean version of Person-Centered Practice Inventory-Staff (PCPI-S) for nurses. Methods: The English PCPI-S was translated into Korean with forward and backward translation. Data were collected from 338 nurses at one general hospital in Korea. Construct validity was evaluated with confirmatory factor analysis, convergent validity, and discriminant validity. Known-group validity was also evaluated. Cronbach's α was used to assess the reliability. Results: The PCPI-S Korean version consisted of 51 items in three areas: prerequisites, the care environment, and person-centered process. The comparative fit index (CFI) and values of person-centered care process were improved after engagement and having sympathetic presence items were combined as one component. The construct validity of PCPI-S Korean version was verified using four-factor structures (.05 < RMSEA < .10, AGFI > .70, CFI > .70, and AIC). The convergent validity and discriminant validity of the entire PCPI-S question were verified using a two-factor structures (AVE > .50, construct reliability > .70). There was an acceptable known-group validity with a significant correlation between the PCPI-S level and the degree of person-centered care awareness and education. Internal consistency was reliable with Cronbach's α .95. Conclusion: The Korean version of PCPI-S is valid and reliable. It can be used as a standardized Korean version of person-centered care measurement tool. Abbreviation: RMSEA = root mean square error of approximation; AGFI = adjusted goodness of fit index; AIC = Akaike information criterion; AVE = average variance extracted.

The Validity and Reliability of the Korean Version of Readiness for Practice Survey for Nursing Students (한국어판 간호학생 간호실무준비도 측정도구의 타당도와 신뢰도)

  • Lee, Tae Wha;Ji, Yoonjung;Yoon, Yea Seul
    • Journal of Korean Academy of Nursing
    • /
    • v.52 no.6
    • /
    • pp.564-581
    • /
    • 2022
  • Purpose: This study aimed to evaluate the validity and reliability of the Korean version of the Readiness for Practice Survey (K-RPS). Method: The English Readiness for Practice Survey was translated into Korean using the Translation, Review, Adjudication, Pretesting, and Documentation (TRAPD) method. Secondary data analysis was performed using the dataset from the New Nurse e-Cohort study (Panel 2020) in South Korea. This study used a nationally representative sample of 812 senior nursing students. Exploratory and confirmatory factor analyses were also conducted. Convergent validity within the items and discriminant validity between factors were assessed to evaluate construct validity. Construct validity for hypothesis testing was evaluated using convergent and discriminant validity. Ordinary α was used to assess reliability. Results: The K-RPS comprises 20 items examining four factors: clinical problem solving, learning experience, professional responsibilities, and professional preparation. Although the convergent validity of the items was successfully verified, discriminant validity between the factors was not. The K-RPS construct validity was verified using a bi-factor model (CMIN/DF 2.20, RMSEA .06, TLI .97, CFI .97, and PGFI .59). The K-RPS was significantly correlated with self-esteem (r = .43, p < .001) and anxiety about clinical practicum (r = - .50, p < .001). Internal consistency was reliable based on an ordinary α of .88. Conclusion: The K-RPS is both valid and reliable and can be used as a standardized Korean version of the Readiness for Practice measurement tool.

Nursing needs assessment scale for women with infertility: development and validation (난임 여성의 간호 요구 측정 도구 개발 및 타당도 검정)

  • Park, Jummi;Shin, Nayeon;Lee, Kyungmi
    • Women's Health Nursing
    • /
    • v.26 no.2
    • /
    • pp.141-150
    • /
    • 2020
  • Purpose: High-quality nursing care must be provided for women with infertility, and their nursing needs must be identified. Although scales have been developed to assess infertility-related stress, quality of life, and psychosocial status, there is a lack of scales that assess the nursing needs of women with infertility. The purpose of this study was to develop a needs assessment scale for nursing care in women with infertility and to verify its reliability and validity. Methods: The 250 subjects in this study were women with infertility recruited from four hospitals. The scale was developed following the framework of DeVellis, through a literature review, in-depth interviews, development of preliminary items, verification of content validity, development of secondary items, verification of construct validity, and extraction of the final items. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson correlation coefficients, and Cronbach's alpha. Reliability was tested using Cronbach's alpha, and validity was evaluated using item analysis, exploratory factor analysis, and criterion validity. Results: The final version of the nursing needs assessment scale for woman with infertility consisted of 18 items. Four factors (physical and psychological nursing needs, needs for information regarding treatment, needs for infertility-related understanding and concern, and supportive needs) explained 66.0% of the total variance. Cronbach's alpha was .92 for the overall instrument and ranged from .88 to .91 for the subscales. Conclusion: These results suggest that this needs assessment scale for nursing care in women with infertility demonstrated acceptable validity and reliability and contained items suitable for assessing the level of nursing care needed by women with infertility.

Multifaceted validity analysis of clinical skills test in the educational field setting (교육 현장에서 시행된 임상 술기 시험의 다면적 타당도 분석)

  • Han Chae;Min-jung Lee;Myung-Ho Kim;Kyuseok Kim;Eunbyul Cho
    • The Journal of Korean Medicine
    • /
    • v.45 no.1
    • /
    • pp.1-16
    • /
    • 2024
  • Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

Statistical Approach to Test Construct Validity and Obtain Weights for the Children's Dietary Life Recognition and Practice Index (우리나라 초등학교 어린이의 식생활 인지.실천 수준 평가지표 구성타당도 평가 및 산정방법 연구)

  • Kwon, Se-Hyug;Kim, Hye-Young P.;Lee, Jung-Sug;Kwa, Tong-Kyung;Chung, Hae-Rang;Choi, Young-Sun;Kang, Myung-Hee
    • Journal of Nutrition and Health
    • /
    • v.44 no.1
    • /
    • pp.41-48
    • /
    • 2011
  • Constructs with seven latent evaluation indicators and 18 observable survey questions were developed by food and nutrition experts to calculate a food safety recognition and practice index for children. The purpose of this study was to suggest statistical approaches to test construction validity on the constructs, obtain weights of the evaluation indicators, and develop questionnaires to calculate a children's food recognition and practice index. Survey data of 2,400 elementary fifth grade students were used as empirical results. Test validity was evaluated by exploratory factor analysis and confirmed to be highly significant by confirmatory factor analysis [i.e., linear structural relations (LISREL) analysis]. Standardized path coefficients of the LISREL analysis were suggested based on weights, and the weights were compared using the AHP and Delphi methods.

Development and Validation of Life Safety Awareness Scale of High School Students and Analysis of Interindividual Differences

  • Lee, Soon-Beom;Kim, Eun-Mi;Kong, Ha-Sung
    • International journal of advanced smart convergence
    • /
    • v.11 no.4
    • /
    • pp.104-119
    • /
    • 2022
  • Life safety awareness level diagnosis is necessary for customized safety education and continuous safety awareness. As the starting stage of safety education for each life cycle, a scale that has verified the reliability and validity of high school students' life safety awareness has not yet been developed. In this context, the purpose of this study is to develop and validate the life safety awareness scale of high school students and to analyze interindividual differences. Questionnaire data was collected from April to June 2022 from 834 students in the first, second, and third grades of high schools in △△ city in Jeollabuk-do. A final 25-item scale was developed using the preliminary survey, preliminary test, the main test, descriptive statistical analysis, and exploratory and confirmatory factor analysis. This scale consists of four sub-factors: 'safety prevention', 'safety knowledge', 'safety preparation', and 'safety protection'. Good reliability and validity were verified by analysis of content validity and construct validity. The generalizability of the scale was verified by crossover validation between the search group and the crossover group. Based on the interindividual differences analysis, although there was a difference between genders in life safety awareness, there was no difference by grade level and academic achievement. This study is significant in developing the first valid scale that can measure high school students' life safety awareness and providing the necessity and rationale for life safety education by life cycle considering individual gender differences.

The Study of the Validity Test on the Self-monitoring Scale (자기 검색척도(Self-Monitoring Scale)의 타당성 검정에 관한 연구)

  • 이선아
    • Journal of Korean Academy of Nursing
    • /
    • v.28 no.3
    • /
    • pp.751-759
    • /
    • 1998
  • The study of the validity test on the self-monitoring scale for nurses In this study, both the literary survey as well as empirical research has been executed to test the validity of the scales that measure the construct of the self-monitoring scale. The self-monitoring scale could not be classified into five factors as Snyder suggested. Many other scholars (Briggs, Cheek and Buss, 1980) suggested 3 different classifications which was accepted by Snyder and Gangestad (1986). John, Cheek and Klohnen(1996) claimed a two-factor classification. As has been discussed, factor analysis is used to prove convergent validity within the factor and discriminant validity between the factors. However, depending on the researchers, many variations in classification of the factors were found and a lack of content and discriminant validity were found in the previous research findings. It is also important to note that Snyder's self-monitoring scale did not factor-load at over. 30 for all 25 items, regardless of how many factors could be classified. According to findings of this study, the self-monitoring scale neither classified as five, three or two factors nor factor loaded as hypothesized. It is also clear that Snyder's self-monitoring scale lacks convergent validity as the sub-factors of the scale failed to prove its uni-dimensionality. The A self-monit oring scale not only fail to overcome the problems of Snyder's self-monitori ng scale but even lost the attractiveness of the self-monitoring scale. In this study it was also found that the A self-monitoring scale was not classified in either in a two or three-factor classification as hypothesized. It is, of course, not desirable to use any scale that lacks convergent and discriminant validity even though it has been widely used and has held a great deal of influence on the field of social psychology. To overcome the shortcomings of Snyder's self-monitoring scale, Lennox and Wolfe(1984) suggested 13 items. This study was dedicated to test the validity and reliability of the scale, in which we found that the data presented in validity as the two factors were class ified and loaded as expected. Reliability was also proven by checking Cronbach's α for each factor and for the total items. In addition, a confirmatory factor analysis was executed for the 13 items using LISREL 8.12 program to confirm convergent validity in a two-factor classification. The model was fitting and sound : however, the self-monitoring scale was unfitted and not validated. Thus, it is recommended to use not the original nor the abbreviated self-monitoring scale but the 13 items in future studies. It should also be noted that items 7 and 13 should be removed to obtain better uni-dimensionality for the 13 items. These items loaded at over. 30, too high for the two factors in the test results of Factor analysis. In addition, it is necessary to double-check the cause of two-hold loading at over .30 for the two factors. It could be a problem caused by data or by the scale itself. Therefore, additional studies should follow to better clarify this matter.

  • PDF

Development and Validation of the Empowerment Scale for Woman with Breast Cancer (유방암여성 임파워먼트 측정도구 개발 및 타당화)

  • Shin, Sun Hwa;Park, Hyojung
    • Journal of Korean Academy of Nursing
    • /
    • v.45 no.4
    • /
    • pp.613-624
    • /
    • 2015
  • Purpose: The purpose of this study was to develop a scale to evaluate empowerment in woman with breast cancer and to examine the validity and reliability of the scale. Methods: The development process for the initial items included a literature review, interviews, and construction of a conceptual framework. The identified items were evaluated for content validity by experts, resulting in 3 factors and 48 preliminary items. Participants were 319 women with breast cancer recruited to test reliability and validity of the preliminary scale. Data were analyzed using item analysis, confirmatory factor analysis, criterion related validity, internal consistency and test-retest reliability. Results: The final scale consisted of 30 items and 3 factors. Factors, including 'intrapersonal factor' (14 items), 'interactional factor' (8 items), and 'behavioral factor' (8 items), were drawn up after confirmatory factor analysis. Goodness of fit of the final research model was very appropriate as shown by ${\chi}^2/df=1.86$, TLI=.90, CFI=.92, SRMR=.06, and RMSEA=.05. Criterion validity was evaluated by total correlation with the Cancer Empowerment Questionnaire .78. Cronbach's alpha for total items was .93 and test-retest reliability was .69. Conclusion: Findings from this study indicate that the scale can be used in the development of nursing interventions to promote the empowerment of women having breast cancer.

Evaluating Applicability of Maslach Burnout Inventory among University Hospitals Nurses (말라크 소진 측정도구(Maslach Burnout Inventory)의 적용가능성 평가)

  • Kang, Jeong-Hee;Kim, Chul-Woung
    • Korean Journal of Adult Nursing
    • /
    • v.24 no.1
    • /
    • pp.31-37
    • /
    • 2012
  • Purpose: This Study was to examine to applicability of the Maslach Burnout Inventory on measuring burnout of the nurses who works in Korean university hospitals. Methods: The sample included 200 nurses and nurse managers. We used 22-item Maslach Burnout Inventory to evaluate the reported burnout. We evaluated the convergent validity through the factor analysis, and evaluated the discriminant validity through the Pearson's correlation analysis. Also, we evaluated the reliability for three subscales of Maslach Burnout Inventory with the Cronbach's ${\alpha}$, which assesses the internal consistency. Results: Factor analysis revealed three factors being extracted from the 22-item Maslach Burnout Inventory, and item loading for each factor is higher than 0.5. Therefore, the Maslach Burnout Inventory demonstrated high convergent validity. Also, emotional exhaustion, personal accomplishment, and depersonalization showed low correlation leading to the conclusion that there was discriminant validity. The Cronbach's ${\alpha}$ coefficients in the 22-item Maslach Burnout Inventory and three subscales were higher than 0.7. Conclusion: Maslach Burnout Inventory can be used as a valid instrument to measure the burnout level of the nurses working in Korean university hospitals.

Predictive Validity of the STRATIFY for Fall Screening Assessment in Acute Hospital Setting: A meta-analysis (입원 환자에서 STRATIFY의 예측 타당도 메타분석)

  • Park, Seong-Hi;Choi, Yun-Kyoung;Hwang, Jeong-Hae
    • Korean Journal of Adult Nursing
    • /
    • v.27 no.5
    • /
    • pp.559-571
    • /
    • 2015
  • Purpose: This study is to determine the predictive validity of the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) for inpatients' fall risk. Methods: A literature search was performed to identify all studies published between 1946 and 2014 from periodicals indexed in Ovid Medline, Embase, CINAHL, KoreaMed, NDSL and other databases, using the following key words; 'fall', 'fall risk assessment', 'fall screening', 'mobility scale', and 'risk assessment tool'. The QUADAS-II was applied to assess the internal validity of the diagnostic studies. Fourteen studies were analyzed using meta-analysis with MetaDisc 1.4. Results: The predictive validity of STRATIFY was as follows; pooled sensitivity .75 (95% CI: 0.72~0.78), pooled specificity .69 (95% CI: 0.69~0.70) respectively. In addition, the pooled sensitivity in the study that targets only the over 65 years of age was .89 (95% CI: 0.85~0.93). Conclusion: The STRATIFY's predictive validity for fall risk is at a moderate level. Although there is a limit to interpret the results for heterogeneity between the literature, STRATIFY is an appropriate tool to apply to hospitalized patients of the elderly at a potential risk of accidental fall in a hospital.