• Title/Summary/Keyword: Testing Validity

Search Result 626, Processing Time 0.025 seconds

Content Validity for a New Korean Version of Pediatric Functional Muscle Testing (한국형 소아 기능근력검사의 개발을 위한 내용타당도 검증)

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.11 no.2
    • /
    • pp.103-114
    • /
    • 2016
  • PURPOSE: The purpose of this study was first to develop a Korean version of pediatric functional muscle testing for children with a motor developmental disorder who have a communication problem and who are aged below five years, and also to verify the content validity. METHODS: First, the preliminary study was conducted to verify the reliability of pediatric functional muscle testing, developed by Venita in Korea. Based on the results of the study, the primary evaluation items were selected and modified. Second, the first test of content validity was conducted through a panel discussion, and a second investigation of content validity was carried out by utilizing the Item Content Validity Index (I-CVI). In this study, we selected only 0.78 or more items from I-CVI. RESULTS: Based on the results of the preliminary study, 19 primary evaluation items were selected. Based on the results of the first and second content validity tests, 15 tertiary evaluation items for the Korean version of pediatric functional muscle testing were determined. CONCLUSION: This study developed a new Korean version of pediatric functional muscle testing and suggested that it will be a useful tool to measure muscle strength for Korean children with a motor developmental disorder and a communication problem, aged below five years.

Development and Validation of the Korean Patient Safety Culture Survey Instrument for Hospitals (한국형 환자안전문화 측정도구 개발 및 평가)

  • Sun-Gyo Lee
    • Quality Improvement in Health Care
    • /
    • v.30 no.1
    • /
    • pp.105-119
    • /
    • 2024
  • Purpose: This study aimed to develop a survey instrument to assess the Patient Safety Culture in Korean hospitals and evaluate its validity and reliability. Methods: A preliminary instrument was developed through a literature review, focus group interviews, content validity testing, and pretesting for face validity. A total of 467 hospital employees participated in the psychometric testing. Validity and reliability assessments included content validity, construct validity, criterion-related validity, and internal consistency. Results: The Korean Patient Safety Culture Survey Instrument comprised 35 items across seven factors: leadership, patient safety policy and procedure, patient safety improvement system, teamwork, non-punitive environment, patient safety knowledge and attitudes, and patient safety priority. These seven factors contributed 60.98% of the variance of the total scale. Cronbach's alpha for internal consistency was .93; the seven factors ranged from .66 to .91. Conclusion: The results of this study showed that the Korean Patient Safety Culture Survey Instrument is reliable, valid, and suitable for measuring patient safety culture in Korean hospitals.

Attitude toward the Website for Apparel Shopping (Part I): Measurement Model Testing (의류 쇼핑 웹사이트 태도 형성 모델 연구 (제1보) -웹사이트 속성, 웹사이트 쇼핑가치, 웹사이트 태도 측정모형 검증-)

  • 홍희숙
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.28 no.11
    • /
    • pp.1482-1494
    • /
    • 2004
  • This study identified convergent validity and discriminant validity of measurement variables by factor analysis using Spss program and tested covariance measurement model including latent variables such as the website attributes (interactivity, search and visual information of website), shopping values(utilitarian and hedonic value) and attitude toward website by AMOS program. The data were collected from a sample of 271 internet shopper of university students(male: 82, female: 189). They visited the website for apparel shopping and, after searching a casual clothing which they wanted to buy, requested to answer the questionnaire. The results were as follows: Variables that reduce validity were deleted in the several steps of factor analysis and initial measurement model testing. Final measurement model was constructed by valid variables was accepted. This measurement model will be input for testing causal research model that can explain how attributes of the website influences on consumer attitude toward the website.

A Study on the Validity and Reliability of Performance Assessment in Home Economics (가정과 수행평가의 타당성과 신뢰성 연구 - 경남 농촌지역의 소인수 학급을 대상으로 -)

  • 윤성희;유태명
    • Journal of the Korean Home Economics Association
    • /
    • v.39 no.10
    • /
    • pp.169-186
    • /
    • 2001
  • The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

  • PDF

Development of a Positive Nursing Organizational Culture Measurement Tool (긍정 간호조직문화 측정도구 개발)

  • Kim, Mi Jung;Kim, Jong Kyung
    • Journal of Korean Academy of Nursing
    • /
    • v.51 no.3
    • /
    • pp.305-319
    • /
    • 2021
  • Purpose: The purpose of this study was to develop a measurement tool for a positive nursing organizational culture and to verify its reliability and validity. Methods: A conceptual framework and construct factors were extracted through an extensive literature review and in-depth interviews with nurses. The final version of the preliminary tool for the main survey was confirmed by experts through a content validity test and a preliminary survey of 40 nurses. Subsequently, the final tool was developed using a validity and reliability test containing 43 preliminary items. The final version of the tool was used with 327 hospital nurses in the testing phase for the main survey to assess validity and reliability. Results: From the factor analysis, 4 factors and 26 items were selected. The factors were positive leadership of the nursing unit manager, pursuit of common values, formation of organizational relationships based on trust, and a fair management system. The entire determination coefficient was 67.7%. These factors were verified through convergent, discriminant, and concurrent validity testing. The internal consistency reliability was acceptable (Cronbach's α = .95). Conclusion: Both the validity and reliability of the scale were confirmed demonstrating its utility for measuring positive nursing organizational culture. It is expected to be used for education, research, and practical performance policies regarding the nursing organizational culture.

Development and Psychometric Evaluation of the Transcultural Self-efficacy Scale for Nurses (간호사의 범문화효능감 측정도구 개발 및 타당화)

  • Oh, Won-Oak;Park, Eun Sook;Suk, Min Hyun;Im, Yeo Jin
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.2
    • /
    • pp.293-304
    • /
    • 2016
  • Purpose: This methodological study was conducted to develop and psychometrically test the Transcultural Self-efficacy scale (TCSE-scale) for nurses. Methods: Initial 41 items for the TCSE-scale were generated based on extensive literature reviews and in-depth interviews with 18 nurses who had experience in caring for foreign patients. Cultural Competence and Confidence model was used as a conceptual framework. Content validity was evaluated by an expert panel. Psychometric testing was performed with a convenience sample of 242 nurses recruited from four general hospitals in the Seoul metropolitan area and Gyeonggi-do province of South Korea. To evaluate the reliability of TCSE-scale, a test-retest reliability and an internal consistency reliability were analyzed. Construct validity, concurrent validity, criterion validity, convergent validity and discriminative validity were used to evaluate the validity. Results: The 25-item TCSE-scale was found to have three subscales-Cognitive, Practical, and Affective domain-explaining 91.5% of the total variance. TCSE-scale also demonstrated a concurrent validity with the Cultural Competence Scale. Criterion-related validity was supported by known-group comparison. Reliability analysis showed an acceptable-to-high Cronbach's alpha-.88 in total, and subscales ranged from .76 to .87. The ICC was .90, indicating that the TCSE-scale has internal consistency and stability of reliability. Conclusion: This preliminary evaluation of the psychometric scale properties demonstrated an acceptable validity and reliability. The TCSE-scale is able to contribute to building up empirical and evidence based on data collection regarding the transcultural self-efficacy of clinical nurses. We suggest further testing of the applicability of TCSE-scale in different settings and community contexts.

Development of an Instrument to Measure Risk Factor-related Deviant Behavior for the Elderly in South Korea (노인의 일탈행동과 관련된 위험요인 측정도구 개발 - 노인 범죄 증가와 관련하여 -)

  • Lee, Sook-Kyung;Hong, Chong-Min
    • Journal of Korean Public Health Nursing
    • /
    • v.25 no.2
    • /
    • pp.244-254
    • /
    • 2011
  • Purpose: The study was designed to develop an instrument to measure risk factor-related deviant behavior (RFRDB) for the elderly. Methods: The preliminary instrument including 52 items to measure the risk factor-related deviant behavior for the elderly was developed through conceptual framework based literature review. The items were reviewed by experts to reveal the Content Validity Index (CVI). Then, construct validity and reliability were tested using factor analysis, comparative groups, and Cronbach's alpha with data from 233 elderly. Results: Among 52 items, 27 questions in the RFRDB instrument were selected from content validity and 21 questions in the final RFRDB were developed from testing validity and reliability. Results of empirical analysis(retest) of RFRDB were supported by 70% congruity with conceptual framework through literature review. The RFRDB has been completed by validity testing by known-group technique. The final developed RFRDB of the elderly has 21 questions each with a 4-point Likert Scale. Conclusion: The RFRDB may be utilized as a measurement to assess the risk of elderly deviant behavior.

The Reliability and Validity of the Korean Version of the Cornell Assessment of Pediatric Delirium (한국어판 Cornell Assessment of Pediatric Delirium 소아 섬망 사정 도구의 검증)

  • Nam, Song Yi;Park, Ki Young;Choi, Su Jung
    • Journal of Korean Clinical Nursing Research
    • /
    • v.26 no.2
    • /
    • pp.254-264
    • /
    • 2020
  • Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

The Reliability and Validity of Korean Version of the Infertility Stigma Scale (K-ISS) (한국어판 난임 낙인 측정도구의 타당도와 신뢰도)

  • Kim, Miok;Ban, Minkyung
    • Journal of Korean Academy of Nursing
    • /
    • v.52 no.6
    • /
    • pp.582-597
    • /
    • 2022
  • Purpose: This study aimed to translate the Infertility Stigma Scale (ISS) into Korean and to evaluate its reliability and validity in the Korean context. Methods: Data were collected from 350 women who underwent in vitro fertilization (IVF). Data were analyzed using SPSS WIN 25.0 and AMOS 22.0. Content validity was analyzed using the item-level content validity index (I-CVI) and scale-level content validity index/averaging (S-CVI/Ave). The preliminary survey was conducted on 20 women who had experienced IVF at least once to check the level of understanding of the tool and the time required to fill out the questionnaire. Exploratory and confirmatory factor analyses were used to test construct validity. Additionally, hypothesis-testing construct validity were tested. Cronbach's α was used to assess the reliability. Results: The Korean-ISS (K-ISS) consists of 25 items, excluding two items from the original ISS questionnaire. Exploratory factor analysis identified four factors, which explained 75.6% of the total variance. The four distinct factors were infertility stigma with self-devaluation (56.8%), public stigma (8.1%), social withdrawal (6.5%), and family stigma (4.2%). In the confirmatory factor analysis, the 25 items in the four-factor structure were validated (χ2 /df ≤ 3, RMSEA ≤ 10). The hypothesis-testing construct validity of K-ISS against FPI (r = .58~.71, p < .001) and FQI (r = - .49~- .65, p < .001) was tested and found to be significant. The internal consistency reliability of the K-ISS, assessed using Cronbach's α, was .97. Conclusion: The K-ISS has satisfactory construct validity and reliability; therefore, it can help minimize the negative impact of stigma by measuring the stigma associated with women experiencing infertility.

Development of the Burnout Scale for General Hospital Nurses (종합병원 간호사의 소진 측정도구 개발)

  • Lee, Sun-Mi;Shin, Hye Sook
    • Journal of East-West Nursing Research
    • /
    • v.29 no.2
    • /
    • pp.95-105
    • /
    • 2023
  • Purpose: The purpose of this study was to develop a measurement tool for burnout in general hospital nurses and verify its reliability and validity. Methods: Construct factors were extracted through an extensive literature review and in-depth interviews with nurses. Psychometric testing was conducted with 550 nurses in a general hospital. Data were analyzed using validity and reliability testing. Results: As a result of factor analysis, 4 factors and 26 items were selected. The burnout factors of general hospital nurses were professional quality of life, work environment excellence, job satisfaction, and negative emotions. The overall coefficient of determination was 46.38%. These factors were validated through convergent, discriminant and concurrent validity testing. The internal consistency reliability was acceptable (Cronbach's α=.91). Conclusions: The Burnout Scale for General Hospital Nurses is a valid and reliable tool that contributes to the assessment of burnout in general hospital nurses. This scale is expected to be used in burnout practice and research of general hospital nurses.