• Journal of Korean Academy of Nursing
• /
• v.43 no.6
• /
• pp.697-703
• /
• 2013

Purpose: This integrative review study was done to analyze methods used for validation studies in Korean nursing research. Methods: In this study, the literature on instrument development in nursing research from Research Information Sharing Service (RISS) and major nursing journal databases in Korea were examined. The MeSH search terms included 'nursing', 'instrument', 'instrument development', 'validation' and 189 articles were included in the review. Results: The most frequently reported validity type was content validity, followed by construct validity, and criterion validity. One third reported a single type of validity, and 15% of the studies demonstrated three kinds of validity at the same time. In about 40% of the studies, both content and construct validity were examined. Conclusion: The results of the study indicate that it is necessary to provide a wider variety of evidence to establish whether instruments are valid enough to use in nursing research.

• Journal of Korean Academy of Nursing
• /
• v.47 no.1
• /
• pp.121-132
• /
• 2017

Purpose: In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. Methods: The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Results: Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (${\chi}^2/df$)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. Conclusion: The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients.

• Journal of Korean Academy of Nursing
• /
• v.53 no.3
• /
• pp.324-339
• /
• 2023

Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

• Journal of the Korean Society of Physical Medicine
• /
• v.11 no.2
• /
• pp.103-114
• /
• 2016

PURPOSE: The purpose of this study was first to develop a Korean version of pediatric functional muscle testing for children with a motor developmental disorder who have a communication problem and who are aged below five years, and also to verify the content validity. METHODS: First, the preliminary study was conducted to verify the reliability of pediatric functional muscle testing, developed by Venita in Korea. Based on the results of the study, the primary evaluation items were selected and modified. Second, the first test of content validity was conducted through a panel discussion, and a second investigation of content validity was carried out by utilizing the Item Content Validity Index (I-CVI). In this study, we selected only 0.78 or more items from I-CVI. RESULTS: Based on the results of the preliminary study, 19 primary evaluation items were selected. Based on the results of the first and second content validity tests, 15 tertiary evaluation items for the Korean version of pediatric functional muscle testing were determined. CONCLUSION: This study developed a new Korean version of pediatric functional muscle testing and suggested that it will be a useful tool to measure muscle strength for Korean children with a motor developmental disorder and a communication problem, aged below five years.

• Journal of the Korean Home Economics Association
• /
• v.39 no.10
• /
• pp.169-186
• /
• 2001

The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

• Journal of Korean Academy of Nursing Administration
• /
• v.13 no.1
• /
• pp.5-16
• /
• 2007

Purpose: This study is to verify the validity and reliability of classified items and criteria of the patient classification system(PCS) based on Park's definition of nursing intensity. Methods: An expert group of 8 persons verified the content validity of the tools. The 1817 inpatients at a tertiary hospital in Seoul, Korea were classified into 4 groups according to two tools for verifying concurrent validity and interraters' reliability. These verifications were performed from September to October, 2004. Results: Nursing domains of the tools have been divided into 12 items: hygiene, nutrition, elimination, exercise & activity, education & counseling, emotional support, communication & consciousness, treatment & examination, medication, measurement & observation, coordination of multidisciplinary team, admission & discharge & transfer management. Content validity was verified by the content validity index(above 0.75 in all 12 areas). Interraters' reliability was no significant difference in the results of the patient classification between the two raters(A group 93.75%. B group 88.24%). Concurrent validity was also verified by the agreement of two tools(73.7%). Conclusion: These results showed that the reliability and validity of the PCS based on the nursing intensity were verified. These will use an data for nursing productivity in the future.

• Journal of Korean Academy of Nursing
• /
• v.46 no.1
• /
• pp.69-78
• /
• 2016

Purpose: The purpose of this study was to develop a wellness index for workers (WIW) and examine the validity and reliability of the WIW for assessing workers' wellness. Methods: The developmental process for the instrument included construction of a conceptual framework based on a wellness model, generation of initial items, verification of content validity, preliminary study, extraction of final items, and psychometric testing. Content validity was verified by 4 experts from occupational health nursing and wellness disciplines. The construct validity, convergent validity and discriminant validity were examined with confirmatory factor analysis. The reliability was examined with Cronbach's alpha. The participants were 494 workers from two workplaces. Results: Eighteen items were selected for the final scale, and the results of the confirmatory factor analysis supported a five-factor model of wellness with acceptable model fit, and factors named as physical emotional social intellectual occupational wellness. The convergent and discriminant validity were also supported. The Cronbach's alpha coefficient was .91. Conclusion: The results indicate that the WIW is a valid and reliable instrument to comprehensively assess workers' wellness, and to provide basic directions for developing workplace wellness program.

• Research in Community and Public Health Nursing
• /
• v.31 no.2
• /
• pp.130-142
• /
• 2020

Purpose: The purpose of this study was to verify the validity and reliability of the Korean version of the Pain in Older Adults Knowledge Survey (K-POAKS) to assess knowledge of pain in older adults including people with dementia for use in long-term care hospital nurses. Methods: Survey data were collected from a convenience sample of 179 nurses who have worked in long-term care hospitals in B, D and U cities. The Kuder-Richardson Formula 20 for internal consistency for test reliability was conducted. The content, criterion-related and construct validity were evaluated using SPSS/WIN 22.0. Results: The KR 20 was .75 and Content Validity Ratio (CVR) was a range of 0.84~1.00. The criterion-related validity was positively correlated with attitudes (r=.28, p<.001) and performance (r=.21, p=.004). The construct validity of K-POAKS was analyzed by conducting the principal component method using the exploratory factor analysis varimax rotation, and seven factors were derived above the eigenvalue of 1.0. The seven factors explained 58.5% of the total variation. Conclusion: The Korean version of the POAKS showed satisfactory internal reliability, content validity, criterion-related validity and construct validity. These results suggest that the K-POAKS could be used as a suitable tool to measure the knowledge of the aged people's pain, including that of dementia patients for long-term care hospital nurses.

• Quality Improvement in Health Care
• /
• v.30 no.1
• /
• pp.105-119
• /
• 2024

Purpose: This study aimed to develop a survey instrument to assess the Patient Safety Culture in Korean hospitals and evaluate its validity and reliability. Methods: A preliminary instrument was developed through a literature review, focus group interviews, content validity testing, and pretesting for face validity. A total of 467 hospital employees participated in the psychometric testing. Validity and reliability assessments included content validity, construct validity, criterion-related validity, and internal consistency. Results: The Korean Patient Safety Culture Survey Instrument comprised 35 items across seven factors: leadership, patient safety policy and procedure, patient safety improvement system, teamwork, non-punitive environment, patient safety knowledge and attitudes, and patient safety priority. These seven factors contributed 60.98% of the variance of the total scale. Cronbach's alpha for internal consistency was .93; the seven factors ranged from .66 to .91. Conclusion: The results of this study showed that the Korean Patient Safety Culture Survey Instrument is reliable, valid, and suitable for measuring patient safety culture in Korean hospitals.

• Safety and Health at Work
• /
• v.9 no.3
• /
• pp.296-307
• /
• 2018

Background: Safety culture, acting as the oil necessary in an efficient safety management system, has its own weaknesses in the current conceptualization and utilization in practice. As a new approach, resilience safety culture (RSC) has been proposed to reduce these weaknesses and improve safety culture; however, it requires a valid and reliable instrument to be measured. This study aimed at evaluating the reliability and validity of such an instrument in measuring the RSC in sociotechnical systems. Methods: The researchers designed an instrument based on resilience engineering principles and safety culture as the first instrument to measure the RSC. The RSC instrument was distributed among 354 staff members from 12 units of an anonymous petrochemical plant through hand delivery. Content validity, confirmatory, and exploratory factor analysis were used to examine the construct validity, and Cronbach alpha and test-retest were employed to examine the reliability of the instrument. Results: The results of the content validity index and content validity ratio were calculated as 0.97 and 0.83, respectively. The explanatory factor analysis showed 14 factors with 68.29% total variance and 0.88 Kaiser-Meyer-Olkin index. The results were also confirmed with confirmatory factor analysis (relative Chi-square = 2453.49, Root Mean Square Error of Approximation = 0.04). The reliability of the RSC instrument, as measured by internal consistency, was found to be satisfactory (Cronbach ${\alpha}=0.94$). The results of test-retest reliability was r = 0.85, p < 0.001. Conclusion: The results of the study suggest that the measure shows acceptable validity and reliability.