• Title/Summary/Keyword: Validity study

Search Result 9,273, Processing Time 0.036 seconds

Development and Validation of the Korean Patient Safety Culture Survey Instrument for Hospitals (한국형 환자안전문화 측정도구 개발 및 평가)

  • Sun-Gyo Lee
    • Quality Improvement in Health Care
    • /
    • v.30 no.1
    • /
    • pp.105-119
    • /
    • 2024
  • Purpose: This study aimed to develop a survey instrument to assess the Patient Safety Culture in Korean hospitals and evaluate its validity and reliability. Methods: A preliminary instrument was developed through a literature review, focus group interviews, content validity testing, and pretesting for face validity. A total of 467 hospital employees participated in the psychometric testing. Validity and reliability assessments included content validity, construct validity, criterion-related validity, and internal consistency. Results: The Korean Patient Safety Culture Survey Instrument comprised 35 items across seven factors: leadership, patient safety policy and procedure, patient safety improvement system, teamwork, non-punitive environment, patient safety knowledge and attitudes, and patient safety priority. These seven factors contributed 60.98% of the variance of the total scale. Cronbach's alpha for internal consistency was .93; the seven factors ranged from .66 to .91. Conclusion: The results of this study showed that the Korean Patient Safety Culture Survey Instrument is reliable, valid, and suitable for measuring patient safety culture in Korean hospitals.

Reliability and Validity of the Korean Version of Presenteeism Scale for Students (K-PSS) in Nursing Students (간호대학생을 대상으로 한 한국어 버전 학생 프리젠티즘 측정도구(K-PSS)의 신뢰도와 타당도 분석)

  • Kim, Jin Hee;Jeon, Jaehee
    • Journal of muscle and joint health
    • /
    • v.26 no.3
    • /
    • pp.281-289
    • /
    • 2019
  • Purpose: This study aims to develop the Korean version of Presenteeism Scale for Students and verify its reliability and validity. Methods: This study conducted a survey with 320 undergraduate students who are attending nursing departments at three universities. The survey was conducted twice, from June 1 to August 31, 2017. Results: The Cronbach's α of K-PSS was .70 indicating high reliability. As a result of testing the content validity of K-PSS was verified by calculating the Item level-Content Validity Index (I-CVI) of .87. The correlation between Medical Outcome Study 36-item Short Form Health Survey (SF-36) score and Work Impairment Score (WIS), Work Output Score (WOS), Hours of absenteeism (HA) was analyzed to verify the concurrent validity of K-PSS. SF-36 score was correlated with WIS, WOS, HA. To test the differentiated validity of K-PSS, a total of 38 subjects were assessed by the paired t-test. As a result, only WIS score showed a significant difference between pre-test and post-test. Conclusion: Since the reliability and validity of the K-PSS developed through this study have been verified, it is expected to be used in various studies related to the presenteeism of students.

Development of a Knowledge Scale of Fall Risk Factors for Community-dwelling Older Adults (재가노인의 낙상위험요인 지식 측정도구 개발)

  • Hong, Chong-Min
    • Korean Journal of Adult Nursing
    • /
    • v.24 no.3
    • /
    • pp.244-252
    • /
    • 2012
  • Purpose: The purpose of the study was to develop a knowledge scale of risk factors for fall among community-dwelling older adults. Further, the validity and reliability of the scale was developed. Methods: A preliminary scale was developed through content validity by five experts and targeted subjects using the CVI (Content Validity Index). Following the establishment of content validity, the scale was used with 359 community-dwelling older adults to further establish both validity and reliability of the scale. Specifically, construct validity using known-group comparison technique, and reliability using Cronbach's ${\alpha}$ were established. Results: After content validity testing, 44 preliminary items were selected. Construct validity was established by known group-comparison, in which scores between the fall and no fall groups were compared. The Cronbach's ${\alpha}$ of the final scale was .83. Conclusion: Reliability and validity of the scale were confirmed. This tool may be used for measuring knowledge of fall risk factor for the community-dwelling older adults.

The Study of the Validity Test on the Self-monitoring Scale (자기 검색척도(Self-Monitoring Scale)의 타당성 검정에 관한 연구)

  • 이선아
    • Journal of Korean Academy of Nursing
    • /
    • v.28 no.3
    • /
    • pp.751-759
    • /
    • 1998
  • The study of the validity test on the self-monitoring scale for nurses In this study, both the literary survey as well as empirical research has been executed to test the validity of the scales that measure the construct of the self-monitoring scale. The self-monitoring scale could not be classified into five factors as Snyder suggested. Many other scholars (Briggs, Cheek and Buss, 1980) suggested 3 different classifications which was accepted by Snyder and Gangestad (1986). John, Cheek and Klohnen(1996) claimed a two-factor classification. As has been discussed, factor analysis is used to prove convergent validity within the factor and discriminant validity between the factors. However, depending on the researchers, many variations in classification of the factors were found and a lack of content and discriminant validity were found in the previous research findings. It is also important to note that Snyder's self-monitoring scale did not factor-load at over. 30 for all 25 items, regardless of how many factors could be classified. According to findings of this study, the self-monitoring scale neither classified as five, three or two factors nor factor loaded as hypothesized. It is also clear that Snyder's self-monitoring scale lacks convergent validity as the sub-factors of the scale failed to prove its uni-dimensionality. The A self-monit oring scale not only fail to overcome the problems of Snyder's self-monitori ng scale but even lost the attractiveness of the self-monitoring scale. In this study it was also found that the A self-monitoring scale was not classified in either in a two or three-factor classification as hypothesized. It is, of course, not desirable to use any scale that lacks convergent and discriminant validity even though it has been widely used and has held a great deal of influence on the field of social psychology. To overcome the shortcomings of Snyder's self-monitoring scale, Lennox and Wolfe(1984) suggested 13 items. This study was dedicated to test the validity and reliability of the scale, in which we found that the data presented in validity as the two factors were class ified and loaded as expected. Reliability was also proven by checking Cronbach's α for each factor and for the total items. In addition, a confirmatory factor analysis was executed for the 13 items using LISREL 8.12 program to confirm convergent validity in a two-factor classification. The model was fitting and sound : however, the self-monitoring scale was unfitted and not validated. Thus, it is recommended to use not the original nor the abbreviated self-monitoring scale but the 13 items in future studies. It should also be noted that items 7 and 13 should be removed to obtain better uni-dimensionality for the 13 items. These items loaded at over. 30, too high for the two factors in the test results of Factor analysis. In addition, it is necessary to double-check the cause of two-hold loading at over .30 for the two factors. It could be a problem caused by data or by the scale itself. Therefore, additional studies should follow to better clarify this matter.

  • PDF

The Validity and Reliability of the Korean Version of Readiness for Practice Survey for Nursing Students (한국어판 간호학생 간호실무준비도 측정도구의 타당도와 신뢰도)

  • Lee, Tae Wha;Ji, Yoonjung;Yoon, Yea Seul
    • Journal of Korean Academy of Nursing
    • /
    • v.52 no.6
    • /
    • pp.564-581
    • /
    • 2022
  • Purpose: This study aimed to evaluate the validity and reliability of the Korean version of the Readiness for Practice Survey (K-RPS). Method: The English Readiness for Practice Survey was translated into Korean using the Translation, Review, Adjudication, Pretesting, and Documentation (TRAPD) method. Secondary data analysis was performed using the dataset from the New Nurse e-Cohort study (Panel 2020) in South Korea. This study used a nationally representative sample of 812 senior nursing students. Exploratory and confirmatory factor analyses were also conducted. Convergent validity within the items and discriminant validity between factors were assessed to evaluate construct validity. Construct validity for hypothesis testing was evaluated using convergent and discriminant validity. Ordinary α was used to assess reliability. Results: The K-RPS comprises 20 items examining four factors: clinical problem solving, learning experience, professional responsibilities, and professional preparation. Although the convergent validity of the items was successfully verified, discriminant validity between the factors was not. The K-RPS construct validity was verified using a bi-factor model (CMIN/DF 2.20, RMSEA .06, TLI .97, CFI .97, and PGFI .59). The K-RPS was significantly correlated with self-esteem (r = .43, p < .001) and anxiety about clinical practicum (r = - .50, p < .001). Internal consistency was reliable based on an ordinary α of .88. Conclusion: The K-RPS is both valid and reliable and can be used as a standardized Korean version of the Readiness for Practice measurement tool.

Evaluation on Criterion Validity of Enterprise Health Promotion Index (기업건강증진지수의 준거타당도 평가)

  • Lee, Jinhwa;Ryoo, Jang-Jin;Yu, Young-Soo;Lee, Bokim
    • Korean Journal of Occupational Health Nursing
    • /
    • v.26 no.1
    • /
    • pp.1-9
    • /
    • 2017
  • Purpose: This study was conducted to evaluate the validity of the 'Enterprise Health Promotion Index', a tool for assessing health promotion activities of worksite developed by the Ministry of Employment and Labor and the Korea Occupational Safety and Health Agency. Methods: This is designed a methodological study that evaluates the validity of the Enterprise Health Promotion Index. For this study, a questionnaire survey was conducted for the workplace health professional and safety professional, and a total of 297 data were extracted as final data. We developed the informal health promotion needs and activity measurement tools. The correlation coefficient between the score of the enterprise health promotion index and the score of the informal health promotion tool was analyzed for the criterion validity evaluation. Results: The criterion validity of the Enterprise Health Promotion Index and activity index were supported by finding moderate (r=.597) and high (r=.783) correlation coefficient. However, the requirement index has low levels of criterion validity (r=.364). Conclusion: Based on these results, we suggest to improve the utility of the corporate health promotion index by developing user manual, active public relations, and providing briefing sessions.

Reliability and Validity of the Clinical Judgment Rubric on Simulation Practice with a Post-operative Rehabilitation Case (수술 후 재활 사례에 적용한 임상 판단력 평가도구의 신뢰도 및 타당도)

  • Oh, Hye Kyung
    • The Korean Journal of Rehabilitation Nursing
    • /
    • v.18 no.2
    • /
    • pp.145-152
    • /
    • 2015
  • Purpose: The purpose of this study was to evaluate the reliability and validity of the clinical judgement rubric on simulation practice with a post-operative rehabilitation case. Methods: Methodological study design was used to evaluate the reliability and validity of the clinical judgement rubric on simulation practice. The participants were 35 students in a college of nursing. Results: There were showed reliability and validity of the clinical judgement rubric on simulation practice with a post-operative rehabilitation case. In terms of internal consistency, the Cronbach's ${\alpha}$ for all columns was .821. Factor analysis showed that planning, intervention and evaluation domains with Eigen values of 69.87% were bound, unlike the original tool where four factors including noticing, interpretation, responding and reflecting domains were bound. Convergent validity was established by the correlation between the total clinical judgement score and critical thinking disposition before and after simulation practice. Discriminative validity was established by the correlation between the total clinical judgement score and simulation effectiveness score. Conclusion: The findings of this study suggested that clinical judgement rubric on simulation practice is reliable. Repeated studies are needed to objectively evaluate the clinical judgement rubric of simulation practice for applying various clinical situations.

Study of the Reliability and Validity of the WOMAC Index in Patients with Total Knee Replacement (무릎관절 전치환술 환자에 대한 WOMAC 지수의 신뢰도와 타당성에 관한 연구 )

  • Hoon Jo;Kyoung Kim;Sang-Cheol Im
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.18 no.2
    • /
    • pp.93-101
    • /
    • 2023
  • PURPOSE: The Western Ontario and McMaster Universities Arthritis (WOMAC) index has been used to measure the outcome of total knee replacement (TKR), but studies on its reliability and validity are limited. The present study examined the reliability and validity of this index for patients with knee osteoarthritis who underwent TKR. METHODS: Seventy-one inpatients and outpatients who underwent bilateral TKR for knee osteoarthritis were included in this study. The pain assessment scale and WOMAC index were used to evaluate the participants every two weeks to examine the test-retest reliability, internal consistency, and construct validity. RESULTS: The test-retest reliability scores for pain, stiffness, and physical function were .75-.92, .85-.90, and .75-.95, respectively. The corresponding intraclass correlation coefficients were .75-.88, .76-.88, and .71-.95, respectively. The internal consistency score in the first and second examinations was .92. Furthermore, the construct validity scores for pain, stiffness, and physical function were .83, .41, and .58, respectively. CONCLUSION: The application of the WOMAC index in patients who underwent TKR showed high test-retest reliability and internal consistency with the use of the WOMAC index and good validity with the use of the pain assessment scale.

Development of a lesbian, gay, bisexual, and transgender cultural competence scale for nurses in South Korea: a methodological study

  • Min Kyung Kim;Hye Young Kim
    • Women's Health Nursing
    • /
    • v.30 no.2
    • /
    • pp.107-116
    • /
    • 2024
  • Purpose: This study was conducted to develop a cultural competence scale for nurses regarding the lesbian, gay, bisexual, and transgender (LGBT) community and to test its validity and reliability. Methods: The study adhered to the 8-step process outlined by DeVellis, with an initial set of 25 items derived through a literature review and individual interviews. Following an expert validity assessment, 24 items were validated. Subsequently, a preliminary survey was conducted among 23 nurses with experience caring for LGBT patients. Data were then collected from a final sample of 322 nurses using the 24 items. Item analysis, item-total score correlation, examination of construct and convergent validity, and reliability testing were performed. Results: The item-level content validity index exceeded .80, and the explanatory power of the construct validity was 63.63%. The factor loadings varied between 0.57 and 0.80. The scale comprised five factors: cultural skills, with seven items; cultural awareness, with five items; cultural encounters, with three items; cultural pursuit, with three items; and cultural knowledge, with three items; totaling 21 items. Convergent validity demonstrated a high correlation, affirming the scale's validity. Internal consistency analysis yielded an overall reliability coefficient of 0.97, signifying very high reliability. Each item is scored from 1 to 6 (total score range, 21-126), with higher scores reflecting greater cultural competence in LGBT care. Conclusion: This scale facilitates the measurement of LGBT cultural competence among nurses. Therefore, its use should provide foundational data to support LGBT-focused nursing education programs.

The method of evaluating the validity in making the checklist of statistical method (통계기법 점검표 작성시 타당성 평가방법)

  • Lee, Sang-Bock;Kim, Mal-Sook
    • Journal of the Korean Data and Information Science Society
    • /
    • v.9 no.2
    • /
    • pp.323-336
    • /
    • 1998
  • This thesis is to propose the method of evaluating the validity in stages on the design of a checklist based on the estimate theory of the validity on the design of a checklist and the method of evaluating the validity accordy to the purpose for usiug checklist and establish the standards of estimating the validity in stages on the checklist owing to the estimate theory with the journal, Journal of the Korean Society of Clothing and Textiles. We are emboding the statistical consulting server using the proposed estimate method of the validity and the followings we the questions to solve in future. First, there are many kinds of the statistical methods used in the fields of learing and applied technalogy. So we must establish the statistical standars required in each field and study and develope the special statistical checklists. Second, it is neded to systemize the estimate methods and standard on the validity by building the statistical consult DB, evaluate the researchers according to the degrees of statistical knowledge the validity of study design iud propose the delicate and generalized statistical methods appropriate to the ability of researchers.

  • PDF