• Title/Summary/Keyword: Validity analysis

Search Result 7,125, Processing Time 0.029 seconds

A Validity Study for the Development of a Digital Competency Assessment Tool for Preschool Teachers (유아교사의 디지털 역량 측정 도구 개발을 위한 타당성 연구)

  • Young-Mi Lee;Seon-Young Park
    • Journal of Internet of Things and Convergence
    • /
    • v.10 no.2
    • /
    • pp.93-102
    • /
    • 2024
  • The purpose of this study is examine the validity of digital competency indicators in order to develop a tool that can measure the digital competency of preschool teachers. To review the validity, exploratory factor analysis and confirmatory factor analysis were conducted on the data of 272 preschool teachers. The exploratory factor analysis resulted in four factors, and the confirmatory factor analysis verified the fit, validity(convergent validity, discriminant validity) and reliability of each competency group and the model composition of sub-competency indicators. The four factors validated were named 'Understanding Digital Technologies', 'Digital Technology Understanding', 'Digital Technology Application', 'Digital Technology-based Communication', 'Digital Ethics Understanding and Practice'. The analysis results demonstrated the reliability and validity of the tool for measuring the digital competencies of preschool teachers, and it is meaningful in that it can provide a foundation for measuring the digital competency of preschool teachers and conducting education program suitable for each digital competency level.

Reliability and Validity Study on the Korean Version of the Fullerton Advanced Balance Scale (한국어판 플러턴 어드밴스드 균형 척도의 신뢰도와 타당도 연구)

  • Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.23 no.1
    • /
    • pp.31-37
    • /
    • 2016
  • Background: The assessment tool developed in other countries should be translated into Korean language using rigorous methodological approaches in order to be used in Korea. Because these procedures are insufficient for establishing the cross-cultural and linguistic equivalence, the need for statistical methods is raised. The Fullerton Advanced Balance Scale was translated into Korean and the content validity was verified through the back translation method, but the reliability and validity have not yet been proven by statistical methods. Objects: The purpose of this study was to investigate the reliability and validity of the Korean version of the Fullerton Advanced Balance Scale (KFAB) by statistical methods in elderly people. Methods: A total of 97 elderly adults (39 males and 58 females) participated in this study. Internal consistency of the KFAB was measured using Cronbach's alpha and an intraclass correlation coefficient (ICC) was used to assess test-retest reliability between the two measurement sessions. Concurrent validity was measured by comparing the KFAB responses with the Korean version of the Berg Balance Scale (KBBS) using the Spearman correlation coefficient. Construct validity of the KFAB was measured using the exploratory factor analysis to evaluate the unidimensionality of the questionnaire. The significance level was set at ${\alpha}=.05$. Results: The internal consistency of the KFAB was found be adequate with Cronbach's alpha (.96), and test-retest reliability was excellent as evidenced by the high ICC (r=.996). Concurrent validity showed high correlation between the KFAB and KBBS (r=.89, p<.001). Construct validity was evaluated using exploratory factor analysis. The result from Bartlett test of sphericity was statistically significant (p<.001), and the value of Kaiser-Meyer-Olkin measure of sampling adequacy was .93. Exploratory factor analysis revealed the existence of only one dominant factor that explained 76.43% of the variance. Conclusion: The KFAB is a reliable, valid and appropriate tool for measuring the balance functions in elderly people.

Validity and Reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in Knee Osteoarthritis Patients (골관절염영향측정척도(AIMS-SF)의 타당도 및 신뢰도 - 일부 슬관절 골관절염 환자를 대상으로 -)

  • Yi, Seung-Ju;Nam, Tae-Ho
    • The Journal of Korean Physical Therapy
    • /
    • v.19 no.5
    • /
    • pp.29-41
    • /
    • 2007
  • Purpose: The aim of this study was to examine the validity and reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in patients with knee osteoarthritis(OA). Methods: The sample consisted of 62 patients who had received physical therapy at the physical therapy units of the Andong Medical Center, Sungso Hospital, Ahn Orthopedic Surgery Clinic, and St. Luke Clinic in Andong city in June 2006. Questionnaire on the AIMS-SF was recruited by 5 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, Pearson's relation coefficient. To explore construct validity we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. Results: 62 OA patients's an average $age{\pm}standard$ deviation was $53.8{\pm}14.4$ years (range: $40{\sim}81$ yr). The internal consistency reliability of 11 items, as estimated by Cronbach's ${\alpha}$ coefficient, was high ranging $0.60{\sim}0.78$ (except for 0.40 for mobility level and -0.48 for mood). The internal consistency reliability of item-each scale was also high $0.82{\sim}0.93$ (except for 0.48 for mood). Of 11 items, the item-discriminant validity on 6 items was high (${\alpha}$ coefficient range: $0.11{\sim}0.25$), however, others (0.57 for tension level, 0.48 for arthritis pain, 0.41 for walking and bending, and 0.40 for work) were a little low. The construct validity by factor analysis was a little low. Conclusion: In conclusion, the results reported here confirm the validity and reliability of the AIMS-SF in patients with OA of the knee. The Collection of information on health status using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

  • PDF

Validity and Reliability of the Korean Version of the Expanded Nursing Stress Scale (한국어판 간호사 직무 스트레스 측정도구의 타당도와 신뢰도 분석)

  • Kim, Kyoung Mi;Nam, Kyoung A;Lee, Eunhee;Jeong, Geum Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.21 no.5
    • /
    • pp.542-551
    • /
    • 2015
  • Purpose: This study was done to evaluate validity and reliability of the Korean version of the expanded nursing stress scale (ENSS). Methods: Forward-backward translation of ENSS from English to Korean was conducted. The translated instrument was pilot-tested and administrated to 285 nurses who worked in five general hospitals in Korea. Internal consistency reliability was assessed using Cronbach's ${\alpha}$ and composite reliability. Validity was evaluated through construct validity with confirmatory factor analysis, convergent and discriminant validity. Results: The Korean version of ENSS showed a reliable internal consistency with Cronbach's ${\alpha}$ .95 and composite reliability .99. Model fit indexes for 46 items were validated by confirmatory factor analysis(goodness of fit index .82, Tucker-Lewis index .92, root mean square error of approximation .04), indicating suitable construct validity. Factor loading of the 48 items (.47~.88) and average variance extracted out of nine factors (.52~.71.) indicated satisfactory convergent validity. Some values of square of the correlation coefficient between factors (.12~.89) were higher than average variance extracted values of each factor (.52~.71) so that it partly satisfied discriminant validity. Conclusion: Findings show that the Korean version ENSS has good reliability and suitable validity; therefore, can be used to assess and identify Korean nurses' job stress.

Validity and Reliability of Korean Version of the Spiritual Care Competence Scale (한국판 영적간호역량 측정도구의 타당도와 신뢰도)

  • Chung, Mi Ja;Park, Youngrye;Eun, Young
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.6
    • /
    • pp.871-880
    • /
    • 2016
  • Purpose: The aim of this study was to examine the validity and reliability of the Korean Version of the Spiritual Care Competence Scale (K-SCCS). Methods: A cross-sectional study design was used. The K-SCCS consisted of 26 questions to measure spiritual care competence of nurses. Participants, 228 nurses who had more than 3 years'experience as a nurse, completed the survey. Confirmatory factor analysis was used to examine the construct validity and correlations of K-SCCS and spiritual well-being (SWB) were used to examine the criterion validity of K-SCCS. Cronbach's alpha was used to test internal consistency. Results: The construct and the criterion-related validity of K-SCCS were supported as measures of spiritual care competence. Cronbach's alpha was .95. Factor loadings of the 26 questions ranged from .60 to .96. Construct validity of K-SCCS was verified by confirmatory factor analysis (RMSEA=.08, CFI=.90, NFI=.85). Criterion validity compared to the SWB showed significant correlation (r=.44, p<.001). Conclusion: The findings suggest that K-SCCS serves as an appropriate measure of spiritual care competence with validity and reliability. However, further study is needed to retest the verification of the factor analysis related to factor 2 (professionalisation and improving the quality of spiritual care) and factor 3 (personal support and patient counseling). Therefore, we recommend using the total score without distinguishing subscales.

The Reliability and Validity of Korean Version of the Infertility Stigma Scale (K-ISS) (한국어판 난임 낙인 측정도구의 타당도와 신뢰도)

  • Kim, Miok;Ban, Minkyung
    • Journal of Korean Academy of Nursing
    • /
    • v.52 no.6
    • /
    • pp.582-597
    • /
    • 2022
  • Purpose: This study aimed to translate the Infertility Stigma Scale (ISS) into Korean and to evaluate its reliability and validity in the Korean context. Methods: Data were collected from 350 women who underwent in vitro fertilization (IVF). Data were analyzed using SPSS WIN 25.0 and AMOS 22.0. Content validity was analyzed using the item-level content validity index (I-CVI) and scale-level content validity index/averaging (S-CVI/Ave). The preliminary survey was conducted on 20 women who had experienced IVF at least once to check the level of understanding of the tool and the time required to fill out the questionnaire. Exploratory and confirmatory factor analyses were used to test construct validity. Additionally, hypothesis-testing construct validity were tested. Cronbach's α was used to assess the reliability. Results: The Korean-ISS (K-ISS) consists of 25 items, excluding two items from the original ISS questionnaire. Exploratory factor analysis identified four factors, which explained 75.6% of the total variance. The four distinct factors were infertility stigma with self-devaluation (56.8%), public stigma (8.1%), social withdrawal (6.5%), and family stigma (4.2%). In the confirmatory factor analysis, the 25 items in the four-factor structure were validated (χ2 /df ≤ 3, RMSEA ≤ 10). The hypothesis-testing construct validity of K-ISS against FPI (r = .58~.71, p < .001) and FQI (r = - .49~- .65, p < .001) was tested and found to be significant. The internal consistency reliability of the K-ISS, assessed using Cronbach's α, was .97. Conclusion: The K-ISS has satisfactory construct validity and reliability; therefore, it can help minimize the negative impact of stigma by measuring the stigma associated with women experiencing infertility.

The Reliability and Validity of the Lasater Clinical Judgement Rubric in Korean Nursing Students (임상판단 평가도구의 신뢰도 및 타당도 검증)

  • Shim, Kaka;Shin, Hyunsook
    • Child Health Nursing Research
    • /
    • v.21 no.2
    • /
    • pp.160-167
    • /
    • 2015
  • Purpose: This study was done to evaluate the Lasater Clinical Judgement Rubric for use with Korean nursing students. Methods: A methodological study was used to validate the rubric developed by Lasater to assess clinical judgment during nursing simulation. Participants were 34 nursing students at K University in Seoul. Between February and May, 2012, analysis was done of 91 video clips recording performance during simulation. Results: Findings showed reliability and validity of the rubric. For internal consistency, Cronbach's ${\alpha}$ score was .884 and intraclass correlation coefficient was .839, which established reliability. The rubric was validated using the exploratory factor analysis and content validity. The content validity score was 83%, establishing the appropriateness and readiness of the tool. Factor analysis showed that noticing, responding, and reflecting domains had Eigen values of 2.669, 1.991, and 2.912, respectively and were bound, but unlike the original tool in which four factors noticing, interpretation, responding, and reflecting domains were bound. Conclusion: Results of the study indicate that the rubric shows acceptable reliability and validity in Korean nursing students. This evaluation tool for nursing simulation allows nursing faculty to objectively evaluate students' clinical judgment as well as students to reflect on their clinical judgment process during simulation.

Validity and Reliability of the Self-Reflection and Insight Scale for Korean Nursing Students (간호대학생의 자기-성찰 및 통찰력 측정도구 타당도 및 신뢰도 검증)

  • Song, Mi Ok;Kim, Heeyoung
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.25 no.1
    • /
    • pp.11-21
    • /
    • 2018
  • Purpose: The purpose of this study was to translate the Self-Reflection and Insight Scale (SRIS) into Korean and test its validity and reliability. Methods: Participants were 340 nursing students who were recruited from 5 nursing colleges in Korea. Data were collected from November 21 to December 20, 2016 and analyzed using the IBM Statistics SPSS 22.0 and AMOS 23.0 programs. Exploratory factor analysis, Confirmatory factor analysis, and concurrent validity analysis were performed. Results: For the Korean-SRIS (K-SRIS) 4 items were deleted from the original SRIS. The final scale consisted of 16 items which were sorted into- the 2 factors: self-reflection (11 items), insight (5 items). The cumulative percent of variance was 50.91%. The statistically significant correlation between K-SRIS scores and the Reflection in Learning Scale (RLS) support the concurrent validity of the K-SRIS. The reliability of the scale, Cronbach's ${\alpha}$ was .83. Conclusion: The finding indicate that the K-SRIS has validity and reliability. Therefore it can be used for measuring and developing reflection ability in nursing students.

Validation Study of the Korean Version of the Jefferson Scale of Empathy-Health Professions Students for Measuring Empathy in Undergraduate Nursing Students (간호대학생 대상 한국판 의료계열 학생용 제퍼슨 공감 척도의 신뢰도 및 타당도 검증)

  • Kim, Jisoon;Ahn, Sukhee
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.24 no.3
    • /
    • pp.259-268
    • /
    • 2018
  • Purpose: This study was to validate the Korean version of the Jefferson Scale of Empathy-Health Professions Students (K-JSE-HPS) in undergraduate nursing students. Methods: With a survey design, a total of 293 junior and senior nursing students were recruited and data were collected using a self-administered study questionnaire to measure their levels of empathy use the K-JSE-HPS. Using SPSS/WIN 22.0 and AMOS 22.0, data analysis was conducted with confirmatory factor analysis, criterion validity, and reliability. Results: For construct validity, confirmatory factor analysis showed an acceptable model fit (Goodness of Fit Index was 0.88) along with confirming convergent and discriminant validity (construct reliability was 0.70). For criterion validity, the scale was significantly related with the Interpersonal Reaction Index. For reliability, Cronbach's ${\alpha}$ coefficient for the scale was 0.87 and for the subscales were 0.84, 0.78, and 0.69, respectively. Conclusion: The findings show satisfactory construct and criterion validity and reliability of the Korean version of the JSE-HPS for measuring empathy in undergraduate nursing students.

Development of an Instrument to Assess the Nursing Professional Pride (간호 전문직 자부심 측정도구 개발)

  • Jeon, JaeHee;Lee, EunHee;Kim, EunJoo
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.2
    • /
    • pp.228-241
    • /
    • 2020
  • Purpose: The purpose of this study was to develop an instrument to assess nursing professional pride. Methods: Fifty-six preliminary items were identified through literature review and focus group interview of nurses working in a hospital. Of these, 45 preliminary instruments were completed over 0.80 of content validity index. To verify the reliability and validity of the preliminary instrument, data were collected from 294 nurses. The data were analyzed using factor analysis and multidimensional scaling analysis. Results: From the factor analysis, 27 significant items were divided into 5 subscales. These subscales were as follows: feeling of vocation, role satisfaction, role of problem solver, self-achievement, and willingness to stay. The nursing professional pride also established criterion-related validity, discriminant validity, and group validity. Cronbach's α of the instrument was .92, and the subscales ranged from .74 to .85. Conclusion: The developed scale for nursing professional pride shows validity and reliability. The significance of this study is the development of an instrument capable of measuring nursing professional pride. To verify the relevance of this instrument, conducting comparative studies is suggested.