• Title/Summary/Keyword: internal consistency

Search Result 1,007, Processing Time 0.027 seconds

Preliminary Study to Develop the Korean Medical Pathologic Aging Scale and Korean Medical Pattern Identification for Dementia (한의학 병리적 노화 척도와 치매 한의학적 변증진단 개발 및 신뢰도 평가)

  • Lee, Go eun;Moon, Kwang Su;Kim, Nam Kwen;Chung, sun yong;Jung, In Chul;Kang, Hyung Won
    • The Journal of Korean Medicine
    • /
    • v.38 no.3
    • /
    • pp.111-123
    • /
    • 2017
  • Objectives: To develop and investigate the reliability of the pathologic aging scale based on korean medical theory and korean medical pattern identification for dementia. Methods: We searched the textbook of korean neurophychiatry and Donguibogam and selected items through professional consensus. We compared between dementia(n=40) and normal elderly(n=38) and tested the reliability of two scales. Results: After professional consensus, we drafted the Korean Medical Pathologic Aging Scale(12 items, Likert 3 scale) and Korean Medical Pattern Identification for Dementia(4 patterns, 28 items, Likert 5 scale). On Korean Medical Pathologic Aging Scale, There is no significant difference between two groups. We had good internal consistency(Cronbach's alpha = 0.6) and test-retest reliability(r=0.631) but low inter-rater reliability(r=0.430). On Korean Medical Pattern Identification for Dementia, dementia patients diagnosed with Qi deficiency are significantly more than those in normal group. We had fairly good internal consistency(Cronbach's alpha = 0.574) and excellent test-retest(kappa= .800) and inter-rater reliability(kappa = .733). Conclusions: Korean Medical Pattern Identification for Dementia is appropriate for diagnosing korean medical pattern. But Korean Medical Pathologic Aging Scale isn't appropriate to discriminate dementia from normal elderly because of many subjective items. Therefore objective measurement of sensory dysfunction would be needed to measure pathologic aging based on korean medical theory.

Validity and Reliability of the Korean Version of the Expanded Nursing Stress Scale (한국어판 간호사 직무 스트레스 측정도구의 타당도와 신뢰도 분석)

  • Kim, Kyoung Mi;Nam, Kyoung A;Lee, Eunhee;Jeong, Geum Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.21 no.5
    • /
    • pp.542-551
    • /
    • 2015
  • Purpose: This study was done to evaluate validity and reliability of the Korean version of the expanded nursing stress scale (ENSS). Methods: Forward-backward translation of ENSS from English to Korean was conducted. The translated instrument was pilot-tested and administrated to 285 nurses who worked in five general hospitals in Korea. Internal consistency reliability was assessed using Cronbach's ${\alpha}$ and composite reliability. Validity was evaluated through construct validity with confirmatory factor analysis, convergent and discriminant validity. Results: The Korean version of ENSS showed a reliable internal consistency with Cronbach's ${\alpha}$ .95 and composite reliability .99. Model fit indexes for 46 items were validated by confirmatory factor analysis(goodness of fit index .82, Tucker-Lewis index .92, root mean square error of approximation .04), indicating suitable construct validity. Factor loading of the 48 items (.47~.88) and average variance extracted out of nine factors (.52~.71.) indicated satisfactory convergent validity. Some values of square of the correlation coefficient between factors (.12~.89) were higher than average variance extracted values of each factor (.52~.71) so that it partly satisfied discriminant validity. Conclusion: Findings show that the Korean version ENSS has good reliability and suitable validity; therefore, can be used to assess and identify Korean nurses' job stress.

Development of Korean Intensive Care Delirium Screening Tool (KICDST) (중환자 섬망 선별도구 개발)

  • Nam, Ae-Ri-Na;Park, Jee-Won
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.1
    • /
    • pp.149-158
    • /
    • 2016
  • Purpose: This study was done to develop of the Korean intensive care delirium screening tool (KICDST). Methods: The KICDST was developed in 5 steps: Configuration of conceptual frame, development of preliminary tool, pilot study, reliability and validity test, development of final KICDST. Reliability tests were done using degree of agreement between evaluators and internal consistency. For validity tests, CVI (Content Validity Index), ROC (Receiver Operating Characteristics) analysis, known group technique and factor analysis were used. Results: In the reliability test, the degree of agreement between evaluators showed .80~1.00 and the internal consistency was KR-20=.84. The CVI was .83~1.00. In ROC analysis, the AUC (Area Under the ROC Curve) was .98. Assessment score was 4 points. The values for sensitivity, specificity, correct classification rate, positive predictive value, and negative predictive value were found to be 95.0%, 93.7%, 94.4%, 95.0% and 93.7%, respectively. In the known group technique, the average delirium screening tool score of the non-delirium group was $1.25{\pm}0.99$ while that of delirium group was $5.07{\pm}1.89$ (t= - 16.33, p <.001). The factors were classified into 3 factors (cognitive change, symptom fluctuation, psychomotor retardation), which explained 67.4% of total variance. Conclusion: Findings show that the KICDST has high sensitivity and specificity. Therefore, this screening tool is recommended for early identification of delirium in intensive care patients.

Psychometric Evaluation of the Korean Social Support Questionnaire (한국 사회적지지 측정도구 개발)

  • Oh, Ka-Sil;Oh, Kyong-Ok;Lee, Sook-Ja;Kim, Jeong-Ah;Jeong, Chu-Ja;Kim, Hye-Ryoung;Jun, Hoa-Yun;Kang, Jung-Hee
    • Journal of Korean Academy of Nursing
    • /
    • v.38 no.6
    • /
    • pp.881-890
    • /
    • 2008
  • Purpose: Research related to social support in Korea has been hampered by paucity of measurement tools reflecting Korean culture. The aim of the study was to develop Korean social support questionnaire (KSSQ) based on the Korean social support pyramid and to test psychometric properties of the KSSQ. Methods: The questionnaire was administered to 701 subjects and 658 college students. Psychometric analyses included factor analyses, expert validity, criterion-related validity, internal consistency, and test-retest reliability. Results: A principal components analysis support for construct validity, eliciting a three factor solution accounting for 65.46% of variance in scores. Concurrent and discriminant validity supported criterion-related validity. Internal consistency of reliability was support with Cronbach's alpha of .97-.98 for the entire scale. Test-retest reliability was .76. Conclusion: This initial testing of KSSQ to measure Korean social support demonstrates evidence of reliability and validity. Assessment of known-group validity and norm establishment of KSSQ are suggested to provide further sound psychometric properties and practical measurement tools.

Development of a Psychological Insulin Resistance Scale for Korean Patients with Diabetes (심리적 인슐린저항성 측정도구 개발)

  • Song, Youngshin;Jeon, Younghee;Cho, Jeonghwa;Kim, Bohyun
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.6
    • /
    • pp.813-823
    • /
    • 2016
  • Purpose: This study was done to develop and validate a measure to evaluate the Korean version of psychological insulin resistance (K-PIR) in patients with diabetes in Korea. Methods: Items were initially generated from literature reviews and interviews with 19 patients with diabetes. The content validity of the items was evaluated by experts. Participants were 424 patients with diabetes recruited through convenience sampling. A cross-sectional survey was designed for item-analysis, exploratory factor analysis with principal axis factoring, and confirmatory factor analysis. Cronbach's alpha was calculated to measure the internal consistency. Results: For the 24 items of the Korean version of psychological insulin resistance, six items were eliminated because of low correlation with the other items. Exploratory factor analysis with 18-item showed that two factors (psycho-cognitive factor and supportive factor) explained 41.8% of the variance, and the factor structure of K-PIR model had a good fit. Internal consistency of K-PIR with 18 items revealed good reliability. Conclusion: The findings show that the K-PIR is reliable for measuring the psychological resistance to insulin therapy for Korean patients with diabetes. However, further study is needed to evaluate the validation because the proportion of variation of K-PIR was low in this study.

Factor Structure of Attitudes Toward Suicide (ATTS) of Adults : Based on a Nationwide Survey in South Korea (한국 성인의 자살태도측정도구의 요인구조 : 2013년 자살실태조사 자료를 바탕으로)

  • Hong, Minseok;Park, Jong-Ik;Lee, Sang-Uk;Shin, Min-Sup;Ahn, Yongmin
    • Korean Journal of Biological Psychiatry
    • /
    • v.26 no.2
    • /
    • pp.71-78
    • /
    • 2019
  • Objectives Suicide is a complex phenomenon not only caused by the individual's mental illness and economic situation, but also occurred in sociocultural contexts and relationships around the individual. Therefore, the attitudes, which include collective norms, thoughts and feelings of a population, toward suicide play a fundamental role in the prevention of suicide. Factor structure of Attitudes Toward Suicide (ATTS), developed by Renberg, is also various in different sociocultural contexts. This is the first study to investigate factor structure of ATTS along with nationwide sample of Korean adults. Methods This study analyzed the factor structure and reliability of ATTS in 1500 regionally stratified Korean adults. Exploratory factor analysis was performed by using principal axis factoring and varimax rotation. Results The selection of 33 ATTS items based on internal consistency and communality was conducted. Five factors were analyzed, which were named 'Good reason,' 'Negative gaze,' 'Predictability,' 'Means of escape,' and 'Common secret,' respectively. Explained total variance was 41.94%, and the internal consistency ranged from 0.516 to 0.740. Conclusions Each of the five factors contains different semantic dimensions. Consistent with previous studies, factors containing permissive attitude toward suicide was high in those with history of suicidal thought and of suicide attempt. It is notable that the 'Good reason' showed higher score in elderly. This may be related to socioeconomic or physical adversities which have been considered the major cause of suicide in elderly.

Measurement Properties of Self-report Questionnaires Published in Korean Nursing Journals (자가 보고형 질문지 측정 속성에 대한 평가: 국내 간호학술지에 게재된 논문을 중심으로)

  • Lee, Eun-Hyun;Kim, Chun-Ja;Kim, Eun Jung;Chae, Hyun-Ju;Cho, Soo-Yeon
    • Journal of Korean Academy of Nursing
    • /
    • v.43 no.1
    • /
    • pp.50-58
    • /
    • 2013
  • Purpose: The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Methods: Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. Results: All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. Conclusion: A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Reliability and Validity on Measurement Instrument for Health Status Assessment in Occupational Workers (직장인들의 건강수준 평가를 위한 측정도구의 신뢰도와 타당도 분석)

  • Koh, Sang-Baek;Chang, Sei-Jin;Kang, Myung-Guen;Cha, Bong-Suk;Park, Jong-Ku
    • Journal of Preventive Medicine and Public Health
    • /
    • v.30 no.2 s.57
    • /
    • pp.251-266
    • /
    • 1997
  • In order to test scaling assumption, and to assess the validity, reliability, and acceptability of the Short form 36(SF-36) health survey questionnaire, we conducted a survey. Samples were 296 workers who had been employed in small sized companies. All scale passed for item internal consistency(100% sucess rate) and item discriminant validity(100% success .ate). Reliability coefficients were ranged from the lowest 0.51 to the highest of 0.85. For 87.5% of the total workers, inconsistent responses were not observed. Only 3.0% of the total workers failed two or more checks. Factor analysis was performed using principal axis factor method and quartimax rotation. In this survey, the SF-36 retained available psychometric properties even when used in a generally healthy worker group. But further study with some consideration to develope health status measurement is expected : first, the definition of health status should be rationalized. Second, the measurement of outcome is an important consideration in evaluations of quality of care. But ambiguities hinder understanding of this important topic. Third, internal consistency should be interpreted with caution as an indication reliability because it ignores potentially important sources of variation that can occur over time.

  • PDF

Item Analysis using Classical Test Theory and Item Response Theory, Validity and Reliability of the Korean version of a Pressure Ulcer Prevention Knowledge (한국어판 욕창예방지식도구의 고전검사이론과 문항반응이론을 적용한 문항분석, 타당도와 신뢰도)

  • Kang, Myung Ja;Kim, Myoung Soo
    • Journal of Korean Biological Nursing Science
    • /
    • v.20 no.1
    • /
    • pp.11-19
    • /
    • 2018
  • Purpose: The purposes of this study were to perform items analysis using the classical test theory (CTT) and the item response theory (IRT), and to establish the validity and reliability of the Korean version of pressure ulcer prevention knowledge. Methods: The 26-item pressure ulcer prevention knowledge instrument was translated into Korean, and the item analysis of the 22 items having an adequate content validity index (CVI), was conducted. A total of 240 registered nurses in 2 university hospitals completed the questionnaire. Each item was analyzed applying CTT and IRT according to 2-parameter logistic model. Response alternatives quality, item difficulty and item discrimination were evaluated. For testing validity and reliability, Pearson correlation coefficient and Kuder Richardson-20 (KR-20) were used. Results: Scale CVI was .90 (Item-CVI range= .75-1.00). The total correct answer rate for this study population was relatively low as 52.5%. The quality of response alternatives was found to be relatively good (range= .02-.83). The item difficulty of the questions ranged form .10 to .86 according to CTT and -12.19 to 29.92 according to the IRT. This instrument had 12-low, 2-medium and 8-high item difficulty applying IRT. The values for the item discrimination ranged .04-.57 applying CTT and .00-1.47 applying IRT. And overall internal consistency (KR-20) was .62 and stability (test-retest) was .82. Conclusion: The instrument had relatively weak construct validity, item discrimination according to the IRT. Therefore, the cautious usage of a Korean version of this instrument would be recommended for discrimination because there are so many attractive response alternatives and low internal consistency.

Reliability and validity of the Korean version of the Dental Fear Survey

  • Kim, Ah-Hyeon;Shim, Youn-Soo;Park, So-Young;Kim, Hee-Won;An, So-Youn
    • Journal of Dental Anesthesia and Pain Medicine
    • /
    • v.15 no.2
    • /
    • pp.85-92
    • /
    • 2015
  • Background: Many people experience varying levels of discomfort when confronted with the prospect of dental treatment. Dental treatment can be a traumatic experience, especially for children and adolescents with dental anxiety. In this age group, dental fear causes a significant problem in dental management and has been related to severe dental caries and dental pain. The Dental Fear Survey (DFS) is the most widely used measure of dental fear. This study was undertaken to develop the Korean version of the DFS (K-DFS) and test its reliability and validity. Methods: The K-DFS, which uses projective techniques to measure children's and adolescents' dental fear, was developed. The DFS was translated into Korean and participants were selected via convenience sampling. Reliability and validity were tested using data from a sample of 813 middle school students in Gyeonggi Province, selected from the Self questionnaire survey. The K-DFS was administered twice to 102 adolescents aged 12-15 years. Results: The K-DFS had high internal consistency reliability (99.1%) but low test-retest reliability. Conclusions: The results indicate that the Korean versions of the DFS have good internal consistency reliabilities and test-retest validities. However, we need to further examine the test-retest reliability of the K-DFS and replicate the current study in different samples covering various age groups.