• Title/Summary/Keyword: validity index

Search Result 892, Processing Time 0.033 seconds

The Validity, Reliability and Discriminative Index of the Korean Version of Modified Barthel Index(K-MBI) in Stroke Patients (한국판 수정바델지수(K-MBI)의 타당도, 신뢰도, 문항변별도 검증: 뇌졸중 환자를 대상으로)

  • Choi, Yoo-Im;Kim, Won-Ho;Park, Eun-Young;Kim, Eun-Joo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.9
    • /
    • pp.4119-4125
    • /
    • 2012
  • The purpose of this study was to identify the validity, reliability, and discriminative index of the Korean version of Modified Barthel Index (K-MBI). For this, two hundreds twenty-thee stroke patients participated. Activities of daily living were measured through using K-MBI. Factor analysis was performed for identifying the construct validity and internal consistent and discriminative index were calculated. The result of factor analysis was that the 10 items of K-MBI have communality above .50, and was constructed one factor. Explained variance was 72.184%. The order of factor loading value was toileting, personal hygiene, transfer from bed to chair and back, ambulation/wheelchair, dressing, feeding, bowel control, bathing, bladder control, and stair climbing. Cronbach ${\alpha}$ of K-MBI was .994. The range of discriminative index was .783~.909, and was acceptable. One factor of K-MBI was identified through factor analysis, and reliability and discriminative index was also identified. Various psychometric properties of K-MBI should be investigated in further studies for valid assessment of activities of daily living in stroke patients.

Performance Comparison of Clustering Validity Indices with Business Applications (경영사례를 이용한 군집화 유효성 지수의 성능비교)

  • Lee, Soo-Hyun;Jeong, Youngseon;Kim, Jae-Yun
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.41 no.2
    • /
    • pp.17-33
    • /
    • 2016
  • Clustering is one of the leading methods to analyze big data and is used in many different fields. This study deals with Clustering Validity Index (CVI) to verify the effectiveness of clustering results. We compare the performance of CVIs with business applications of various field. In this study, the used CVIs for comparing performance are DU, CH, DB, SVDU, SVCH, and SVDB. The first three CVIs are well-known ones in the existing research and the last three CVIs are based on support vector data description. It has been verified with outstanding performance and qualified as the application ability of CVIs based on support vector data description.

A Study on the Quantification of Information Security Level (정보보안수준 계량화 연구)

  • Kim, Hyun-Soo
    • Asia pacific journal of information systems
    • /
    • v.9 no.4
    • /
    • pp.181-201
    • /
    • 1999
  • This study presents an information security level index and a quantification scheme. A comprehensive survey on previous researches in information security checklists has been performed. A candidate indicator list for information security level has been developed, Desirability of each indicator has been tested by 4 criteria, They are general validity, relative importance, probability of accident and impact of accident. 67 experts' opinion has been collected and analysed. The result shows that selected indicators are a very good candidate set for the determination of information security level. A factor analysis shows indicators are well structured. There exists strong correlation between validity and probability, validity and impact, and importance and probability. A quantification scheme of information security index has been developed by experts' judgement and statistical tests.

  • PDF

Development and Validation of a Clinical Critical Thinking Skills Scale (임상적 비판적 사고능력 검사도구 개발 및 평가)

  • Shin, Su-Jin;Yang, Eunbae;Kong, Byunghea;Jung, Dukyoo
    • Korean Medical Education Review
    • /
    • v.14 no.2
    • /
    • pp.102-108
    • /
    • 2012
  • This study developed a test entitled Clinical Critical Thinking Skills (CCTS) by using item response theory (IRT) and examined its validity. In the development stage, data obtained from a convenience sample of 627 undergraduate nursing students were analyzed using a discrimination and difficulty index with the TestAn 1.0 program. In the evaluation stage, data from a convenience sample of 284 nursing and non-nursing students were analyzed using a discrimination and difficulty index with the BILOG-MG program. Criterion validity was verified by the group comparison method. Five items received low discrimination index scores according to the IRT results. In terms of the criterion validity, CCTS scores differed according to major (t=2.21, p=0.028), location of high school (F=4.35, p=0.014), clinical experience (t=5.66, p=0.004), and grade point average (F=7.17, p< 0.001). The CCTS can be used to measure critical thinking skills in the clinical setting.

Validity and Reliability of the Plaque Score Using Qraycam (Qraycam을 이용한 치면세균막 검사의 타당도와 신뢰도)

  • Kim, Mi;Lee, Su-Young;Cho, Young-Sik
    • Journal of dental hygiene science
    • /
    • v.15 no.3
    • /
    • pp.377-382
    • /
    • 2015
  • The purpose of this study was to evaluate the validity and reliability of plaque scoring system using new Qraycam (All in One Bio, Korea) device which enables plaque score without tooth disclosing. This study measured Quigley-Hein index and plaque control record by both Qraycam and disclosing agent on 64 elderly people and checked degree of congruence between the two methods. Reliability was evaluated with the mean of measured values, kappa index and intraclass correlation coefficient statistical analysis. The analysis of the plaque scores showed a high agreement between the measured values according to the method of measurement and the measured part. The mean of plaque index of anterior labial were not significantly different according to measurement method. The kappa index was higher by Qraycam and tooth disclosing method of plaque index. Therefore, it was verified that Qraycam has sufficient reliability as screening tool for plaque scoring system.

Cognitive-Pragmatic Language Assessment for Normal Aging : Study of Assessment Tools and Content Validity (노년층의 인지-화용언어 능력 평가 : 평가도구 및 내용타당도 연구)

  • Lee, Mi-Sook;Kim, Hyang-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.5
    • /
    • pp.280-292
    • /
    • 2012
  • Cognitive-pragmatic language ability decreases during the normal aging process. Evaluating the ability might be useful in testing predicting cognitive level and diseases such as dementia. The aim of this study is to analyze various assessment protocols for normal aging, and evaluate the content validity of the currently developing cognitive-pragmatic language test domains and items. Content Validity Index(CVI) was calculated based on ratings judged by 17 experts including speech-language pathologists and clinical psychologists. As a result, it was found that CVIs of all 7 domains including attention, memory, organization, reasoning, problem solving, executive function, pragmatic language were above .75. It was concluded that the test items contained the appropriate content validity to assess cognitive-pragmatic language for normal aging.

The validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale for nursing students (한국어판 간호대학생의 인공지능에 대한 태도 측정도구 신뢰도 및 타당도 검증)

  • Seo, Yon Hee;Ahn, Jung-Won
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.28 no.4
    • /
    • pp.357-367
    • /
    • 2022
  • Purpose: The aim of the study was to verify the validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale (GAAIS-K) for nursing students. Methods: Data from 235 participants were collected from April 12 to April 26, 2022. A total of 230 participants' data were analyzed. The data were analyzed for content, discriminant, known-groups, and construct validity using content validity index, correlation coefficient, and confirmatory factor analyses. The reliability of the GAAIS-K was examined using internal consistency and test-retest analyses. Results: The expert-rated content validity index was ≥.80. The sub-scales of the GAAIS-K were moderately correlated with attitude toward accepting technology, indicative of its discriminant validity. The male students' positive attitude score was significantly higher than that of the female students, satisfying the known-groups validity. Cronbach's α for the scale was .86 (positive) and .74 (negative), and the intra-class correlation coefficient for the two-week test-retest reliability was .86 (positive) and .60 (negative). The scores for positive and negative attitudes were 3.68±0.46 and 3.05±0.55. Conclusion: This study shows that the GAAIS-K is a valid and reliable instrument for assessing nursing students. Additional research is recommended to continue the evaluation of the GAAIS-K with a focus on healthcare settings.

Measurement Scale Development of Waterpark Service Quality (워터파크의 서비스품질 척도개발)

  • Kwak, Han-Pyong;Kim, Kyong-Sik;Lee, Chang-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.1
    • /
    • pp.426-435
    • /
    • 2010
  • The object of this study was to develop an index of service quality of waterparks and verify the validity and reliability of the index. This study represents the waterparks user population in 2009, and 250 people were extracted by using the purposive sampling method. In other words, five locations have major waterparks were chosen and 50 people per each location were collected. Conference, panel survey, exploratory factor analysis and confirmatory factor analysis were performed to verify the validity of the questionnaire while item analysis, interrater reliability and internal consistency reliability were conducted to probate the reliability. Through these methods and procedures, the results of this study like these; (i) Validity of this index was significantly high and the index include amenity/cleanness, safety, price, programs, facilities, accessibility and promotion. Among them, amenity/cleanness was the major factor for the validity value; (ii) Reliability of this index was also high. There are high correlations between questions and fields and questions and total score. And the Cronbach's $\alpha$ values of the internal consistency reliability was over 0.603 except in the case of promotion which was below 0.6. After all the analysis, the index of service quality proved to be very proper and reliable index. Therefore, the major factors of service quality have to be figured out and reflected to the management innovation to improve service quality of waterparks.

Reliability and Validity of the Side-lying Instability and Prone Instability Tests in Patients with Lumbar Segmental Instability

  • Kim, Bo-Eon;Lee, Kwan-Woo;Park, Dae-Sung
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.16 no.1
    • /
    • pp.1-7
    • /
    • 2021
  • PURPOSE: The purpose of this study is to conduct inter-rater and intra-rater reliability tests in patients with low back pain (LBP) using the prone instability test (PIT) and side-lying instability test (SIT). We have analyzed the Korean version Oswestry disability index (K-ODI) correlations and radiograph finding (RF) for validity. METHODS: Individuals (n = 51) (mean age of 40.27 ± 13.28) with LBP for at least over a week were recruited, together with two participating physical therapist examiners. The measurement consisted of PIT, PST, K-ODI, and RF. Sensitivity (Sn), specificity (Sp), positive predictive value, negative predictive value, prevalence index, agreement %, Cohen's kappa, and prevalence-adjusted bias-adjusted kappa (PABAK) were calculated. The PIT and SIT were compared with RF for validity analysis, while PIT, SIT, K-ODI, and RF were calculated for the correlation analysis. RESULTS: The intra-rater reliability test measured for the PIT (kappa = .79, PABAK = .88) and SIT (kappa = .73, PABAK = .84), and inter-rater reliability test measured for the SIT (kappa = .80, PABAK = .88) showed good agreements. The PIT (Sn = .65, Sp = .63) and SIT validities (Sn = .68, Sp = .70) were compared with RF, showing a significant correlation in PIT and RF (r = .69), SIT and RF (r = .73), and PIT and K-ODI (r = .53). CONCLUSION: The SIT is a more comfortable position test than the PIT in patients. Both PIT and SIT have acceptable reliability and validity.

The Survey on Contents Validity of 'Preliminary Critical Pathway for Acute Postoperative Pain after Back Surgery' ('요추 수술 후 급성기 통증 환자의 예비 표준임상경로지 내용타당도 설문' 조사 보고)

  • Lim, Kyeong-Tae;Heo, In;Kim, Byung-Jun;Shin, Byung-Cheul;Son, Dong-Wuk;Kim, Chan-Young;Park, Soo Ah;Hwang, Eui-Hyoung
    • Journal of Korean Medicine Rehabilitation
    • /
    • v.26 no.4
    • /
    • pp.77-83
    • /
    • 2016
  • Objectives The aim of this study is to investigate the possibility of making Korean Medicine-Western Medicine collaboration Critical Pathway for Acute Postoperative Pain after Back Surgery. Methods This preliminary Critical Pathway (CP) was composed of 9 Index of vertical axis (assesment, treatment, patient movements, consultation, diet, other, administration, examination, education) and 5 hospitalization periods of horizontal axis through a review of the literature and reference data of medical records. This preliminary CP's Content Validity Index (CVI) survey was carried out by 20 personnel of two different medical institutions from 06, June, 2016 to 15, June, 2016. All data were double-cross checked and analyzed. Results Of those questioned, there were 13 males and 7 females in age, 6 professors, 7 medical residents, 7 nurses in position of 20 personnel. According to the survey, among the 62 contents, 32 contents are above 80 percent agreements, 12 contents were between 70 to 80 percent and 18 contents below 70 percent agreements. Especially, Most contents in treatment index were below fixed validity. Overall Contents Validity in Index, Treatments (72.7%), Diet (100.0%), Other (100.0%), Administration (75.0%) and Examination (100.0%) were in high validity. On the other hands, Assessments (29.4%), Patient movements (0.0%), Consultation (30.0%) and Education (33.3%) were in low position. Conclusions This survey results can be evidence of possibility to develop New Korean Medicine-Western Medicine Collaboration Critical Pathway for Acute Postoperative Pain after Back Surgery.