• Title/Summary/Keyword: validity index

Search Result 892, Processing Time 0.038 seconds

The Validity, Reliability and Discriminative Index of the Korean Version of Modified Barthel Index(K-MBI) in Stroke Patients (한국판 수정바델지수(K-MBI)의 타당도, 신뢰도, 문항변별도 검증: 뇌졸중 환자를 대상으로)

  • Choi, Yoo-Im;Kim, Won-Ho;Park, Eun-Young;Kim, Eun-Joo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.9
    • /
    • pp.4119-4125
    • /
    • 2012
  • The purpose of this study was to identify the validity, reliability, and discriminative index of the Korean version of Modified Barthel Index (K-MBI). For this, two hundreds twenty-thee stroke patients participated. Activities of daily living were measured through using K-MBI. Factor analysis was performed for identifying the construct validity and internal consistent and discriminative index were calculated. The result of factor analysis was that the 10 items of K-MBI have communality above .50, and was constructed one factor. Explained variance was 72.184%. The order of factor loading value was toileting, personal hygiene, transfer from bed to chair and back, ambulation/wheelchair, dressing, feeding, bowel control, bathing, bladder control, and stair climbing. Cronbach ${\alpha}$ of K-MBI was .994. The range of discriminative index was .783~.909, and was acceptable. One factor of K-MBI was identified through factor analysis, and reliability and discriminative index was also identified. Various psychometric properties of K-MBI should be investigated in further studies for valid assessment of activities of daily living in stroke patients.

Performance Comparison of Clustering Validity Indices with Business Applications (경영사례를 이용한 군집화 유효성 지수의 성능비교)

  • Lee, Soo-Hyun;Jeong, Youngseon;Kim, Jae-Yun
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.41 no.2
    • /
    • pp.17-33
    • /
    • 2016
  • Clustering is one of the leading methods to analyze big data and is used in many different fields. This study deals with Clustering Validity Index (CVI) to verify the effectiveness of clustering results. We compare the performance of CVIs with business applications of various field. In this study, the used CVIs for comparing performance are DU, CH, DB, SVDU, SVCH, and SVDB. The first three CVIs are well-known ones in the existing research and the last three CVIs are based on support vector data description. It has been verified with outstanding performance and qualified as the application ability of CVIs based on support vector data description.

A Study on the Quantification of Information Security Level (정보보안수준 계량화 연구)

  • Kim, Hyun-Soo
    • Asia pacific journal of information systems
    • /
    • v.9 no.4
    • /
    • pp.181-201
    • /
    • 1999
  • This study presents an information security level index and a quantification scheme. A comprehensive survey on previous researches in information security checklists has been performed. A candidate indicator list for information security level has been developed, Desirability of each indicator has been tested by 4 criteria, They are general validity, relative importance, probability of accident and impact of accident. 67 experts' opinion has been collected and analysed. The result shows that selected indicators are a very good candidate set for the determination of information security level. A factor analysis shows indicators are well structured. There exists strong correlation between validity and probability, validity and impact, and importance and probability. A quantification scheme of information security index has been developed by experts' judgement and statistical tests.

  • PDF

Development and Validation of a Clinical Critical Thinking Skills Scale (임상적 비판적 사고능력 검사도구 개발 및 평가)

  • Shin, Su-Jin;Yang, Eunbae;Kong, Byunghea;Jung, Dukyoo
    • Korean Medical Education Review
    • /
    • v.14 no.2
    • /
    • pp.102-108
    • /
    • 2012
  • This study developed a test entitled Clinical Critical Thinking Skills (CCTS) by using item response theory (IRT) and examined its validity. In the development stage, data obtained from a convenience sample of 627 undergraduate nursing students were analyzed using a discrimination and difficulty index with the TestAn 1.0 program. In the evaluation stage, data from a convenience sample of 284 nursing and non-nursing students were analyzed using a discrimination and difficulty index with the BILOG-MG program. Criterion validity was verified by the group comparison method. Five items received low discrimination index scores according to the IRT results. In terms of the criterion validity, CCTS scores differed according to major (t=2.21, p=0.028), location of high school (F=4.35, p=0.014), clinical experience (t=5.66, p=0.004), and grade point average (F=7.17, p< 0.001). The CCTS can be used to measure critical thinking skills in the clinical setting.

Validity and Reliability of the Plaque Score Using Qraycam (Qraycam을 이용한 치면세균막 검사의 타당도와 신뢰도)

  • Kim, Mi;Lee, Su-Young;Cho, Young-Sik
    • Journal of dental hygiene science
    • /
    • v.15 no.3
    • /
    • pp.377-382
    • /
    • 2015
  • The purpose of this study was to evaluate the validity and reliability of plaque scoring system using new Qraycam (All in One Bio, Korea) device which enables plaque score without tooth disclosing. This study measured Quigley-Hein index and plaque control record by both Qraycam and disclosing agent on 64 elderly people and checked degree of congruence between the two methods. Reliability was evaluated with the mean of measured values, kappa index and intraclass correlation coefficient statistical analysis. The analysis of the plaque scores showed a high agreement between the measured values according to the method of measurement and the measured part. The mean of plaque index of anterior labial were not significantly different according to measurement method. The kappa index was higher by Qraycam and tooth disclosing method of plaque index. Therefore, it was verified that Qraycam has sufficient reliability as screening tool for plaque scoring system.

Cognitive-Pragmatic Language Assessment for Normal Aging : Study of Assessment Tools and Content Validity (노년층의 인지-화용언어 능력 평가 : 평가도구 및 내용타당도 연구)

  • Lee, Mi-Sook;Kim, Hyang-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.5
    • /
    • pp.280-292
    • /
    • 2012
  • Cognitive-pragmatic language ability decreases during the normal aging process. Evaluating the ability might be useful in testing predicting cognitive level and diseases such as dementia. The aim of this study is to analyze various assessment protocols for normal aging, and evaluate the content validity of the currently developing cognitive-pragmatic language test domains and items. Content Validity Index(CVI) was calculated based on ratings judged by 17 experts including speech-language pathologists and clinical psychologists. As a result, it was found that CVIs of all 7 domains including attention, memory, organization, reasoning, problem solving, executive function, pragmatic language were above .75. It was concluded that the test items contained the appropriate content validity to assess cognitive-pragmatic language for normal aging.

The validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale for nursing students (한국어판 간호대학생의 인공지능에 대한 태도 측정도구 신뢰도 및 타당도 검증)

  • Seo, Yon Hee;Ahn, Jung-Won
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.28 no.4
    • /
    • pp.357-367
    • /
    • 2022
  • Purpose: The aim of the study was to verify the validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale (GAAIS-K) for nursing students. Methods: Data from 235 participants were collected from April 12 to April 26, 2022. A total of 230 participants' data were analyzed. The data were analyzed for content, discriminant, known-groups, and construct validity using content validity index, correlation coefficient, and confirmatory factor analyses. The reliability of the GAAIS-K was examined using internal consistency and test-retest analyses. Results: The expert-rated content validity index was ≥.80. The sub-scales of the GAAIS-K were moderately correlated with attitude toward accepting technology, indicative of its discriminant validity. The male students' positive attitude score was significantly higher than that of the female students, satisfying the known-groups validity. Cronbach's α for the scale was .86 (positive) and .74 (negative), and the intra-class correlation coefficient for the two-week test-retest reliability was .86 (positive) and .60 (negative). The scores for positive and negative attitudes were 3.68±0.46 and 3.05±0.55. Conclusion: This study shows that the GAAIS-K is a valid and reliable instrument for assessing nursing students. Additional research is recommended to continue the evaluation of the GAAIS-K with a focus on healthcare settings.

Measurement Scale Development of Waterpark Service Quality (워터파크의 서비스품질 척도개발)

  • Kwak, Han-Pyong;Kim, Kyong-Sik;Lee, Chang-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.1
    • /
    • pp.426-435
    • /
    • 2010
  • The object of this study was to develop an index of service quality of waterparks and verify the validity and reliability of the index. This study represents the waterparks user population in 2009, and 250 people were extracted by using the purposive sampling method. In other words, five locations have major waterparks were chosen and 50 people per each location were collected. Conference, panel survey, exploratory factor analysis and confirmatory factor analysis were performed to verify the validity of the questionnaire while item analysis, interrater reliability and internal consistency reliability were conducted to probate the reliability. Through these methods and procedures, the results of this study like these; (i) Validity of this index was significantly high and the index include amenity/cleanness, safety, price, programs, facilities, accessibility and promotion. Among them, amenity/cleanness was the major factor for the validity value; (ii) Reliability of this index was also high. There are high correlations between questions and fields and questions and total score. And the Cronbach's $\alpha$ values of the internal consistency reliability was over 0.603 except in the case of promotion which was below 0.6. After all the analysis, the index of service quality proved to be very proper and reliable index. Therefore, the major factors of service quality have to be figured out and reflected to the management innovation to improve service quality of waterparks.

Reliability and Validity of the Side-lying Instability and Prone Instability Tests in Patients with Lumbar Segmental Instability

  • Kim, Bo-Eon;Lee, Kwan-Woo;Park, Dae-Sung
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.16 no.1
    • /
    • pp.1-7
    • /
    • 2021
  • PURPOSE: The purpose of this study is to conduct inter-rater and intra-rater reliability tests in patients with low back pain (LBP) using the prone instability test (PIT) and side-lying instability test (SIT). We have analyzed the Korean version Oswestry disability index (K-ODI) correlations and radiograph finding (RF) for validity. METHODS: Individuals (n = 51) (mean age of 40.27 ± 13.28) with LBP for at least over a week were recruited, together with two participating physical therapist examiners. The measurement consisted of PIT, PST, K-ODI, and RF. Sensitivity (Sn), specificity (Sp), positive predictive value, negative predictive value, prevalence index, agreement %, Cohen's kappa, and prevalence-adjusted bias-adjusted kappa (PABAK) were calculated. The PIT and SIT were compared with RF for validity analysis, while PIT, SIT, K-ODI, and RF were calculated for the correlation analysis. RESULTS: The intra-rater reliability test measured for the PIT (kappa = .79, PABAK = .88) and SIT (kappa = .73, PABAK = .84), and inter-rater reliability test measured for the SIT (kappa = .80, PABAK = .88) showed good agreements. The PIT (Sn = .65, Sp = .63) and SIT validities (Sn = .68, Sp = .70) were compared with RF, showing a significant correlation in PIT and RF (r = .69), SIT and RF (r = .73), and PIT and K-ODI (r = .53). CONCLUSION: The SIT is a more comfortable position test than the PIT in patients. Both PIT and SIT have acceptable reliability and validity.

Development and validation of a novel screening instrument to prioritize the orthodontic referral of developing malocclusion in children: The index for interceptive orthodontics referral

  • Saraswathy Devi Sinniah;Annapurny Venkiteswaran;Najiyatu Nazihah Zakaria
    • The korean journal of orthodontics
    • /
    • v.53 no.2
    • /
    • pp.116-124
    • /
    • 2023
  • Objective: The absence of a guideline to refer to developing malocclusions appropriately, may be a contributing factor to the inadequacy of timely interceptive orthodontics provision. This study aimed to develop and validate a new orthodontic grading and referral index to be used by dental frontliners to prioritize the orthodontic referral of developing malocclusion in children based on its severity. Methods: A cross-sectional study involving clinical assessment with 413 schoolchildren aged between 8.1 and 11.9 years was conducted in 2018. All the presenting malocclusion was listed and graded based on a few dental guidelines to produce the draft index. The validity and reliability of the draft index were tested using twenty study models. Face and content validation was carried out using the content validation index and Modified Kappa Statistics. Results: Fourteen dental and occlusal anomalies were identified as components of malocclusion and three grades of referral (monitor, standard, urgent) were included in the final index. The scale-level content validity index average value of 0.86 and 0.87 was obtained for content and face validation, respectively. There was moderate to excellent agreement in the Modified Kappa Statistics for both validations. Excellent inter- and intra-assessor agreement was obtained. The new index displayed valid and reliable scores. Conclusions: The Index for Interceptive Orthodontics Referral was developed and validated for the dental frontliners to identify and prioritize the developing malocclusion in children based on its severity and refer for orthodontic consultation to increase the possibility for interceptive orthodontics.