• 제목/요약/키워드: validity-reliability

검색결과 3,287건 처리시간 0.028초

A Validity Study on the Vocabulary Grade Levels Test for Korean Elementary Students

  • Shin, Yousun
    • 영어어문교육
    • /
    • 제18권2호
    • /
    • pp.125-147
    • /
    • 2012
  • The primary goal of the study was to provide some preliminary validity evidence for the Vocabulary Grade Levels Test (Busan Metropolitan City Office of Education, 2009), which is designed to measure the receptive vocabulary knowledge of learners in L2. For the purpose of the current study, 327 participants at the elementary school participated in the study and were asked to take two different vocabulary tests. Namely, a Vocabulary Size Test (Nation, 2001) and a Vocabulary Grade Levels Test. The data were analyzed using correlation in order to discover the relationship between these two types of tests. Following this, the Rasch analysis was conducted to examine the reliability and validity of the measurement in question. The data analysis showed that both grade separation reliability and item separation reliability were high, indicating that the Vocabulary Grade Levels Test well discriminates learners with a wide range of proficiency levels. The findings of the study are discussed, along with further improvements in order to ascertain the validity of this particular vocabulary test.

  • PDF

수학 교수 효능감 도구 MTEBI 한글판의 신뢰도와 타당도 (Reliability and Validity of Korean-Translated Mathematics Teaching Efficacy Beliefs Inventory)

  • 량도형
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제46권3호
    • /
    • pp.263-272
    • /
    • 2007
  • Mathematics Teaching Efficacy Beliefs Inventory (MTEBI) was translated into Korean and conducted among Korean pre-service mathematics teachers. The Korean-translated MTEBI consists of two subscales with 16 items. Personal Mathematics Teaching Efficacy (PMTE) subscale has 10 items and Mathematics Teaching Outcome Expectancy (MTOE) subscale has 6 items. The purpose of this study is to investigate the internal reliability and the construct validity of the Korean-translated MTEBI. The Cronbach alpha coefficient of Korean-translated MTEBI and its two subscales are respectively .87, .83, and .74 which imply that the instrument is reliable. The construct validity was achieved by performing factor analysis. Principal component solution with varimax rotation for the Korean-translated MTEBI was used in factor analysis and thus the best fit simple structure was obtained by two factors which correspond to the self-efficacy dimension and the outcome expectancy dimension of Bandura's self-efficacy theory.

  • PDF

The Validity and Reliability of a Screening Questionnaire for Parkinson's Disease in a Community

  • Kim, Jong-Hun;Cheong, Hae-Kwan;Lee, Chong-Sik;Yi, Sung-Eun;Park, Kun-Woo
    • Journal of Preventive Medicine and Public Health
    • /
    • 제43권1호
    • /
    • pp.9-17
    • /
    • 2010
  • Objectives: Parkinson's disease is one of the most common neurodegenerative diseases in the elderly population. In order to estimate the prevalence of Parkinson's disease in the community, the application of a good screening tool is essential. We evaluated the validity and reliability of a Parkinson's disease screening questionnaire and propose an alternative measure to improve its validity for use in community surveys. Methods: We designed the study in a three-phase approach consisting of a screening questionnaire, neurologic examination, and confirmatory examination. A repeated survey was administered to patients with disease detected in the community and on 150 subjects. We examined internal consistency using Cronbach's alpha test, test-retest reliability using the kappa statistic, and validity using sensitivity, specificity, and ROC curves. Unadjusted odds ratios were utilized for the estimation of weights for each questionnaire item. Results: The Cronbach's alpha of the questionnaire was 0.708. The kappa statistic for test-retest reliability was good to generally fair in most of the items. When newly proposed weighting scores were used, the optimum cut-off value was 7/8. When cut-off value was 5/6 for surveying prevalence in a community, the sensitivity was 0.98, and the specificity was 0.61, with simultaneous improvement in reliability. Conclusions: We recommend 5/6 as the ideal cut-off value for the survey of PD prevalence in community. This questionnaire designed for the Korean community could help future epidemiologic studies of PD.

가미귀비탕(加味歸脾湯)의 우울증 투약지침 개발을 위한 기초연구 - 우울증 변증 설문지의 신뢰도 타당도 평가 - (The Basic Study for Building the Depression Prescription Guideline of Gamiguibi-Tang - The Evaluation of Reliability and Validity of the Depression Pattern-Identification Questionnaire -)

  • 구병수;이상재;한창호;김호준;박세환
    • 동의신경정신과학회지
    • /
    • 제20권4호
    • /
    • pp.1-13
    • /
    • 2009
  • Objectives : As depression falls into the category of Wuljeung, Gamiguibi-Tang(Jiaweiguipitang) is the standard prescription to cure Wuljeung. This study develops a questionnaire for building the guidelines to administer Gamiguibi-Tang to depression and evaluates reliability and validity of questionnaire. Methods : With extracting the text related to depression and Gamiguibi-Tang through total 9 Korean medicine books and consulting the experts, the study selected 80 items and converted them into a questionnaire. It surveyed the neuropsychiatry professors and the medical specialists three times by Delphi method, and lastly selected 21 final items of a questionnaire. On the basis of the questionnaire, it collected total 216 samples and tested their reliability and validity. Results : 21 items all didn't reduce total Cronbach alpha coefficient and satisfied test-retest reliability. As a result of factor analysis, totally 5 factors were extracted such as mental state, sleep, accompaniment, fatigue and weakness. Finally, in comparing a depression group with a normal control group, two groups all showed meaningful difference in each 21 items' point, the sum of factor 1 to 5 items' points, and the sum of 21 items' points. Conclusions : The questionnaire on the updated depression prescription guideline of Gamiguibi-Tang satisfied both of reliability and validity. Later it can help objectifying to apply Gamiguibi-Tang to depression cure.

  • PDF

중환자 분류도구(WMSCN)의 신뢰도, 타당도 및 환산지수 검증 (Reliability, Validity, and Conversion Index of the Workload Management System for Critical Care Nurses(WMSCN))

  • 유정숙;권은옥;김순희;조용애
    • 중환자간호학회지
    • /
    • 제2권1호
    • /
    • pp.48-57
    • /
    • 2009
  • Purpose: The purpose of this study is to establish reliability and validity and to identify the conversion index. Method: The WMSCN for ICU was revised from Workload Management System for Nurses(WMSN) of Walter Reed Army Hospital. Reliability of the WMSCN was evaluated interrater reliability between head nurses and staff nurses at 124 patients in April 2008. Validity through the correlation between direct nursing care hours and WMSCN score was conducted at 20 ICUs of 10 hospitals. Finally the conversion index was identified by total nursing hours and it divided by WMSCN score. Results: The scores by nurses were highly correlated with head nurses’(p=.967), and also scores of the WMSCN were highly correlated with the direct nursing care hours(p<.001). The distribution of patient classification ranks into class V(61.3%), class IV(24.2%) and class VI(11.3%). The scores of the WMSCN were no differences between MICU and SICU. Finally, the conversion index was 8.2 minutes. Conclusion: WMSCN is available to classify the nursing workload for critical care patients. The repeated evaluation of validity and reliability are requisite to use WMSCN effectively. And the conversion index should be adjusted to estimate the appropriate staffing in Korea.

  • PDF

Verification of the Reliability and Validity of the Short Form 36 Scale in Indonesian Middle-aged and Older Adults

  • Arovah, Novita Intan;Heesch, Kristiann C.
    • Journal of Preventive Medicine and Public Health
    • /
    • 제53권3호
    • /
    • pp.180-188
    • /
    • 2020
  • Objectives: The Short Form 36 (SF-36) questionnaire is increasingly being used to measure health-related quality of life (HRQoL) in Indonesia. However, evidence that it is valid for use in Indonesian adults is lacking. This study assessed the validity and reliability of the SF-36 in Indonesian middle-aged and older adults. Methods: Adults aged 46-81 years (n=206) in Yogyakarta, Indonesia completed the SF-36, another measure of HRQoL (the EuroQoL visual analogue scale [EQ-VAS]), and measures assessing their demographic characteristics. Fifty-four percent (n=121) completed the SF-36 measure again 1 week later. Confirmatory factor analysis was conducted to confirm the factor structure of the SF-36. Internal consistency reliability was estimated using Cronbach's alpha, and test-retest reliability was assessed using intraclass correlations. Convergent and discriminant validity were assessed by computing correlations among SF-36 subscales, between subscales and the 2 component scores, and between component scores and EQ-VAS scores. Results: Most scaling assumptions were met. The hypothetical factor structure fit the data poorly (root mean square error of approximation [RMSEA]=0.108) and modification was required for a good fit (RMSEA=0.060). Scores on all subscales demonstrated acceptable internal consistency (α>0.70) and test-retest reliability (r>0.70). Divergent validity was supported by weak to moderate interscale correlations (r=0.19 to 0.64). As expected, the 2 summary scores were moderately to strongly correlated with the EQ-VAS (r>0.60). Conclusions: The findings adequately support the use of SF-36 in Indonesian middle-aged and older adults, although the optimal algorithm for computing component scores in Indonesia warrants further investigation.

뇌졸중 환자들의 한국판 Tinetti-보행 척도의 측정자간·절대적 신뢰도와 동시 타당도 (Inter-rater·absolute Reliability and Concurrent Validity of Tinetti-gait Scale (Korean version) in Stroke Patients)

  • 안승헌;이동건;이윤복;이규창
    • 대한물리의학회지
    • /
    • 제9권2호
    • /
    • pp.201-211
    • /
    • 2014
  • PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

Validity and Reliability of New Digital Navicular Drop Test Equipment in Young People

  • Park, Jin-Seong;Park, Du-Jin
    • PNF and Movement
    • /
    • 제19권2호
    • /
    • pp.279-285
    • /
    • 2021
  • Purpose: This study aimed to develop new digital navicular drop test (ND-NDT) equipment and to determine its validity and reliability. Methods: A total of 24 healthy male and female adults, who fully understood the purpose of the study and gave consent to participate in the study, were selected as participants. The NDT and ND-NDT were conducted in the dominant foot of the participants in a random order. For the NDT, the position of the navicular bone was marked with a pen first; then, the height of the navicular bone from the ground was measured in both sitting and standing positions. For the ND-NDT, after the sticker-type reflection markers were attached to the position of the navicular bone, the height of the navicular bone from the ground was measured in both sitting and standing positions. To assess the validity of the diagnostic tests, the same examiner measured the height of the medial longitudinal arch (MLA) three times in both the sitting and standing positions. To assess the inter-rater reliability of the ND-NDT, three examiners, in a random order, attached the sticker-type reflection markers to the position of the navicular bone and then measured the height of the MLA in both positions. Results: In the sitting position, the Pearson correlation coefficient (r) between the two diagnostic tests was very high (r = 0.97) and statistically significant. In the standing position, the Pearson correlation coefficient (r) between the two tests was 0.95, which was also statistically significant. The ICC2,1 values in the sitting and standing positions were 0.93 and 0.95, respectively, indicating significantly high inter-rater reliability. Conclusion: The ND-NDT equipment showed very high diagnostic validity, as well as excellent inter-rater reliability, indicating the clinical usefulness of the equipment as a diagnostic system for confirming pes planus.

한국어판 기후 건강관련 간호사 인지행동 측정도구의 타당도와 신뢰도 (Validity and Reliability of the Korean Version of the Climate, Health, and Nursing Tool)

  • 정다운;김광숙;박민경
    • 대한간호학회지
    • /
    • 제52권2호
    • /
    • pp.173-186
    • /
    • 2022
  • Purpose: Climate change has various negative effects on human health, which has resulted in increased burden on the health care system. Nurses contribute significantly to assessing climate-related health risks and creating a healthy environment. This study aimed to evaluate the reliability and validity of the Korean version of the Climate, Health, and Nursing Tool (K-CHANT) to measure nurses' awareness, motivation, concern, and behaviors at work and at home regarding climate change and health. Methods: The 22 items of English CHANT were translated into Korean with forward-backward translation techniques. Internal consistency reliability, test-retest reliability, and construct validity using confirmatory factor analysis were performed using SPSS WIN (25.0) and AMOS (26.0). Survey data were collected from 220 master's, doctoral, and post-doctoral nursing students. Results: The K-CHANT consists of 20 items across 5 domains. Two items of the original CHANT were excluded because of low content validity index and standardized regression weights. The internal consistency reliability of the K-CHANT, assessed by Cronbach's α was .81, with an intraclass correlation coefficient of .66~.90. The five subscales model was validated by confirmatory factor analysis (SRMR < .08, RMSEA < .08, AGFI > .70, CFI > .70). Conclusion: The K-CHANT has satisfactory construct validity and reliability to measure nurses' awareness, motivation, concern, and behaviors at work and at home regarding climate change and health. Future research should examine nurses' perceptions and behaviors related to the health effects of climate change and develop an action plan to improve it.

치과위생사의 경증 장애인 환자 진료 고려사항에 대한 지식 측정 도구의 타당도와 신뢰도 검증 (Testing the validity and reliability of an assessment tool for dental hygienists' consideration of patients with mild disabilities)

  • 김예지;노희진;문소정;한선영
    • 한국치위생학회지
    • /
    • 제23권1호
    • /
    • pp.55-62
    • /
    • 2023
  • Objectives: The purpose of this study was to test the reliability and validity of an assessment tool for dental hygienists' consideration of patients with mild disabilities. Methods: Thirty-seven preliminary questions were compiled through literature review, and thirty-two questions were selected through content validity testing by eight experts. Two hundred and three dental hygienists completed the assessment tool as an online survey. The construct validity, internal consistency, and test-retest reliability of the tool were investigated using the SPSS 26.0 program. The construct validity was assessed using exploratory factor analysis. The internal consistency was assessed using Cronbach's alpha. The intraclass correlation coefficient (ICC) value with 95% confidence intervals was calculated for test-retest reliability. Results: Ten items and four factors were selected through exploratory factor analysis. The internal consistency reliability of the tool was found to be Cronbach's alpha=0.658, and test-retest reliability was found to be ICC=0.812. Conclusions: An assessment tool of care for patients with mild disabilities by dental hygienists is a reliable and valid tool suitable for the job characteristics of dental hygienists. It can be used in clinical practice and research.