• Title/Summary/Keyword: Validity test

Search Result 3,244, Processing Time 0.029 seconds

A Study of Reliability and Validity of the Learning Satisfaction and Learning Flow Scale in Korean Medical Ophthalmology & Otolaryngology and Dermatology (안이비인후과목, 피부외과목의 전공만족 및 전공 몰입경험 척도의 신뢰도와 타당도 연구)

  • Kim, Chul-Yun;Kim, Nam-Kwen;Kwon, Kang;Seo, Hyung-Sik
    • The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
    • /
    • v.28 no.2
    • /
    • pp.54-65
    • /
    • 2015
  • Objective : This Study was conducted in order to develop the Learning Satisfaction (LS)and Learning Flow Scale(LFS) for Korean Medical Ophthalmology & Otolaryngology & Dermatology and to investigate the reliability and validity. Methods : LF and LFS were administered to 44 students and 20 resident physicians . We examined the test-retest reliability, internal consistency and perfomed factor analysis. Result : 1. Test-retest reliability were reliable on LS and LFS for Korean Medical Ophathalmology & Otolaryngology.2. Test-retest reliability were unreliable comparatively on LS and LFS for Korean Medical Dermatology.3. internal consistency were all reliable in LS and LFS Korean Medical Ophthalmology & Otolaryngology & Dermatology.4. factor analysis were reliable only LS of Korean Medical Dermatology. Conclusions : LS and LFS has reliability to measure learning satisfaction and learning flow of Korean Medical students. But there is no evidence about validity of LS and LFS for Korean Medical Ophthalmology & Otolaryngology & Dermatology.

Reliability and Validity of Korean Geriatric Anxiety Inventory(K-GAI) (한국판 노인불안도구(K-GAI)의 신뢰도와 타당도)

  • Kim, Jiyun;Park, Myung Sook;Oh, Doo Nam
    • Journal of muscle and joint health
    • /
    • v.21 no.1
    • /
    • pp.75-84
    • /
    • 2014
  • Purpose: The purpose of this study was to test the validity and reliability of the Korean version of the Geriatric Anxiety Inventory (K-GAI). Methods: Two hundreds and thirty six elderly were participated to test K-GAI. Goldberg's short screening scale for anxiety was tested for criterion validity. Receiver operating characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: The obtained internal consistency was 0.88. There were significant associations between test and retest results. K-GAI scores was significantly associated with Goldberg's short screening scale for anxiety (r=.694, p<.001). We found that a score of seven and greater was optimal for a criterion of anxiety among elderly Koreans. At this cut point, sensitivity was 78.9% and specificity was 73.1%. Conclusion: The K-GAI displayed good psychometric properties. This tool would be useful for early detection of anxiety among elderly Koreans with various situations including cognitive disorder, low education, or physical disability.

Validity & Reliability Test of a Life Respect Instrument for Korean Elementary School Students (초등학생 대상 생명존중 인식 측정도구의 타당도 및 신뢰도 검증)

  • Kang, Kyung-Ah;Kim, Shin-Jeong;Song, Mi-Kyung;An, Jin-Young
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.17 no.1
    • /
    • pp.120-128
    • /
    • 2011
  • Purpose: The purpose of this study was to test the validity and reliability of a life respect instrument for elementary school students. Method: The study was conducted as follows: identification of the tentative content domains, items generation, test of content validity, and data collecting with a preliminary questionnaire. Descriptive statistics, factor analysis, Cronbach's alpha, Guttman split-half, and Pearson correlation coefficients were used to analyze the data. Results: Two factors were extracted through factor analysis: 'Value about life respect', and 'Attitude about life respect.' These factors explained 58.82% of all factors. A total of 16 items belonging to 2 domains were generated. Cronbach's alpha and Guttman split-half coefficient were .82, and .84 respectively. Conclusion: The life respect instrument modified in this study will be useful for evaluating the effect of life respect education for elementary school students.

The Evaluation of Reliability and Validity for Mibyeong Questionnaire (증상 정도, 기간, 불편정도 및 회복력 기반 미병 설문지의 신뢰도 및 구성 타당도 평가)

  • Jang, Eunsu;Yoon, Ji-Hyeon;Lee, Youngseop
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.21 no.1
    • /
    • pp.13-25
    • /
    • 2017
  • Objectives The purpose of this study was to evaluate the reliability and the validity of Mibyeong Questionnaire (MQ). The subjects enrolled in this study was 165 from July 2015 to Jan. 2016. The surveys were conducted twice with 3 month terms. Methods The Cronbach's ${\alpha}$ analysis for internal reliability, Pearson Correlation Coefficient analysis for test-retest reliability, Factor analysis with varimax rotation for construct validity, Kappa analysis for diagnostic reliability were used. The significant p-value was less than 0.05. Results and Conclusions The result showed that the Cronbach's ${\alpha}$ of MQ was .857-.937 and total was .913. The reliabilities between test and retest for the MQ were .666-.832 (0.416-0.673, in case of including recovery question) in intraclass correlation coefficient (ICC). The Kappa of recovery question in each item was ranged 0.23(80.6% in agreement rate) to .46(87.9% in agreement rate). In test-retest the Kappa value of Mibyeong diagnosis referred by median value was .418(71% in agreement rate). This study revealed that MQ is a reliable and valid questionnaire.

Development of a Mother-Preschool Child Interaction Scale (학령전기 아동과 어머니의 상호작용 측정도구 개발)

  • Park, Sung-Hee;Bang, Kyung-Sook
    • Journal of Korean Academy of Nursing
    • /
    • v.43 no.1
    • /
    • pp.59-68
    • /
    • 2013
  • Purpose: This study was done to develop the self-report Mother-Preschool Child Interaction Scale (MPIS) for mothers of preschool children. Methods: The scale was based on items derived from literature review and in-depth interviews. A methodological study was used to check reliability and validity and participants were 334 mothers of preschool children enrolled in kindergarten or nursery. Data were analyzed using principal component factor analysis for construct validity, t-test for contrasted group validity, Pearson correlation for criterion related validity and test-retest reliability and Cronbach's ${\alpha}$ for reliability. Results: In the final MPIS 34 items identified through factor analysis were included, 6 constructs were derived, and explanatory power was 64.2%. Items on the MPIS were verified through correlation with the interaction observation scale of Kim & Mahoney and MPIS. Results were significant as mothers in the normal group exhibited MPIS scores that were significantly higher than those of mothers in the depressed group. Reliability of MPIS was .96 and test-retest reliability was .92. Conclusion: MPIS has the advantage of being easy to use, economical, and useful. Consequently, it is expected to be used as a screening tool for promptly and simply identifying the mother-preschool child interaction in diverse nursing practice and research.

Development of Formative Constructs and Measurements for Performance Evaluation of Information Systems (정보시스템 성과평가를 위한 형성적 구성변수(Constructs) 및 측정지표 개발)

  • Kim, Sanghoon;Kim, Changkyu
    • Journal of Information Technology Services
    • /
    • v.11 no.4
    • /
    • pp.135-151
    • /
    • 2012
  • Traditionally in IS studies, the relationship between construct and its measurement items tends to be assumed to be reflective, meaning that the measurements are a reflection of the construct. In reality, however, the nature of the construct can be often formative, which means that its measurement items describe and define the construct rather than vice versa. The purpose of this study was to investigate theoretical and empirically-analysed differences between formative construct and reflective construct through comprehensive interdisciplinary literature review. And then on the basis of these differences, we intended to derive the rule of specifying whether the construct is formative or reflective and propose the methodology of testing the validity(content validity, construct validity, internal consistency and external construct) of formative construct and its measurements, differentiated from that in the case of reflective construct. Also, we suggested the concrete statistical testing methods such as VTT(Vanishing Tetrad Test), MIMIC(Multiple Indicators and Multiple Causes) test and multi-collinearity test. In order to examine the applicability of this methodology to developing the constructs for performance evaluation of IS(Information Systems), we tried to identify its attribute(formative or reflective) and test the validity for the construct arbitrarily chosen among them which had been derived in our previous IS performance evaluation study by using this methodology. The result of the examination was that the methodology proposed in this study was significantly valid and effective in the area of IS performance evaluation.

Reliability and Concurrent Validity of Korean Version of the Trunk Control Measurement Scale (K-TCMS) for Children with Cerebral Palsy

  • Ko, Jooyeon;Jung, Jeewoon
    • The Journal of Korean Physical Therapy
    • /
    • v.29 no.1
    • /
    • pp.16-26
    • /
    • 2017
  • Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.

Development of a Questionnaire for Dietary Habit Survey of Korean Adults (델파이 기법에 의한 한국 성인의 식습관 조사용 설문지 개발)

  • Jo, Jin Suk;Kim, Ki Nam
    • Korean Journal of Community Nutrition
    • /
    • v.19 no.3
    • /
    • pp.258-273
    • /
    • 2014
  • Objectives: The purposes of the study were to develop a questionnaire for dietary habit survey for Korean adults, and unify the terms related to dietary habits. Methods: The Delphi method by 43 professionals on dietary habit research was applied to unify the terms. Results: With regard to results on terms related to dietary habit, the respondents recorded the highest percentage (90.7%) of selecting the term "dietary habits" and also the highest percentage (76.7%) of choosing "dietary habits" for English. The biggest percentage of the respondents chose "individual dietary behaviors repeatedly formed and habitualized under the social, cultural, and psychological influence in the group" as the concept of dietary habits. The Delphi survey for the development of a questionnaire resulted in the first questionnaire of 31 items, the second one of 27 items, and the third one of 25 items. The validity of questionnaire items was tested with content validity ratios (CVR). The items whose CVR value was 0.29 or lower were eliminated or revised, because the minimum CVR value needed to test validity was 0.29. To test the reliability of questionnaire items, test-retest method was performed in 163 adults. According to the Kappa coefficient in the range of 0.314-0.716, all of the 25 items were in the reliability scope. A survey was taken with 702 adults to finally revise and supplement the third questionnaire whose validity and reliability were tested. Conclusions: Through those processes, a questionnaire for adults' dietary habit survey was finally completed. The significance of the study lies in the development of the first questionnaire on dietary habits equipped with both validity and reliability in South Korea.

Multifaceted validity analysis of clinical skills test in the educational field setting (교육 현장에서 시행된 임상 술기 시험의 다면적 타당도 분석)

  • Han Chae;Min-jung Lee;Myung-Ho Kim;Kyuseok Kim;Eunbyul Cho
    • The Journal of Korean Medicine
    • /
    • v.45 no.1
    • /
    • pp.1-16
    • /
    • 2024
  • Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

Development of Measurement Scale for Clothing Shopping Orientation (Part I) (의복 쇼핑 성향의 측정 도구 개발 (제1보))

  • 김세희;이은영
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.28 no.910
    • /
    • pp.1253-1264
    • /
    • 2004
  • The purpose of this study is to develop clothing shopping orientation[CSO] scale reflecting the conceptual structure of CSO. For this purpose, a questionnaire composed of comprehensive 85 CSO items was developed through 2-step preliminary tests. Data was collected from two samples. One sample(n=559) was for scale development and the other sample(n=235) was for cross validity test. Descriptive analysis, correlation analysis, exploratory factor analysis, regression analysis, ANOVA, and confirmatory factor analysis were used for data analysis. For each lower-dimension within the CSO conceptual structure model, 1-2 items were selected based on the quantitative and the qualitative standards. As a result, a CSO scale composed of 31 items was developed, and reliability, construct validity, cross validity, convergent validity, discriminant validity, and criterion validity of the scale were verified. This study has significance in offering the standardized scale to both the academic and the practical fields.