• Title/Summary/Keyword: Validity Evaluation

Search Result 1,877, Processing Time 0.049 seconds

Generalized Analysis on Validity of Sasang Type Diagnosis (사상체질 진단검사 타당성 분석지표의 일반화 연구)

  • Hwang, Sang-Moon;Park, So-Jung;Gang, Ki-Rim;Kwon, Young-Kyu;Chae, Han
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.23 no.5
    • /
    • pp.950-957
    • /
    • 2009
  • The purpose of this study was to develop generalized validity evaluation indexes for the Sasang type diagnostic test. As a generalized evaluation index for Sasang type diagnostic test, Generalized Squared Correlation (GC2), Mutual Information (I) and Mutual Information Coefficient (IC) as overall validity index, and Correlation Coefficient (C) and Mutual Information Contribution (ID) as type-specific validity index were suggested and the practicability of these indexes was assessed along with Percentage Correctly Predicted (PCP), adjusted PCP, type-specific sensitivity and type-specific specificity which was proposed previously. The usefulness of the nine validity indexes was examined using previously reported data and three mock Sasang type diagnosis results. We demonstrated here that the PCP is not adequate for the analysis of validity. We also showed that our validity index is recommendable for the comparison and improvement of Sasang type diagnosis. The generalized validity analysis of Sasang type diagnosis can provide a guideline for the development of new Sasang type diagnosis or pattern identification. The working sheet for calculating validity indexes can be acquired at http://www.sasangtypology.org/validity.

Development and Psychometric Evaluation of the Transcultural Self-efficacy Scale for Nurses (간호사의 범문화효능감 측정도구 개발 및 타당화)

  • Oh, Won-Oak;Park, Eun Sook;Suk, Min Hyun;Im, Yeo Jin
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.2
    • /
    • pp.293-304
    • /
    • 2016
  • Purpose: This methodological study was conducted to develop and psychometrically test the Transcultural Self-efficacy scale (TCSE-scale) for nurses. Methods: Initial 41 items for the TCSE-scale were generated based on extensive literature reviews and in-depth interviews with 18 nurses who had experience in caring for foreign patients. Cultural Competence and Confidence model was used as a conceptual framework. Content validity was evaluated by an expert panel. Psychometric testing was performed with a convenience sample of 242 nurses recruited from four general hospitals in the Seoul metropolitan area and Gyeonggi-do province of South Korea. To evaluate the reliability of TCSE-scale, a test-retest reliability and an internal consistency reliability were analyzed. Construct validity, concurrent validity, criterion validity, convergent validity and discriminative validity were used to evaluate the validity. Results: The 25-item TCSE-scale was found to have three subscales-Cognitive, Practical, and Affective domain-explaining 91.5% of the total variance. TCSE-scale also demonstrated a concurrent validity with the Cultural Competence Scale. Criterion-related validity was supported by known-group comparison. Reliability analysis showed an acceptable-to-high Cronbach's alpha-.88 in total, and subscales ranged from .76 to .87. The ICC was .90, indicating that the TCSE-scale has internal consistency and stability of reliability. Conclusion: This preliminary evaluation of the psychometric scale properties demonstrated an acceptable validity and reliability. The TCSE-scale is able to contribute to building up empirical and evidence based on data collection regarding the transcultural self-efficacy of clinical nurses. We suggest further testing of the applicability of TCSE-scale in different settings and community contexts.

Development and Validation of a Scale for the Measurement of Early Childhood Teacher's Competence in Unification Education (유아교사의 통일교육역량에 대한 평가척도 개발 및 타당화 연구)

  • Jung, Dae Hyun;Kwak, Youn Mi
    • Korean Journal of Human Ecology
    • /
    • v.21 no.5
    • /
    • pp.819-835
    • /
    • 2012
  • The purpose of this study was to develop and test the validity of an assessment scale for determining the competency of early childhood teachers practicing unification education. For this purpose, an evaluation scale was constructed and then tested for reliability and validity. Participants for this study included 266 early childhood teachers in the unification education field. In order to the measure reliability and validity of this scale, Exploratory Factor Analysis and Confirmatory Factor Analysis were conducted with SPSS 18.0 and AMOS. The result of this study identified four principal factors: 1) Instruction skills, 2) Evaluation, 3) Attitude, and 4) Knowledge. The results of this study supported the scale's reliability and legitimacy as a valid instrument for the evaluation of early childhood teacher's competence in unification education.

Validity of Seismic Performance Evaluation Using Static Analysis (정적해석을 이용한 내진성능평가의 타당성)

  • 원학재;한상환;이리형
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2001.04a
    • /
    • pp.475-480
    • /
    • 2001
  • The purpose of this study is to evaluate the validity of seismic performance evaluation using static analysis. For this purpose, Ordinary Moment Resisting Steel Frames(OMRSF) for different heights(3, 6 ,9, 12 story) and seismic zones(Zone 2A, 2B, 3, 4) were designed in compliance to AISC LRFD 1993 Seismic Provisions and NEHRP 1994 Guidelines. Nonlinear Static Procedure(NSP) and Nonlinear Dynamic Procedure(NDP) with a set of ground motion record were used to evaluate seismic demands in OMRSFs. Using the DRAIN-2DX program, this study compares peak displacement demands(Target Displacement) proposed by FEMA 273 with the peak roof displacement demands obtained from the inelastic time history analyses. Based on the results, the validity of procedure of seismic demand evaluation using Target Displacement is discussed.

  • PDF

The Development of a Client Health Status Outcome Evaluation Instrument in Home Care (가정간호대상자의 건강상태 결과 평가도구 개발)

  • 박현태
    • Journal of Korean Academy of Nursing
    • /
    • v.34 no.3
    • /
    • pp.552-564
    • /
    • 2004
  • Purpose: This study was to develop a client health status outcome evaluation instrument, and examine content validity, reliability, construct validity, and the acceptability of this instrument. Method: A preliminary list was made of such key information as standards, criteria, indicators and measures, by means of a broad review of literature within the field. After determining the preliminary instruments, the study sought to obtain examination, consensus, and modification of two groups of experts in the home-care field. Finally, the instrument examined content validity, reliability, construct validity, and the acceptability of this instrument. Result: The tool was considered of 13 criteria, 48 indicators, and 167 detail measures. The content validity index of the tool was above 0.8 according to the expert group. Regarding the reliability of the evaluators of standards 1 and 2, the degree of agreement between evaluators was high(96.4% through 98.2%). Construct validity in this study, the difference in the mean score between the baseline point and the follow up point of each of standards 1 and 2 was significant, and the mean score of the follow up point was more than that of the baseline point. After examining the acceptability of this instrument with practice managers and home care nurses in home care institutions, a positive opinion was given of this instrument, and it was indicated that to be useful and applicable in home care practice. Conclusion: The results of evaluating client outcome will contribute to overall outcome-based quality improvement and service marketing in home care by providing a constant gauge of home care effectiveness.

The Reliability and Validity of the Lasater Clinical Judgement Rubric in Korean Nursing Students (임상판단 평가도구의 신뢰도 및 타당도 검증)

  • Shim, Kaka;Shin, Hyunsook
    • Child Health Nursing Research
    • /
    • v.21 no.2
    • /
    • pp.160-167
    • /
    • 2015
  • Purpose: This study was done to evaluate the Lasater Clinical Judgement Rubric for use with Korean nursing students. Methods: A methodological study was used to validate the rubric developed by Lasater to assess clinical judgment during nursing simulation. Participants were 34 nursing students at K University in Seoul. Between February and May, 2012, analysis was done of 91 video clips recording performance during simulation. Results: Findings showed reliability and validity of the rubric. For internal consistency, Cronbach's ${\alpha}$ score was .884 and intraclass correlation coefficient was .839, which established reliability. The rubric was validated using the exploratory factor analysis and content validity. The content validity score was 83%, establishing the appropriateness and readiness of the tool. Factor analysis showed that noticing, responding, and reflecting domains had Eigen values of 2.669, 1.991, and 2.912, respectively and were bound, but unlike the original tool in which four factors noticing, interpretation, responding, and reflecting domains were bound. Conclusion: Results of the study indicate that the rubric shows acceptable reliability and validity in Korean nursing students. This evaluation tool for nursing simulation allows nursing faculty to objectively evaluate students' clinical judgment as well as students to reflect on their clinical judgment process during simulation.

A Study on the Statistical Model Validation using Response-adaptive Experimental Design (반응적응 시험설계법을 이용하는 통계적 해석모델 검증 기법 연구)

  • Jung, Byung Chang;Huh, Young-Chul;Moon, Seok-Jun;Kim, Young Joong
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2014.10a
    • /
    • pp.347-349
    • /
    • 2014
  • Model verification and validation (V&V) is a current research topic to build computational models with high predictive capability by addressing the general concepts, processes and statistical techniques. The hypothesis test for validity check is one of the model validation techniques and gives a guideline to evaluate the validity of a computational model when limited experimental data only exist due to restricted test resources (e.g., time and budget). The hypothesis test for validity check mainly employ Type I error, the risk of rejecting the valid computational model, for the validity evaluation since quantification of Type II error is not feasible for model validation. However, Type II error, the risk of accepting invalid computational model, should be importantly considered for an engineered products having high risk on predicted results. This paper proposes a technique named as the response-adaptive experimental design to reduce Type II error by adaptively designing experimental conditions for the validation experiment. A tire tread block problem and a numerical example are employed to show the effectiveness of the response-adaptive experimental design for the validity evaluation.

  • PDF

Development and Validation of the Nurse Needs Satisfaction Scale Based on Maslow's Hierarchy of Needs Theory (Maslow의 욕구위계이론에 근거한 간호사 욕구만족도 측정도구 개발 및 타당화)

  • Kim, Hwa Jin;Shin, Sun Hwa
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.6
    • /
    • pp.848-862
    • /
    • 2020
  • Purpose: The purpose of this study was to develop an instrument to evaluate the needs satisfaction of nurses and examine its validity and reliability. Methods: The initial items for the instrument were developed through a literature review and interviews, using the conceptual framework of Maslow's hierarchy of needs theory. The initial items were evaluated for content validity by 14 experts. Four hundred and eighty-six clinical nurses participated in this study through offline and online surveys to test the reliability and validity of the instrument. The first evaluation (n = 256) was used for item analysis and exploratory factor analysis, and the second evaluation (n = 230) was used to conduct a confirmatory factor analysis and to assess the criterion-related validity and internal consistency of the instrument. Test-retest reliability was analyzed using data from 30 nurses. Results: The final instrument consisted of 30 items with two sub-factors for five needs that were identified through the confirmatory factor analysis. The criterion-related validity was established using the five need satisfaction measures (r = .56). Cronbach's α for total items was .90, and test-retest reliability was .89. Conclusion: The findings from this study indicate that this instrument has sufficient validity and reliability. This instrument can be used for the development of nursing interventions to improve the needs satisfaction of clinical nurses.

Development of Clinical Evaluation Tool for Nursing Student (임상 간호실습교육 평가도구 개발)

  • Lee, Kun-Ja;Chang, Chun-Ja;Hong, Sung-Sun
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.7 no.3
    • /
    • pp.473-485
    • /
    • 2001
  • This study is intended to develop a reliable and appropriate instrument of the clinical nursing education. This research consisted of 4 steps. First step is construction of the content validity by 1 Korean literature professor and 1 teaching professor in Ga Chon Gil College, the pilot study for the content validity by 14 professors and survey with four points Likert Scale, which includes from the point 'strongly valid' to the point of 'strongly non-valid', by 113 head nurses who guide and evaluate the students in clinical practice. The third step is the test of validity and reliability of the preliminary evaluation tool. The fourth step is the test of validity and reliability of the developmental evaluation tool. The data were collected from Sep. 10th, 2001 to Sep. 28th, 2001. This study was analyzed by SPSS PC+ for descriptive statistics, factor analysis and Cronbach's Co-efficient Alpha of the collected data. The results of these analysis are like as follows. 1. Evaluation tool of Clinical practice consists of 16 items including four categories : factor 1 was labeled 'desirable attitude'(5 items), factor 2 was labeled 'correctly judgement and nursing problem solving'(4 items), factor 3 was labeled 'adaptive ability of nursing knowledge and skill'(4 items), factor 4 was labeled 'desirable human relationship'(3 items) and these contributed 71.992% of the variance in the total score. 2. Cronbach's Co-efficient Alpha for internal consistency was .9128 for the total 16 items. For further research, it need to develop a variable and reliable instrument of the student self-evaluation and instrument that based on community.

  • PDF

A Translation and Construct Validity Study of the Evaluation in Ayres Sensory Integration® (EASI) (Evaluation in Ayres Sensory Integration® (EASI)의 번역 및 구성타당도 연구)

  • Kim, Kyeong-Mi;Lee, Ji-Hyun;Jung, Hyerim;Choi, Jeong-Sil;Hong, Eunkyoung
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.19 no.1
    • /
    • pp.24-38
    • /
    • 2021
  • Objective : This study aimed to create a Korea translation of the Evaluation in Ayres Sensory Integration (EASI) and to then test the adapted version for construct validity. Methods : The translation and content validation process were conducted in accordance with a four-step process, namely translation, integration, content validity examination, and backward translation. The construct validity of the translated version was evaluated using the EASI for children aged 3~12 years with and without sensory integration problems, comparing the two groups as well as preschool and school-aged groups. The group comparison was analyzed using the Mann-Whitney U test in SPSS. Results : In terms of content validity, all 20 items averaged more than 3.17 points. Of the four EASI categories, there was a difference in Sensory Perception (p=0.044) between the typical and sensory integration groups, and there was a statistical difference between tactile and vestibular sensations. Between the preschool and school-aged children, statistical difference was observed in two categories, namely Praxis and Ocular-Postural-Bilateral Motor Integration. Conclusion : Based on its construct validity, the Korean version of EASI is suitable for use in research. The construct validity study highlighted items that explain differences between typical and diagnostic children and items that explain those differences by age. Our findings could therefore be considered when interpreting EASI results.