• Title/Summary/Keyword: Consistency in Assessment

Search Result 333, Processing Time 0.024 seconds

A validation study for the Infant/Toddler Environment Rating Scale(I) (영아/걸음마기 아동 환경 평정 척도 타당화 연구(I))

  • 현온강
    • Journal of the Korean Home Economics Association
    • /
    • v.35 no.6
    • /
    • pp.235-248
    • /
    • 1997
  • This study was aimed to validate the Infant/Toddler Environment Rating scale (ITERS). The rating scale was translated and adjusted appropriately by two researchers majoring child studies. An item-by-item comparison of the ITERS with criteria of NAEYC was conducted as the measure of content validity. 88% of the items of the ITERS was covered on the NAEYC criteria. Criterion validity was assessed by comparing ITERS scores and the Assessment Profile for early childhood Programs scores. The total correlation of two scores was .87. The sample for the inetrater reliability and internal consistency studies included 30 infant/toddler classes in 30 day care center in Inchon city. Two observers independently rated each class on the ITERS during a single visit. The Spearman's correlation coefficient for interater reliability on the overall scale was .74. For the measure of internal consistency, the Cronbach's Alpha score on the overall scale was .93. The rating results show that national/public child care centers have better quality in Adult Needs and Learning Activities subscales than private child care centers have.

  • PDF

A Computer Algorithm for the evaluation of elements in Face Stimulus Assessment (얼굴자극검사의 평가를 위한 컴퓨터 알고리즘)

  • Kim, Jong-Hoon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.11 no.6
    • /
    • pp.1961-1968
    • /
    • 2010
  • The Face Stimulus Assessment is an efficient projective drawing test developed by Betts. This paper categorizes scales which Betts suggested into the following five groups: accuracy of painting, color fit, perception of shape, precision of drawing, and space usage. In this paper, a computer algorithm which objectively evaluates these five scales is suggested. The proposed algorithm defines the areas of the lip, eyes, hair, etc. which take on significant roles in the evaluation of the FSA and based on these factors, it calculates the grade of each scale through the main color and color ratio. The consistency of evaluations between the computer algorithm and the art therapist is measured by the Quadratic Weighted Kappa. By providing objectivity and consistency, the computer algorithm is expected to solve the problem of uncertainty found in art therapists' evaluations of projective drawing tests caused by their subjective judgment, experience, and intuition.

Risk Analysis Based on Accident-Category for Railway Work Zones (철도건설현장의 사고유형기반 위험도 분석)

  • Park, Mi-Yun;Choi, Eun-Soo;Park, Joo-Nam;Choi, Seung-Sun
    • Journal of the Korean Society for Railway
    • /
    • v.12 no.2
    • /
    • pp.260-266
    • /
    • 2009
  • The theory of risk is applied frequently in analysis of railway accidents. The aim of risk analysis is to search potential causes and contribution factors of accidents by checking the total system of construction field. This paper analyze a pattern and a cause of accident occupied in construction field, calculate risk index considering accident frequency and severity, and then provide the relative risk assessment. Based on this, this paper will provide the methodology of qualitative risk assessment guiding to reach a consistency of risk index with risk assessment.

The Relationship Between Postural Control, ADL Function, Muscle Tone, and Functional Improvement in Chronic Stroke Patients (만성 뇌졸중 환자의 자세 조절과 일상생활동작, 근긴장도, 그리고 기능증진과의 관계)

  • An, Seung-Heon;Seo, Young-Jong;Park, Chang-Sik
    • Physical Therapy Korea
    • /
    • v.14 no.1
    • /
    • pp.64-73
    • /
    • 2007
  • The purpose of this study was to find any correlations among Postural Assessment Scale for Stroke (PASS), Modified Barthel Index (MBI), Tone Assessment Scale (TAS), Motor Assessment Scale-Gait (MAS-G), Fugl Meyer-Balance (FM-B), and to predict MBI from subscales of the PASS. The subjects were 41 stroke patients of the Korea National Rehabilitation Center in Seoul. The main outcome measures were postural control (PASS), gait (MAS-G), Balance (FM-B), Tone (TAS), ADL (MBI). The data was analyzed using the Pearson product correlation. PASS scale was used between other clinical and instrumental indexes, multiple stepwise regression analyses were performed to identify prognostic factors for ADL incline, and Cronbach's alpha coefficient was used to identify internal consistency on PASS scale. The results of this study areas follows: 1. The highest level was sitting without support, the lowest level was standing on paretic leg on PASS scale. The highest level was chair/bed transfer, the lowest level was bathing on MBI. 2. All items of the PASS, except postural tone were significantly correlated with Gait, Balance, MBI (p<.01), 3. The Internal Consistency (Cronbach's alpha coefficient=.85) was very high, indicating that the PASS is homogeneous and is likely to produce consistent response. Furthermore, the sums of maintaining position items and of changing-position items were strongly correlated (r=.64, p<.05) and there were significant correlations between sums of PASS, sums of maintaining position items (r=.87, p<.01), and changing-position items (r=.93, p<.01). 4. The standing without support of the PASS items was the strongest variance ($R^2$=.85) of the predicting ADL function. These findings provide strong evidence of the predictive value of the postural control on gait, Balance, ADL function in stroke patients and to can provide a reference for the successful therapeutic program and more improved functional recovery.

  • PDF

Reliability and Validity of the Postural Assessment Scale for Stroke in Chronic Stroke Patients (만성뇌졸중 환자의 Postural Assessment Scale for Stroke의 신뢰도와 타당도)

  • An, Seung-Heon;Lee, Je-Hoon
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.1
    • /
    • pp.9-17
    • /
    • 2009
  • Purpose: The purpose of this study was to determine reliability and validity of the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Methods: A total of 43 stroke patients, who had a stroke more than 6 months previously, participated in the study. Reliability was determined by the intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method and Cronbach's alpha by internal consistency. Validity was examined by correlation the PASS scores to the Berg Balance Scale (BBS), Trunk Control Test (TCT), and Fugl-Meyer Balance (FM-B) score. Results: The intra-rater reliability and the Absolute reliability of the PASS was good ICC$_{3,1}$=0.97 (95%CI 0.95$\sim$0.99) and excellent SEM=1.01 respectively. Cronbach's alpha value for PASS was found to be 0.94. There were significant correlations between the PASS and BBS, TCT, FM-B (r=0.65-0.96, p<0.01). Conclusion: The PASS provide reliable and valid instrument of the postural control assessment for chronic stroke patients.

  • PDF

Development and Application of a Nursing Assessment Tool for Senior Center Nurses (노인복지관 간호사를 위한 간호사정조사도구 개발 및 적용)

  • Ko, Ha Na;Song, Misoon
    • Perspectives in Nursing Science
    • /
    • v.13 no.2
    • /
    • pp.96-109
    • /
    • 2016
  • Purpose: The purposes of this study were to develop a nursing assessment tool for senior center nurses, and to test its feasibility and content validity. Methods: The study utilized a psychometric test design. Preliminary items were developed based on geriatric health needs and Gordon's 11 domains of functioning health. Initially, the tool was evaluated for content validity and feasibility. Then, it was administered among 195 older adults in a senior center by a gerontological nurse practitioner. Data were analyzed to describe the nursing problems of the senior center older adults. Results: The final version of the nursing assessment tool consisted of 27 items. The internal consistency, measured with the Cronbach's ${\alpha}$, was .74. The result of the assessment showed that senior center older adults had high nursing needs in the area of management of chronic diseases (hypertension, diabetes, and lipids), dental care, community relations, safety, elder abuse, health behaviors (such as drinking), mental health (depression, suicide, and cognitive function), and health consultations. Conclusion: The new tool was feasible for use with senior center participants, and it was evaluated as having high content validity by senior center nurses.

Development of the Self-Care Non-adherence Risk Assessment Scale for Patients with Chronic Illness (만성질환자의 자가간호 불이행 위험 사정도구 개발)

  • Jo, Mirae;Oh, Heeyoung
    • Research in Community and Public Health Nursing
    • /
    • v.32 no.4
    • /
    • pp.415-429
    • /
    • 2021
  • Purpose: The purpose of this study was to develop the Self-Care Non-adherence Risk Assessment Scale (SCNRAS) for patients with chronic illness in South Korea. Methods: This study was conducted from April to July, 2020 and utilized a convenience sampling method to recruit 336 patients with chronic illness from three hospitals located in South Korea. The content, factorial structure, item-convergent/discriminant validity, convergent validity, internal consistency reliability, and test-retest reliability of the scale were evaluated. The data were analyzed using exploratory and confirmatory factor analyses, Pearson's correlation coefficient, Cronbach's α, and intra-class correlation coefficient. Results: The exploratory and confirmatory factor analyses yielded six-factors. Convergent validity was demonstrated using measures of defining issues. Internal consistency reliability and test-retest reliability were found to be acceptable, as indicated by a Cronbach's α of .65~.81 and an intra-class correlation coefficient of .93~.98. The Self-Care Non-adherence Risk Assessment Scale for patients with chronic illness is a new instrument that comprehensively measures the knowledge, skill, physical function status, access to health care, social support, motivation, and confidence. It comprises 18 items scored on a 5-point Likert scale. The validity and reliability of the scale were verified. Conclusion: The scale developed through this study is expected to screen those who need nursing intervention early by predicting the self-care non-adherence risk group.

A Study on Performance Assessment Methods Using Fuzzy Logic

  • Chae, Gyoo-Yong;Jang, Gil-Sang;Joo, Jae-Hun
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.9 no.1
    • /
    • pp.92-102
    • /
    • 2004
  • Performance assessment was introduced to improve self-directed learning and method of assessment for differenced learning when the seventh educational curriculum was enforced. Written examinations often fail to properly assess students higher thinking abilities ad problem solving abilities. Performance assessment addresses this drawback and also allows normalization of class and school quality. However, performance assessment also has drawbacks that could lead to faulty assessment due to lack of fairness, reliability and validity of grading, ambiguity of grading standard etc. This study proposes a fuzzy performance assessment system to address the drawbacks of the conventional performance assessment. This paper presents in objective and reliable performance assesment method through fuzzy reasoning, design of fuzzy membership function. We define a fuzzy rule analyzing factor that influences in each sacred ground of performance assessment and accounts for the principle subject The proposed performance assessment method divides into three categories, namely, formation estimation subject estimation and design of membership function. Performance assessment result that is worked through fuzzy performance assessment system can reduce the burden of appraisal's fault and provide. We fair and reliable assessment results through grading that have correct standard mid consistency to students.

  • PDF

A Study on the Reliability Assessment of Sasang Constitution Questionnaire Developed by KIOM for Japanese (일본인 대상자를 통해 살펴본 KIOM 체질 설문지의 신뢰도 평가)

  • Yoo, Jong-Hyang;Jang, Eun-Su;Kim, Yun-Yung;Park, Ki-Hyun;Lee, Si-Woo
    • Journal of Sasang Constitutional Medicine
    • /
    • v.24 no.2
    • /
    • pp.8-18
    • /
    • 2012
  • 1. Objectives : This study aimed to assessing the reliability of questionnaire for Japanese as one of method to diagnose Sasang Constitution and evaluating the possibility of applying domestic questionnaire to foreign site. 2. Methods : A cross-sectional survey approved by IRB (Independent Review Board) at Tohoku University was performed for 119 participants with informed consent at a particular city in Japan using self-reported questionnaires developed by KIOM (Korea Institute of Oriental Medicine). Among the entire samples, 112 were retested. The test-retest reliability was assessed by Kappa for normal variables and internal consistency was evaluated by Cronbach's alpha. 3. Results : Four of 77 questions are impossible to calculate consistency owing to unsymmetric matrix between primary reply and secondary one. Seventeen of them (22%) showed 0.4 or below in Kappa, 56 were ranged from 0.4 to 0.8 and no question marked 0.8 or over. Internal consistency was possibly checked for several questions about character, digestion, sweat, excrement, urine, cold-heat pattern. Cronbach's alpha for questions except urine and cold-heat pattern was over 0.6 4. Conclusions : On the basis of Kappa value by two self reported questionnaire, 72.7% of questions showed 0.4 or over so that reliability were highly secured. And other questions except for urine and heat-cold pattern marked 0.6 or over in order that internal consistency was also successfully maintained. Accordingly, when subsequently applying KIOM questionnaire to foreign site, domestic questionnaire should be properly adjusted in social and cultural background, lifestyle, etc.

The Reliability and Validity of the Korean Version of the Cornell Assessment of Pediatric Delirium (한국어판 Cornell Assessment of Pediatric Delirium 소아 섬망 사정 도구의 검증)

  • Nam, Song Yi;Park, Ki Young;Choi, Su Jung
    • Journal of Korean Clinical Nursing Research
    • /
    • v.26 no.2
    • /
    • pp.254-264
    • /
    • 2020
  • Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.