• Journal of Korean Dental Hygiene Science
• /
• v.4 no.1
• /
• pp.53-64
• /
• 2021

Background: The elderly in long-term care facilities tend to have a diminished oral health status, with a high prevalence of dental caries and periodontal disease, as reduced cognitive function, joint mobility, and gait ability hinder the performance of oral hygiene. To improve the oral health of the elderly at long-term care facilities, it is necessary to have precise guidelines for oral health care and assessment; however, such guidelines are not readily available. Therefore, the present study aimed to develop an oral care assessment tool with verified reliability and validity. Methods: The participants in this study were 100 elderly patients at a care facilities and 10 clinical dental hygienists. Collected data were analyzed using the descriptive statistics, content validity index, and inter-rater reliability, as well as the analyses of intra-class correlation coefficient. Results: After a review of relevant literature, a preliminary questionnaire comprised of seven questions related to the evaluation of oral health was formed. After revising and supplementing the questions through a content validity test, a total of nine questions were selected. Conclusion: The novel assessment tool developed for the present study is anticipated to allow analyses of the level of problems related to oral health care before routine and professional care. Moreover, regular oral health status check-ups will enable the early diagnosis and treatment of diseases.

• International Journal of Contents
• /
• v.15 no.4
• /
• pp.97-106
• /
• 2019

EMI (English as a Medium of Instruction) classes are now accepted policy at Korean universities, yet students often struggle with required academic English writings. The present study examined an EMI class that used direct instruction and access to online assistive English writing software. From preliminary analysis, 26 students expressed interest in how an EMI academic writing class could facilitate improved English writing skills. Study participants completed a survey on self-efficacy and learning needs and assignments for an EMI academic writing class. To establish inter-rater reliability, three trained raters assessed the written essays of students prior to and after instructional intervention. Fleiss' Kappas statistics showed moderate reliability. Students' opinions on the use of online software were also analysed. Paired t-test was run on the quality of students' pre- and post-instruction assignments, and there was significant difference in the rated scores. Self-efficacy was found to have moderate positive association with improved post-essay writing scores.

• Journal of the Korean Society of Physical Medicine
• /
• v.5 no.1
• /
• pp.89-99
• /
• 2010

Purpose : This study were to examine the test-retest and inter-rater reliability as well as the concurrent validity, and convergent validity of the 2 simplified Postural Assessment Scale for Stroke:5itmes-3Level(PASS:5i-3L) & Berg Balance Scale:7items

• English Language & Literature Teaching
• /
• v.15 no.2
• /
• pp.169-184
• /
• 2009

The purpose of this study is to identify the most important factor(s) that contribute(s) to the overall oral proficiency and to examine whether the factor(s) play(s) a different role depending on the proficiency level of learners. Learners were divided into novice group and advanced group and were asked to produce an oral recording of a story based on a comic strip. The recordings were transcribed and graded by three raters. According to the results, the raters attained high inter-rater reliability when assessing advanced learners. However, the reliability level became considerably lower in the assessment of novice learners. The best predictor of oral proficiency among novice learners was sociolinguistic competence and fluency, while grammatical competence and fluency were the strongest predictors for advanced learners. The results suggest the need for a separate assessment tool for different proficiency levels and the need for a different focus in the classroom depending on the learners' proficiency level.

• The Journal of the Korean dental association
• /
• v.57 no.8
• /
• pp.448-455
• /
• 2019

This study aims to apply the Generalizability Theory (G-theory) for estimation of reliability of evaluation scores between raters on Patient Dentist Interaction. Selecting a number of raters as multiple error sources, this study was analyzed the error sources caused by relative magnitude of error variances of interaction between the factors and proceeded with D-study based on the results of G-study for optimal determination of measurement condition. The estimated outcomes of variance component for accuracy among the Patient Dentist Interaction evaluation with G-theory showed that impact of error was the biggest influence factor in students. The second influence was the item effect, and the rater effect was relatively small. The Generalizability coefficients for case1 and case2 which were estimated through the D- study were calculated relatively low.

• Journal of The Korean Association For Science Education
• /
• v.30 no.2
• /
• pp.275-290
• /
• 2010

In this study, reliabilities of holistic scoring method and analytic scoring method were analyzed in performance assessments of middle school students' science investigation activity. Reliabilities of 2, 3, and 4~7-level rubric ratings for analytic scoring methods were compared to figure out optimized numbers of rubric ratings. Two trained raters rated four activity sheets of 60 students by two rating methods and three kinds of rubric ratings. Internal consistency reliabilities of holistic scoring methods were higher than those of analytic scoring methods, while intrarater reliabilities of analytic scoring were higher than those of holistic scoring methods. Internal consistency reliabilities and intra-rater reliabilities of 3-level rubric rating showed similar patterns of 4~7-level rubric ratings. But students' discriminations, item difficulties and item-response curves showed that the 3-level rubric ratings was reliable. These results suggest that holistic scoring method could be adapted to increase internal consistency reliabilities with improvement in intra-rater reliabilities by rater's conferences. Also, the 3-level rubric rating would be enough for good reliability in case of adapting analytic scoring methods.

• Physical Therapy Korea
• /
• v.20 no.2
• /
• pp.52-59
• /
• 2013

The purpose of this study was to determine the reliability and validity of the postural balance program which uses the movement accelerating field principles of posture balance training and evaluation equipment and smartphone movement accelerometer program (SMAP) in healthy young adults. A total of 34 people were appointed as the subject among the healthy young adults. By using Biodex stability system (BSS) and SMAP on the subject, the posture balance capability was evaluated. For the test-retest reliability, SMAP showed the intra-class correlation (ICC: .62~.91) and standard error measurement (SEM: .01~.08). BSS showed the moderate to high reliability of ICC (.88~.93) and SEM (.02~.20). In the reliability of inter-rater, ICC (.59~.73) as to SMAP, showed the reliability of moderate in eyes open stability all (EOSA), eyes open stability anterior posterior (EOSAP), eyes open stability medial lateral (EOSML) and eyes open dinamic all (EODA), eyes open danamic anterior posterior (EODAP), and eyes open danamic medial lateral (EODML). However, ICC showed reliability which was as low as .59 less than in other movements. In addition, BSS showed the reliability of high as ICC (.70~.75). It showed reliability which was as low as ICC (.59 less than) in other movements. In correlation to the balance by attitudes between SMAP and BSS, EOSML (r=.62), EODA (r=.75), EODML (r=.72), ECDAP (r=.64), and ECDML (r=.69) shown differ significantly (p<.05). However, the correlation noted in other movements did not differ significantly. Therefore, SMAP and BSS can be usefully used in the posture balance assessment of the static and dynamic condition with eyes opened and closed.

• Physical Therapy Rehabilitation Science
• /
• v.10 no.1
• /
• pp.40-47
• /
• 2021

Objective: The purpose of this study is to prove the reliability and validity of the Power breath K5 and to compare it with pony FX. Power breathe K5 is one type of device can assess automatically Maximum inspiratory pressure (MIP), Peak inspiratory pressure, Peak inspiratory flow (PIF). Design: Cross-sectional study. Methods: Thirty-five COPD patients participated in the test to investigate for the intra relater reliability and concurrent validity. The tests MIP, Vital capacity (VC), PIF were measured by Powerbreathe K5 and Pony Fx. Data was analyzed by intraclass correlation reliability (ICC) value and a standard error of measurement and Bland-Altman plots for reliability and pearson correlation for validity. Results: Intra rater reliability of the Powerbreathe K5 was very high at MIP (ICC=0.977 95%CI 0.956~0.989, SEM=8.665, MDC=0.295), PIF (ICC=0.966 95%CI 0.933~0.93, SEM=8.665, MDC=0.295), VC (ICC=0.949 95CI 0.902~0.974, SEM=0.042, MDC=0.116). The Powerbreath K5 was significant correlation compared with Pony Fx in assessment for MIP (r=0.971, p<0.05) and vital capacity (r=0.534, p<0.05). Conclusion: In this study, We investigated the clinical usefulness of the Powerbreath K5 in evaulating the MIP, VC and PIF with COPD patients with high reliability and validity.

• Journal of Korean Academy of Nursing Administration
• /
• v.1 no.2
• /
• pp.338-348
• /
• 1995

We need to continuously evaluate for nursing quality and the outcome to reflect nursing, to repair and improve of nursing. The first problem for nursing quality improvement is development of evaluation tool for the quality of nursing care. We need a system for quality assurance evaluation that is, development and framework of evaluation tool for nursing care quality. The purpose of this study was attempted to develop an evaluation tool for the quality of nursing care in musculoskeletal disorder patients. The approach method of nursing quality for the development of the tool in this study was process evaluation framework. The study were devided dvelopment process and reliability, validity verification process. The subjects of development process of this tool are three nursing export groups, and the subject of reliability, validity verification process are 20 samples of two university hospital in seoul, who were within discharge 3 months after admission treatment in musculo-skeletal disorder. Data for this study was collected from March 10 to April 13, 1995. The development process of the tool were as follows : 1. Make preliminary list of the tool by focal group were constituted 12 clinical nurses. 2. Modify and add preliminary list by 4 nursing expert panel. 3. Calculate content validity of the tool by 25 nursing expert panel of judge. 4. Verify reliability and validity of the tool. 5. Finalize an evaluation tool for the quality of the nursing care in musculo-skeletal disorder. The results of this study were as follows : 1) Development an evaluation tool for the quality of nursing care in musculo-skeletal disorder. (1) The evalution tool of this study was developed 5 standards, 33 criterias and 133 indicators. (2) 5 standards were divided according to Nursing Process. from standard 1 to standard 5, involved criterias were each 6(18%), 3(9%), 3(9%), 15(46%), 6(18%). 2) Verify reliability and validity of the tool. (1) Score of adequate degree for content validity of 33 criterias and 133 indicators were every average 2.82. (2) Inter-rater reliabilities(consentaneity score) of the tool by pearson correlation coefficient between three raters were : r=.7506, r=.8934, r=.6695. and Inter-rater reliabilities by single-facet crossed design were : r=.7464. (3) The alpha coefficient relating to internal consistency was .8524 over all 30 items of 33 criterias of developed tool. (4) Score of the quality of nursing care following to generaal characteristics of this study subjects were stastically significant differences according to educational level (F=2.93, p=.029)and diagnosing classification (F=2.50, p=.042). Through this study, I'm sure that the developed tool for the quality of patient care in musculo-skeletal disorder will show the way of more improvement of the quality of nursing care and effective nursing interventions.

• Journal of the Korean earth science society
• /
• v.24 no.3
• /
• pp.150-159
• /
• 2003

This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.