• 대한치위생과학회지
• /
• 제4권1호
• /
• pp.53-64
• /
• 2021

Background: The elderly in long-term care facilities tend to have a diminished oral health status, with a high prevalence of dental caries and periodontal disease, as reduced cognitive function, joint mobility, and gait ability hinder the performance of oral hygiene. To improve the oral health of the elderly at long-term care facilities, it is necessary to have precise guidelines for oral health care and assessment; however, such guidelines are not readily available. Therefore, the present study aimed to develop an oral care assessment tool with verified reliability and validity. Methods: The participants in this study were 100 elderly patients at a care facilities and 10 clinical dental hygienists. Collected data were analyzed using the descriptive statistics, content validity index, and inter-rater reliability, as well as the analyses of intra-class correlation coefficient. Results: After a review of relevant literature, a preliminary questionnaire comprised of seven questions related to the evaluation of oral health was formed. After revising and supplementing the questions through a content validity test, a total of nine questions were selected. Conclusion: The novel assessment tool developed for the present study is anticipated to allow analyses of the level of problems related to oral health care before routine and professional care. Moreover, regular oral health status check-ups will enable the early diagnosis and treatment of diseases.

• International Journal of Contents
• /
• 제15권4호
• /
• pp.97-106
• /
• 2019

EMI (English as a Medium of Instruction) classes are now accepted policy at Korean universities, yet students often struggle with required academic English writings. The present study examined an EMI class that used direct instruction and access to online assistive English writing software. From preliminary analysis, 26 students expressed interest in how an EMI academic writing class could facilitate improved English writing skills. Study participants completed a survey on self-efficacy and learning needs and assignments for an EMI academic writing class. To establish inter-rater reliability, three trained raters assessed the written essays of students prior to and after instructional intervention. Fleiss' Kappas statistics showed moderate reliability. Students' opinions on the use of online software were also analysed. Paired t-test was run on the quality of students' pre- and post-instruction assignments, and there was significant difference in the rated scores. Self-efficacy was found to have moderate positive association with improved post-essay writing scores.

• 대한물리의학회지
• /
• 제5권1호
• /
• pp.89-99
• /
• 2010

Purpose : This study were to examine the test-retest and inter-rater reliability as well as the concurrent validity, and convergent validity of the 2 simplified Postural Assessment Scale for Stroke:5itmes-3Level(PASS:5i-3L) & Berg Balance Scale:7items

• 영어어문교육
• /
• 제15권2호
• /
• pp.169-184
• /
• 2009

The purpose of this study is to identify the most important factor(s) that contribute(s) to the overall oral proficiency and to examine whether the factor(s) play(s) a different role depending on the proficiency level of learners. Learners were divided into novice group and advanced group and were asked to produce an oral recording of a story based on a comic strip. The recordings were transcribed and graded by three raters. According to the results, the raters attained high inter-rater reliability when assessing advanced learners. However, the reliability level became considerably lower in the assessment of novice learners. The best predictor of oral proficiency among novice learners was sociolinguistic competence and fluency, while grammatical competence and fluency were the strongest predictors for advanced learners. The results suggest the need for a separate assessment tool for different proficiency levels and the need for a different focus in the classroom depending on the learners' proficiency level.

• 대한치과의사협회지
• /
• 제57권8호
• /
• pp.448-455
• /
• 2019

This study aims to apply the Generalizability Theory (G-theory) for estimation of reliability of evaluation scores between raters on Patient Dentist Interaction. Selecting a number of raters as multiple error sources, this study was analyzed the error sources caused by relative magnitude of error variances of interaction between the factors and proceeded with D-study based on the results of G-study for optimal determination of measurement condition. The estimated outcomes of variance component for accuracy among the Patient Dentist Interaction evaluation with G-theory showed that impact of error was the biggest influence factor in students. The second influence was the item effect, and the rater effect was relatively small. The Generalizability coefficients for case1 and case2 which were estimated through the D- study were calculated relatively low.

• 한국과학교육학회지
• /
• 제30권2호
• /
• pp.275-290
• /
• 2010

중학생의 과학탐구활동 수행평가 시 총체적 채점과 분석적 채점의 신뢰도를 비교 분석하였으며, 분석적 채점을 하는 경우에는 신뢰도 확보를 위하여 채점척도의 수준을 어느 정도로 분석적으로 해야 하는지를 조사하였다. 중학생들이 작성한 4개의 과학탐구과제에 대한 활동지를 두 명의 채점자가 총체적 채점 방식, 분석적 채점 방식, 분석적 채점 중 채점척도를 2, 3, 4~7수준으로 다르게 하여 채점하였다. 총체적 채점 방식은 과제 간 내적 일치도가 높게 나타났으며, 분석적 채점 방식은 채점자간 신뢰도가 높게 나타났다. 또한 채점척도 3수준의 경우는 4~7수준의 경우와 활동간 내적 일치도와 채점자간의 신뢰도가 유사하게 나타났으나, 능력추정치별 학생의 분포, 문항곤란도 및 문항특성곡선의 경우 채점척도 3수준의 경우가 적절한 것으로 나타났다. 이러한 연구 결과는 과학탐구활동 수행평가 시 총체적 채점 방식을 선택하는 경우는 과제 간 내적일치도를 높일 수 있으며 분석적 채점 방식에 비해 낮게 나타나는 채점자 간 일치도를 높이기 위한 채점자간 협의등 방안이 필요하다는 것을 시사한다. 또한 분석적 채점 방식을 선택하는 경우는 채점척도 3수준으로 충분히 신뢰도를 확보할 수 있다는 점을 시사한다.

• 한국전문물리치료학회지
• /
• 제20권2호
• /
• pp.52-59
• /
• 2013

The purpose of this study was to determine the reliability and validity of the postural balance program which uses the movement accelerating field principles of posture balance training and evaluation equipment and smartphone movement accelerometer program (SMAP) in healthy young adults. A total of 34 people were appointed as the subject among the healthy young adults. By using Biodex stability system (BSS) and SMAP on the subject, the posture balance capability was evaluated. For the test-retest reliability, SMAP showed the intra-class correlation (ICC: .62~.91) and standard error measurement (SEM: .01~.08). BSS showed the moderate to high reliability of ICC (.88~.93) and SEM (.02~.20). In the reliability of inter-rater, ICC (.59~.73) as to SMAP, showed the reliability of moderate in eyes open stability all (EOSA), eyes open stability anterior posterior (EOSAP), eyes open stability medial lateral (EOSML) and eyes open dinamic all (EODA), eyes open danamic anterior posterior (EODAP), and eyes open danamic medial lateral (EODML). However, ICC showed reliability which was as low as .59 less than in other movements. In addition, BSS showed the reliability of high as ICC (.70~.75). It showed reliability which was as low as ICC (.59 less than) in other movements. In correlation to the balance by attitudes between SMAP and BSS, EOSML (r=.62), EODA (r=.75), EODML (r=.72), ECDAP (r=.64), and ECDML (r=.69) shown differ significantly (p<.05). However, the correlation noted in other movements did not differ significantly. Therefore, SMAP and BSS can be usefully used in the posture balance assessment of the static and dynamic condition with eyes opened and closed.

• Physical Therapy Rehabilitation Science
• /
• 제10권1호
• /
• pp.40-47
• /
• 2021

Objective: The purpose of this study is to prove the reliability and validity of the Power breath K5 and to compare it with pony FX. Power breathe K5 is one type of device can assess automatically Maximum inspiratory pressure (MIP), Peak inspiratory pressure, Peak inspiratory flow (PIF). Design: Cross-sectional study. Methods: Thirty-five COPD patients participated in the test to investigate for the intra relater reliability and concurrent validity. The tests MIP, Vital capacity (VC), PIF were measured by Powerbreathe K5 and Pony Fx. Data was analyzed by intraclass correlation reliability (ICC) value and a standard error of measurement and Bland-Altman plots for reliability and pearson correlation for validity. Results: Intra rater reliability of the Powerbreathe K5 was very high at MIP (ICC=0.977 95%CI 0.956~0.989, SEM=8.665, MDC=0.295), PIF (ICC=0.966 95%CI 0.933~0.93, SEM=8.665, MDC=0.295), VC (ICC=0.949 95CI 0.902~0.974, SEM=0.042, MDC=0.116). The Powerbreath K5 was significant correlation compared with Pony Fx in assessment for MIP (r=0.971, p<0.05) and vital capacity (r=0.534, p<0.05). Conclusion: In this study, We investigated the clinical usefulness of the Powerbreath K5 in evaulating the MIP, VC and PIF with COPD patients with high reliability and validity.

• 간호행정학회지
• /
• 제1권2호
• /
• pp.338-348
• /
• 1995

We need to continuously evaluate for nursing quality and the outcome to reflect nursing, to repair and improve of nursing. The first problem for nursing quality improvement is development of evaluation tool for the quality of nursing care. We need a system for quality assurance evaluation that is, development and framework of evaluation tool for nursing care quality. The purpose of this study was attempted to develop an evaluation tool for the quality of nursing care in musculoskeletal disorder patients. The approach method of nursing quality for the development of the tool in this study was process evaluation framework. The study were devided dvelopment process and reliability, validity verification process. The subjects of development process of this tool are three nursing export groups, and the subject of reliability, validity verification process are 20 samples of two university hospital in seoul, who were within discharge 3 months after admission treatment in musculo-skeletal disorder. Data for this study was collected from March 10 to April 13, 1995. The development process of the tool were as follows : 1. Make preliminary list of the tool by focal group were constituted 12 clinical nurses. 2. Modify and add preliminary list by 4 nursing expert panel. 3. Calculate content validity of the tool by 25 nursing expert panel of judge. 4. Verify reliability and validity of the tool. 5. Finalize an evaluation tool for the quality of the nursing care in musculo-skeletal disorder. The results of this study were as follows : 1) Development an evaluation tool for the quality of nursing care in musculo-skeletal disorder. (1) The evalution tool of this study was developed 5 standards, 33 criterias and 133 indicators. (2) 5 standards were divided according to Nursing Process. from standard 1 to standard 5, involved criterias were each 6(18%), 3(9%), 3(9%), 15(46%), 6(18%). 2) Verify reliability and validity of the tool. (1) Score of adequate degree for content validity of 33 criterias and 133 indicators were every average 2.82. (2) Inter-rater reliabilities(consentaneity score) of the tool by pearson correlation coefficient between three raters were : r=.7506, r=.8934, r=.6695. and Inter-rater reliabilities by single-facet crossed design were : r=.7464. (3) The alpha coefficient relating to internal consistency was .8524 over all 30 items of 33 criterias of developed tool. (4) Score of the quality of nursing care following to generaal characteristics of this study subjects were stastically significant differences according to educational level (F=2.93, p=.029)and diagnosing classification (F=2.50, p=.042). Through this study, I'm sure that the developed tool for the quality of patient care in musculo-skeletal disorder will show the way of more improvement of the quality of nursing care and effective nursing interventions.

• 한국지구과학회지
• /
• 제24권3호
• /
• pp.150-159
• /
• 2003

본 연구에서는 지구과학 지식과 창의력을 동시에 적용해야 해결할 수 있는 지구과학 창의력을 평가할 수 있는 문항의 개발 방법을 제시하고자 하였다. R&D과정을 거친 본 연구의 결과는 첫째, 조작적 정의를 통해 창의력과 과학창의력간의 인지능력 차이를 명료화하였고 둘째, 과학창의력을 구성하는 하위 요소들 중에서 문항 개발이 가능하다고 판단된 유창성, 융통성, 정교성, 독창성을 선정하여 각각에 대한 조작적 정의를 내린 후 각 요소들에 대한 평가와 채점의 준거를 제시하였다. 셋째, 평가도구의 구비 조건인 타당도, 신뢰도, 변별도, 난이도를 검증하기 위하여 3번의 현장검증을 실시하였으며, 본 연구에서 개발한 지구과학창의력 평가도구는 각 하위 요소별로 2문항씩 총 8문항으로 구성되어 있다. 넷째, 문항합치도 지수 평균은 .99, 문항 내적 합치도 지수인 Cronbach ${\alpha}$값은 .79, 각 문항별 평가자간 신뢰도는 0.78,각 하위 요소별 평가자간 신뢰도는 0.75, 변별도 지수인 점이연상관 지수는 .19, 문항 난이도 지수는 .00이었다. 이와 같이 평가도구의 구비조건들이 허용 범위 내에 있는 것으로 볼 때 본 연구에서 개발한 지구과학 창의력 평가도구는 유용한 것으로 판단할 수 있다.