• 음성과학
• /
• 제11권4호
• /
• pp.129-141
• /
• 2004

An auditory-perceptual evaluation has long been utilized in assessing dysarthric speech. The process involves subjective judgement and the results might vary depending on clinical experiences or training of listeners. This study aimed to investigate reliability of the auditory-perceptual evaluation of 22 multi -dimensional variables on 6 patients with Parkinsonian speech disorders. Listeners were divided into two groups: one consisted of 6 speech therapists with clinical experiences for three years or more, and the other 6 graduate students without any previous clinical background. The results showed that the former evaluated dysarthric speech with higher inter-rater and intra-rater reliabilities than the latter. Furthermore, such speech variables as 'precise consonant: 'speech intelligibility: and 'SMR regularity' were more influenced than others by clinical experiences. We, therefore, postulated that a reliable auditory-perceptual evaluation of dysarthric speech may require adequate amount of clinical training of listeners.

• 중환자간호학회지
• /
• 제5권2호
• /
• pp.61-71
• /
• 2012

Purpose: The aim of this study was to measure the inter-rater reliability of Emergency severity index (ESI) version 4 among triage nurse. Methods: This study was carried out from August 11, 2010 to September 7, 2010 in a regional emergency department. Data collection was done by ten triage nurses who trained ESI v.4. Two research nurses and ten triage nurses scored the ESI version 4 to the patients as references, independently. We calculated the weighted kappa between the triage nurses and research nurses to evaluate the consistency of the ESI v.4. Results: A total of 233 patients were enrolled in this study. Classification of ESI level was as follows - level 1 (0.4%), level 2 (21.0%), level 3 (67.8%), level 4 (9.4%), and level 5 (1.3%). Inter-rater reliability by weighted kappa was 0.79 (95% Confidence Interval= 0.74-0.83) and agreement rate was 87.1%. Under-triage rate by triage nurse was 6.0% and over-triage rate was 6.9%. Conclusion: For this study, inter-rater reliability was measured good level between triage nurses and research nurses in Korean single ED.

• 한국전문물리치료학회지
• /
• 제18권1호
• /
• pp.37-46
• /
• 2011

The purpose of this study was to investigate intra-rater reliability and determine the validity of electromyography (EMG) measurements to represent muscle activity and ultrasonography (US) to represent muscle thickness during manual muscle testing (MMT) to external abdominal oblique (EO) and lumbar multifidus (MF). Twenty healthy subjects were recruited for this study and asked to perform MMT at differing levels. The subjects' muscle activity using EMG was measured by a ratio to maximum voluntary contraction (MVC) and root mean square (RMS) methods. The subjects' muscle thickness using US was measured by raw muscle thickness and change ratio of thickness to maximum (MVC) or resting condition. In three trials, measurements were performed on each subject by one examiner. The intra-rater reliability of measurements of EMG and US to EO and MF was calculated using intra-class coefficients. The intra-rater reliability of all measurements was excellent (ICC=.75~.98) in EMG and US. The conduct validity was calculated by one-way ANOVA with repeated measurements to compare whether the EMG and US measurements were different between MMT at different levels. There was only a significant difference between all grades at %MVC thickness measurement of US. These results suggest that a %MVC thickness measurement of US was a more sensitive and discriminate in all manual muscle testing grades. This information will be useful for the selection of US measurement and analysis methods in clinics.

• 대한기계학회논문집B
• /
• 제41권2호
• /
• pp.125-133
• /
• 2017

본 연구에서는 환자의 손가락 경직을 모사하는 손가락 시뮬레이터를 통해 손가락 경직도 검진에서의 검진자간 신뢰도에 대해 연구하였다. 시뮬레이터를 제어하기 위해 경직에서 나타나는 토크를 간단하게 모델링 하고 손가락 경직 환자로부터 간단한 측정 모듈을 이용해 각각의 Modified Ashworth Scale(MAS) 등급에 맞는 파라미터를 얻어냈다. 또한 중수지 관절에 모터가 위치한 손가락 형태의 로봇을 설계하여 경직 토크 모델을 따르는 시뮬레이터를 개발하였다. 이 시뮬레이터를 통해 일곱 명의 재활의학과 전문의들의 검진 결과를 평가해본 결과 중수지 관절에서 0.619, 근위지간 관절에서 0.514의 Cohen's Kappa 값을 보였다. 검진자간의 Fleiss' Kappa 값은 중수지 관절에서 0.513, 근위지간 관절에서 0.486으로 나타났다. 또한 검진자들은 각각의 주관적인 MAS 검진 기준을 가진다는 것을 확인하였다. 결과적으로 같은 환자에 대한 MAS 검진 신뢰도가 높지 않기 때문에 개발된 로봇 시뮬레이터는 검진자의 신뢰도를 높일 수 있는 교육용 도구로서 활용 가능함을 확인하였다.

• Journal of Preventive Medicine and Public Health
• /
• 제55권4호
• /
• pp.334-341
• /
• 2022

Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

• 한국전문물리치료학회지
• /
• 제20권2호
• /
• pp.46-51
• /
• 2013

The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권2호
• /
• pp.1201-1216
• /
• 2017

In this study, we described the development of a methodology to measure tip-pinch strength on the paretic hand rehabilitation device and aimed to investigate reliability of the device. FSR sensors were embedded on the device, and tip pinch strength was estimated with data collected from the sensors using a developed equation while participants were demonstrating tip pinch. Reliability tests included inter-rater, test-retest, and inter-instrument reliability. B&L Engineering pinch gauge was utilized for the comparison. Thirty-seven healthy students participated in the experiment. Both inter-rater and test-retest reliability were excellent as Intraclass Correlation Coefficients (ICCs) were greater than 0.9 (p<0.01). There were no statistically significant differences in tip-pinch strengths. Inter-instrument reliability analysis confirmed good correlation between the two instruments (r = 0.88, p < 0.01). The findings of this study suggest that the two instruments are not interchangeable. However, the tip-pinch mechanism used in the paretic hand rehabilitation device is reliable that can be used to evaluate tip pinch strength in clinical environment and can provides a parameter that monitors changes in the hand functions.

• The Journal of Korean Physical Therapy
• /
• 제22권5호
• /
• pp.83-93
• /
• 2010

Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

• Physical Therapy Rehabilitation Science
• /
• 제10권3호
• /
• pp.379-386
• /
• 2021

Objective: The purpose of this study was to systematically review the trunk impairment scale that are used to assess the trunk control of stroke patients. Design: A systematic review Methods: Stroke subjects were categorized as acute, subacute, chronic. In this systematic review, the studies published between 2000 and 2020 were selected. A literature search using the keywords 'QUADAS', 'stroke', 'trunk impairment scale'. Data sources included RISS, GOOGLE Scholar and DBpia. We assessed the quality of assessment tools using Quality Assessment of Diagnostic Accuracy Studies tool. Results: We reviewed 18 studies. 7 of the 18 studies reported reliability results, 10 reported validity results. The QUADAS tool quality evaluation of 17 literatures extracted except for one randomized control test among 18 literatures showed a range of 3 to 13 points. 5 of the 18 studies are presented with the Cronbach alpha coefficient indicating reliability using internal consistency, all of which are more than 0.8. All studies that presented test-retest reliability, intra-rater reliability, and inter-rater reliability showed high agreement with an intra-class correlation coefficient of 0.75 or more. Conclusions: A systematic review of the study of the application of the trunk impairment scale for stroke patients will help provide criteria for future studies and application of the trunk impairment scale in clinical practice.

• 대한지역사회작업치료학회지
• /
• 제7권1호
• /
• pp.17-24
• /
• 2017

목적 : 건강한 성인을 대상으로 목의 관절가동범위를 측정하는데 임상에서 간편하게 적용할 수 있는 스마트폰 어플리케이션의 유용성을 확인하고자 한다. 연구방법 : 목의 관절가동범위는 스마트폰 어플리케이션과 각도계로 목의 굽힘, 폄, 오른쪽 돌림, 왼쪽 돌림, 오른쪽 가쪽 굽힘, 왼쪽 가쪽 굽힘의 움직임을 각각 측정하였다. 검사자내 신뢰도와 검사자간 신뢰도를 측정하기 위해 같은 검사자가 두 번, 다른 검사자가 한 번으로 총 세 번 측정을 실시하였다. 검사 순서는 무작위로 하였으며, 두 검사자는 서로 측정한 결과를 알지 못하게 하였다. 결과 : 연구에 참여한 대상자는 남자 9명, 여자 21명이었다. 실험 결과 스마트폰 어플리케이션과 각도계의 평균 각도 비교에서 오른쪽 가쪽 굽힘을 제외한 모든 항목에서 유의한 차이가 없는 것으로 나타났다(p>.05). 스마트폰 어플리케이션과 각도계의 검사자내 신뢰도는 전 움직임에서 ICC값이 .841~.958로, 검사자간 신뢰도는 전 움직임에서 ICC값이 .720~.944로 나타나 모두 높은 수준의 신뢰도를 보였다. 결론 : 스마트폰 어플리케이션과 각도계는 목의 관절가동범위를 측정하는데 신뢰할 수 있는 것으로 나타나, 스마트폰 어플리케이션은 관절가동범위에 신속하고 정확한 측정으로 인해 임상에서 유용한 도구로 활용할 수 있을 것이다.