• 대한한의학회지
• /
• 제17권1호
• /
• pp.48-83
• /
• 1996

Our conclusions for function evaluation tools of Stroke patients are as follows. 1. Evaluating tools of Activities of Daily Living, Katz Index, Barthel Index, Modified Barthel Index have high validity and reliability because of ease of measuring, high accuracy, consistency, sensitivity and sufficient stastistics, but they mainly measure motor function except sense, mentation, language, and social conception. Therefore cerebrovascular disease and brain injury in trauma patients with lacked acknowledgement and sensation, we are not able to apply these tools. 2. PULSES Profile is a useful scale for measuring the patient's over-all status, upper and lower limb functions, sensory components, excretary functions, and intellectual and emotional adaptabilities. It is recognized as a good, useful tool to evaluate patient's whole function. 3. Motor Assessment Scale was designed to measure the progress of stroke patients. The scale was supplemented with upper arm function items. We believe that the Motor Assessment Scale could be a useful evaluation tool with inter-rater reliability ,test-retest reliability. 4. The existing evaluation tools, Katz Index, Barthel Index, Modified Barthel Index, PULSES Profile, Motor Assessment Scale, mainly measured the rehabilitational motor function of sequela of cerebrovascular patients. On the other hand CNS & INH stroke scale can measure cerebrovascular disease patient's neurologic deficits and over-all stautus, which are recognition ability, speech status, motor function, sensory function, activities of daily living. Those scales have been recognized as useful tools to measure function of cerebrovascular disease patients and have increased in use. 5. Every function evaluation tool was recognized to have some validity and inter-rater, test-retest reliability in items of each evaluation tool and total scores of each evaluation tools, but it is thought that none of these scales have been fully validated and proved reliable. Therefore afterward, the development of a highly reliable rating system may best be accomplished by a careful comparison of several tools, using the same patients and the same observers in order to choose the most reliable items from each. 6. Ideal evaluation tools must have the following conditions; (1) It should show the objective functional statues at the same time. (2) It should be repeated consecutively to know changed function status. (3) It should be easy to observe the treatment program. (4) It should have the same result with another rater to help rater exchange information with treatment team members. (5) It should be practical and simple. (6) The patient should not suffer from the observer.

• 대한간호학회지
• /
• 제40권1호
• /
• pp.110-118
• /
• 2010

Purpose: To develop outcome indicators of urinary incontinence to measure quality of care in long term care hospitals in Korea. Methods: The draft indicators of urinary incontinence were developed from a literature review and clinical expert panel. A survey of medical records of 280 patients in 20 hospitals was conducted to test inter-rater reliability. Statistical analysis was done to test risk adjustment criteria, variation between hospitals, and stability of indicators, using assessment data from 77,918 patients in 623 hospitals. Results: The inter-rater reliability of items was high (Kappa range: 0.66- 0.92). Severe cognitive impairment (odds ratio [OR]: 3.15, confidence interval [CI]: 3.03-3.26) and total mobility activities of daily living (ADLs) dependency (OR: 4.85, CI: 4.72-4.98) increased the prevalence of urinary incontinence, thus they proved to be significant criteria to stratify high and low risk groups. The prevalence for low risk showed more substantial variation than the high risk group. The indicators were stable over one month. Conclusion: This study demonstrated the feasibility of outcome indicators of urinary incontinence. Improving the reliability of the patient assessment tool and refining the indicators through validation study is a must for future study.

• 한국IT서비스학회지
• /
• 제17권2호
• /
• pp.111-128
• /
• 2018

About 3.9 million apps and 24 primary categories can be approved on Apple iTunes Store. Making accurate categorization can potentially receive many benefits for developers, app stores, and users, such as improving discoverability and receiving long-term revenue. However, current categorization problems may cause usage inefficiency and confusion, especially for cross-attribution, etc. This study focused on evaluating the reliability of app categorization on Apple iTunes Store by using several rounds of inter-rater reliability statistics, locating categorization problems based on Machine Learning, and making more accurate suggestions about representative functionality stems for each primary category. A mixed methods research was performed and total 4905 popular apps were observed. The original categorization was proved to be substantial reliable but need further improvement. The representative functionality stems for each category were identified. This paper may provide some fusion research experience and methodological suggestions in categorization research field and improve app store's categorization in discoverability.

• The Journal of Korean Physical Therapy
• /
• 제28권4호
• /
• pp.232-242
• /
• 2016

Purpose: This study was conducted to develop a Korean version of the pediatric functional muscle test (K-PFMT) for children with motor developmental disorders, and to verify its reliability and validity. Methods: The subjects were 40 children, aged below 5 years. Each was scored on the K-PFMT by 14 physical therapists to determine inter-rater reliability and internal consistency. Additionally, 3 of the 14 therapists tested 20 children again one or two weeks later to determine test-retest reliability. The internal consistency was calculated by Cronbach's alpha. The inter-rater and test-retest reliability were calculated using the intraclass correlation coefficient (ICC). One-way ANOVA and the paired t-test were used to compare differences among the three evaluator groups and between the test and retest group. Concurrent validity was evaluated by Pearson's correlation with a total score of GMFM. Results: Chronbach's alpha was over 0.98 for each test item and 0.99 for the total items. There was no significant differences in the score of K-PFMT among the three evaluator groups except for a few items. The test-retest ICC was from 0.89 to 1.00 and from 0.82 to 1.00, respectively. There was no significant difference between the test and retest group, except for a few items. There were high significant correlations between K-PFMT and GMFM. Conclusion: This study showed that a K-PFMT with relatively high reliability and validity was successfully developed. The K-PFMT will be a useful tool for measurement of muscle strength of children with motor developmental disorder.

• The Journal of Korean Physical Therapy
• /
• 제29권1호
• /
• pp.16-26
• /
• 2017

Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.

• 대한감각통합치료학회지
• /
• 제14권1호
• /
• pp.1-8
• /
• 2016

목적 : 본 연구의 목적은 주의력결핍 과잉행동장애 아동을 대상으로 놀이의 질적수준을 평가하는 놀이다움 평정척도(Test of Playfulness: ToP)의 신뢰도를 알아보고자 한다. 연구방법 : 연구대상은 G시에 거주하는 초등학교 2학년~3학년의 주의력결핍 과잉행동장애 아동 20명이다. 놀이다움 평정척도의 신뢰도를 알아보기 위하여 측정자간 일치율과 Kappa계수로 제시하였고, 측정자간 신뢰도 분석은 급간내 상관계수(Intraclass Correlation Coefficient: ICC)를 사용하여 제시하였다. 결과 : 놀이다움 평정척도의 각 항목간 측정자간 일치율은 75~95%이었다. 각 항목의 Kappa계수의 범위는 .45~1.00이었다. 각 요소에 대한 측정자간 신뢰도를 급간내 상관계수로 분석한 결과 내적동기는 .96, 통제지각은 .98, 현실감 부재는 .90, 참조체계는 .98, 총점은 .99로 매우 높은 신뢰도를 보였다. 결론 : 연구결과를 통하여 주의력결핍 과잉행동장애 아동의 놀이다움 평정척도의 측정자간 신뢰도는 높은 것으로 나타났다. 이를 근거로 하여 주의력결핍 과잉행동장애 아동의 임상적인 평가의 유용성을 제공하고, 주의력결핍 과잉행동장애 아동의 놀이연구에 대한 기초자료를 제공하고자 한다.

• PNF and Movement
• /
• 제17권2호
• /
• pp.329-337
• /
• 2019

Purpose: Ultrasound imaging is commonly used to measure the pennation angle of human skeletal muscles in vivo. However, manual assessment of the pennation angle using ultrasound images is subjective and time-consuming and requires a high level of examiner skill. The architectural analysis of human skeletal muscles is thus challenging. Automated approaches using image processing techniques are therefore required to estimate the pennation angle in ultrasound images. The purpose of this study was thus to assess the intra-tester and inter-tester reliability and validity of the pennation angle using an automatic measurement program. Methods: Twenty-two healthy young adults (mean age = 22.55 years) with no medical history of neurological or musculoskeletal disorders voluntarily participated in this study. Ultrasound imaging was used to measure the pennation angle of the gastrocnemius muscle at rest. One examiner acquired images from all the participants. The intra-tester and inter-tester reliability were evaluated using the intraclass correlation coefficient (ICC) to estimate reliability. Validity was measured using Pearson's correlation coefficient. Results: The intra-rater reliability was excellent for the automatic pennation angle measuring program and the manual pennation angle assessment method (ICC>0.95). The inter-rater reliability was also excellent for both methods (ICC>0.93). All the correlation coefficients for the automatic pennation angle measuring program and the manual pennation angle assessment method were 0.79, which indicated a significantly positive correlation (p<0.05). Conclusion: Pennation angle measurement using the automatic pennation angle measuring program showed acceptable reliability and validity. This study therefore demonstrated that the automatic measuring program was able to automatically measure the pennation angle of skeletal muscles using ultrasound images, and thus made it easy to investigate skeletal muscle architecture.

• Journal of Preventive Medicine and Public Health
• /
• 제43권6호
• /
• pp.479-485
• /
• 2010

Objectives: The Korean Genome and Epidemiology Study (KoGES), a multicenter-based multi-cohort study, has collected information on body composition using two different bioelectrical impedence analysis (BIA) machines. The aim of the study was to evaluate the possibility of whether the test values measured from different BIA machines can be integrated through statistical adjustment algorithm under excellent inter-rater reliability. Methods: We selected two centers to measure inter-rater reliability of the two BIA machines. We set up the two machines side by side and measured subjects' body compositions between October and December 2007. Duplicated test values of 848 subjects were collected. Pearson and intra-class correlation coefficients for inter-rater reliability were estimated using results from the two machines. To detect the feasibility for data integration, we constructed statistical compensation models using linear regression models with residual analysis and R-square values. Results: All correlation coefficients indicated excellent reliability except mineral mass. However, models using only duplicated body composition values for data integration were not feasible due to relatively low $R^2$ values of 0.8 for mineral mass and target weight. To integrate body composition data, models adjusted for four empirical variables that were age, sex, weight and height were most ideal (all $R^2$ > 0.9). Conclusions: The test values measured with the two BIA machines in the KoGES have excellent reliability for the nine body composition values. Based on reliability, values can be integrated through algorithmic statistical adjustment using regression equations that includes age, sex, weight, and height.

• Physical Therapy Rehabilitation Science
• /
• 제12권3호
• /
• pp.259-267
• /
• 2023

Objective: Rehabilitative ultrasound imaging is a safe and noninvasive technique for evaluating muscle thickness. A dual probe-fixing frame (DPF) can provide visual feedback during exercises targeting specific muscles. The purpose of this research was to verify the reliability and validity of the DPF for dual-probe ultrasound (DPU)-based visual feedback exercises, allowing users to use both hands freely. Design: This cross-sectional study used repeated measures to compare muscle thickness measurements obtained using the handheld device and DPF with DPU. Methods: Twenty healthy adults participated in the study. Measurements were taken over two sessions, with a two-day interval between the sessions. The thicknesses of the rectus abdominis (RA) and transverse abdominis (TrA) muscles were measured using DPU. The DPF with DPU developed by the research team, was used along with a laptop-based muscle viewer. Bland-Altman analysis and intraclass correlation coefficients (ICCs) calculations were used in statistical analyses to evaluate agreement and reliability, respectively. Results: The results of the Bland-Altman analysis showed small average differences between the handheld and DPF methods for both RA and TrA muscle thicknesses. Inter-rater reliability analysis showed high ICC values for DPF measurements of both RA (0.908-0.912) and TrA (0.892-741) muscle thicknesses. Intra-rater reliability analysis also showed good ICC values for measurements taken by a single examiner over two days. Conclusion: The findings of this study demonstrate that the DPF provides reliable and valid measurements of muscle thickness during visual feedback exercises using the DPU.

• 한국전문물리치료학회지
• /
• 제18권3호
• /
• pp.67-75
• /
• 2011

The purpose of this study was to assess the agreement of manual muscle testing (MMT) and test-retest reliability of a hand held dynamometer for the posterior gluteus medius muscle, with and without lumbar stabilization, using a pressure biofeedback unit for patients with low back pain. The pressure biofeedback unit was used to minimize the substitute motion of the lumbopelvic region during hip abduction in patients lying on their side. Fifteen patients with low back pain participated in this study. A tester determined the MMT grades of the posterior gluteus medius with and without the pressure biofeedback unit. Active hip abduction range of motion with an inclinometer and the strength of their posterior gluteus medius using a hand held dynamometer were measured with and without the pressure biofeedback unit in the MMT position. The agreement of the grade of muscle strength in the MMT, and intra-rater reliability of both the active hip abduction range of motion and the strength of posterior gluteus medius were analyzed using the weighted kappa and intraclass correlation coefficient (ICC), respectively. The agreement of MMT with the pressure biofeedback unit (weighted kappa=.92) was higher than the MMT (weighted kappa=.34)(p<.05). The inclinometer with pressure biofeedback unit measurement of the active hip abduction range of motion had an excellent intra-rater reliability (ICC=.90). Also, the hand held dynamometer with pressure biofeedback unit measure of strength of the posterior gluteus medius had a good intra-rater reliability (ICC=.85). Therefore, the test for muscle strength with pressure biofeedback unit will be a reliable method for the determination of the MMT grades or amount of posterior gluteus medius muscle strength and the measurement of the range of motion for hip abduction in patients with low back pain.