• 대한통합의학회지
• /
• 제8권3호
• /
• pp.173-180
• /
• 2020

Purpose : The aim of this study was to assess the intra- and inter-rater reliability and validity of measurements of head, neck, and pelvis posture using a mobile application in subjects with forward head posture. Methods : Forty-eight volunteers (22 men, 26 women) participated in this study. Two raters independently examined whole body picture images in a lateral standing posture with arms crossed using a CA-Smart Posture Reminder (CA-SPR), and a rater took and calculated posture images twice to assess reliability. We measured five parameters: craniovertebral angle 1 (CVA1), anterior shoulder translation (AST), pelvic tilt (PT), knee angle (KA), and ankle angle (AA) in the subject's sagittal plane using CA-SPR. We examined whole spine X-ray images in the same position to assess validity. We measured four variables in the subjects: CVA2, translation distance (AHT), anterior pelvic plane (APP), and sacral slope (SS). The intra- and inter-rater reliability were calculated using the intraclass correlation coefficient (ICC). Convergent validity was calculated using Pearson's correlation coefficient. Results : The intra-rater reliability (ICC=.889 -.989) and inter-rater reliability (ICC=.800 -.980) were excellent for all variables measured using CA-SPR. The variables measured using CA-SPR and X-ray were significantly positively correlated (r=.623, p<.01). However, the correlation of the variables in the pelvis was not statistically significant. Conclusion : This study shows that a mobile application (CA-SPR) is a useful tool for measuring head and neck posture in subjects with forward head posture. However, further study is needed to measure pelvic variables when using a mobile application.

• 한방안이비인후피부과학회지
• /
• 제30권4호
• /
• pp.97-103
• /
• 2017

Objectives : To identify whether pattern identification using nasal endoscopy for rhinitis can be applied as a tool for evaluating rhinitis in routine care setting, we performed a inter-rater reliability study on this pattern identification. Methods : Two Korean medicine doctors assessed 290 left/right nasal endoscopy photograph cases of rhinitis patients with pattern identification using nasal endoscopy. This pattern identification consist of four assessment items, nasal membrane color(pale/hyperemia), nasal membrane humidity(dryness/dampness), rhinorrhea(watery/yellow), and turbinate membrane edema(atrophic/edematous). Cohen's kappa statistic and Percentage agreement were used to evaluate the inter-rater reliability. Results : Inter-rater percentage agreement and Kappa coefficient for left nasal endoscopy photograph cases was from 'slight' to 'moderate'(% agreement: 40.00-67.59%/Kappa: 0.06-0.407). Only the agreement of 'rhinorrhea (watery/yellow)' item was moderate(% agreement: 67.59%/Kappa: 0.407). Inter-rater percentage agreement and Kappa coefficient for right nasal endoscopy photograph cases was also from 'slight' to 'moderate'(% agreement: 42.41-68.97%/Kappa: 0.109-0.465). Only the agreement of 'rhinorrhea(watery/yellow)' item was moderate(% agreement: 68.97%/Kappa: 0.465). Conclusions : It is necessary to resolve problems such as cut-off value setting, bipolar evaluation values(pale/hyperemia, dryness/dampness, watery/yellow, atrophic/edematous) and weighting items. Further rigorous studies that overcome the limitations of the current research are warranted.

• Physical Therapy Rehabilitation Science
• /
• 제11권4호
• /
• pp.488-492
• /
• 2022

Objective: The purpose of this study is to find out the reliability and validity of the newly updated Balancia 2.5 program using Wii balance board through equipment that can measure center of pressure data with the precision. Design: Cross-sectional study Methods: Twenty-seven healthy adults participated in the study. The subjects were assessed for static balance ability by Accusway, and were assessed for static balance ability on Wii balance board connected to theBalancia 2.5 program.To limit postural fluctuations due to stare, the subjects were asked to look at a 15 cm dot drawn 3 m in front of them for 30 seconds with their eyes open. Static balance ability data such as path length and sway velocity were extracted from all measurement tools.Intra-rater and inter-rater reliability and validity were extracted through intraclass correlation coefficient (ICC) and 95% confidence interval (CI). Results: The intra-rater reliability that the same rater shows consistent results through test-retest was a high level at ICC=0.968 (0.926~0.986), and inter-rater reliability that the requires consistent results even when measured by different raters was a high level at ICC=0.943 (0.870~0.975). The validity was a high level at ICC=0.948 (0.881~0.977), which shows whether the measurement tool is properly measuring what it is intended to measure. Conclusions: The Balancia 2.5 program, newly updated through this study, proved to be a program with high reliability and validity in evaluating static balance ability like the existingBalancia 2.0 program.

• 한방안이비인후피부과학회지
• /
• 제26권2호
• /
• pp.10-18
• /
• 2013

Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

• 한국전문물리치료학회지
• /
• 제26권2호
• /
• pp.24-33
• /
• 2019

Background: Spontaneous use of the upper extremities on the affected side of patients with stroke is a meaningful indicator of recovery and may vary by the age or dominant hand of patients. No prior study has reported changes in actual amount of use test (AAUT) and motor activity log (MAL)-28 according to age and handedness in healthy adults, and AAUT inter-rater reliability for assessment of healthy adults. Objects: This study aimed to (1) research the differences in AAUT and MAL-28 according to age and handedness in healthy adults, and (2) determine the inter-rater reliability of the AAUT. Methods: Seventy healthy adults participated in this study. The MAL-28 was assessed by dividing 61 subjects into young right-handed ($n_1=20$), young left-handed ($n_2=21$), and older right-handed ($n_3=20$) groups. The AAUT was assessed by dividing 63 subjects into young right-handed ($n_1=25$), young left-handed ($n_2=18$), and older right-handed ($n_3=20$) groups. Student's t-test and the Wilcoxon signedrank test were used for statistical analysis. Results: The Amount of Use (AOU) scale values for each group showed no significant differences between age groups and handedness groups in the MAL-28 (p>.05). The AAUT AOU scale value showed significant differences regarding dominant handedness in the AAUT (p<.05), but no significant differences according to age (p>.05). (2) Inter-rater reliability of the AAUT was excellent, except few items (item 9, 11, and 12). Conclusion: Although both the MAL-28 and the AAUT measured how much participants used their dominant arms in healthy subjects, the AAUT only showed significantly higher dominant arm use in left hander than the right hander. In addition, the inter-rater reliability of the AAUT was excellent. Current results can be utilized as a basic information when clinicians develop rehabilitation strategies, and AAUT was shown to be a reliable evaluation tool for measurement of upper extremity use in Korean adults, based on the reliability demonstrated by this study.

• 한국전문물리치료학회지
• /
• 제20권2호
• /
• pp.60-68
• /
• 2013

The purpose of this study was to assess the intra-rater test-retest reliability of tibial external rotation angle measurement using a smartphone-based photographic goniometer, DrGoniometer (DrG) compared to a three-dimensional motion analysis system (Vicon). The current study showed an interchangeable method using DrG to measure the tibial external rotation angle in standing knee flexion at $90^{\circ}$. Twelve healthy subjects participated in this study. A rest session was conducted 30 minutes later for within-day reliability and five days later for between-day intra-rater test-retest reliability. To assess the validity of the measurement using DrG, we used a three dimensional motion analysis system as a gold standard to measure the angle of tibial external rotation. Intra-class correlation coefficient (ICC) and the standard error of measurement (SEM) values were used to determine the within- and between- day intra-rater test-retest reliability of using DrG and a three dimensional motion analysis system. To assess validity, Pearson correlation coefficients were used for two measurement techniques. The measurement for tibial external rotation had high intra-rater test-retest reliability of within-day (ICC=.88) and between-day (ICC=.83) reliability using DrG and of within-day (ICC=.93) and between-day (ICC=.77) reliability using a three-dimentional motion analysis system. Tibial external rotation angle measurement using DrG was highly correlated with those of the three-dimensional motion analysis system (r=.86). These results represented that the tibial external rotation angle measurement using DrG showed acceptable reliability and validity compared with the use of three-dimensional motion analysis system.

• 컴퓨터교육학회논문지
• /
• 제17권2호
• /
• pp.39-51
• /
• 2014

서답형 문항이 포함된 대규모 평가에서 학생들의 답안이 어떻게 채점자들에게 분배되고 어떠한 체계적인 채점 과정을 거쳐야 하는 지에 대한 채점의 효율성은 전반적인 평가의 성공에 중요한 사안이다. 서답형 문항 채점에서 채점자 신뢰도를 확보하기 위해 채점자의 채점 결과가 얼마나 일관성이 있으며, 또한 채점자 간의 채점 결과 또한 서로 일관성을 유지해야하는 것이 중요하다. 이 연구의 목적은 지필 평가로 시행된 서답형 문항 채점을 위한 온라인 채점 시스템을 설계하고 개발한 후, 이를 시행한 결과를 기반으로 온라인 채점 시스템에 대한 신뢰도를 확인하고자 하였다. 이러한 서답형 문항 온라인 채점은 채점자들의 채점 과정에 대한 정보로, 기존의 전통적인 채점 방식과의 비교와 함께 채점자 내 및 채점자 간의 신뢰도를 제공하고 있다. 그 결과로 온라인 채점 시스템이 신뢰롭고 타당한 서답형 문항 채점 결과를 얻는데 효과적이었다는 것을 알 수 있었다.

• 한국콘텐츠학회논문지
• /
• 제20권9호
• /
• pp.511-519
• /
• 2020

본 연구의 목적은 수정된 노팅엄 감각평가(rNSA)를 한국판으로 번역하고 검증하는 것이었다. 수정된 rNSA를 한국어로 번역하기 위해 번안/역번안 과정을 사용하여 단면 연구가 수행되었고, 한국판 rNSA의 유효성을 조사하기 위하여 평가자간 및 평가자내 신뢰도, 내적일관성 및 동시타당도를 조사하였다. 한국판 rNSA는 평가자간 신뢰도(r=0.92-1.00), 평가자내 신뢰도(r=0.93-1.00)로 높은 신뢰도를 확인하였고, 한국판 Fugl Meyer의 감각항목과의 유의한 상관관계(r=0.96)를 확인하였다. 한국판 rNSA의 내적일치도에 대한 Cronbach 값은 0.73-0.90의 범위이고, 한국판 Fugl Meyer의 감각항목의 Cronbach 값은 0.70-0.88의 범위였다. 이 결과로, 한국판 rNSA의 신뢰도 및 타당도를 확인하였으며, 임상환경에서 뇌졸중 이후 감각기능을 평가하는 것이 가능할 수 있다고 생각한다.

• 한국전문물리치료학회지
• /
• 제19권4호
• /
• pp.46-54
• /
• 2012

Ely's test is commonly used to assess rectus femoris muscle flexibility. however, a reliability limit of this test was demonstrated by a previous study. In this study, we present an alternative method using an application for a digital horizontal level in a smartphone (DHLS) to complement the reliability limit of Ely's test. The aim of this study was to examine the reliability of Ely's test using DHLS on the pelvis, compared to using visual observation (VO) of pelvic and hip motions. Nineteen patients with lumbar extension-rotation syndrome were recruited for this study. An examiner examined the rectus femoris flexibility (both pass/fail and goniometer scoring) through Ely's test using both DHLS and VO. A retest session was completed two hours later for within-day reliability and seven days later for between-day intra-rater test-retest reliability. Results showed higher Kappa values for pass/fail scoring and higher intraclass correlation coefficient values for goniometer scoring in Ely's test using DHLS, compared to using VO. Measurement error and Bland and Altman plots further demonstrated the degree of intra-rater variance during Ely's test using DHLS in a clinical setting, compared to using VO. These results demonstrated that Ely's test using DHLS showed acceptable reliability compared to using VO. Ely's test using DHLS could be widely used for measuring the rectus femoris muscle flexibility in patients with lumbar extension-rotation syndrome, although the inter-rater reliability needs to be established first.

• The Journal of Korean Physical Therapy
• /
• 제27권3호
• /
• pp.154-158
• /
• 2015

Purpose: The purpose of this study was to propose a new reference point for measurement of the infrasternal angle and to investigate the intra- and inter-rater reliabilities of infrasternal angle measurement using photographs. Methods: Twenty-four healthy male college students participated as subjects in this study. Photographs were taken of subjects in two postures, one standing with the shoulders relaxed and one standing with the shoulders at $150^{\circ}$ abduction. All photographs were analyzed using Image J software. Raters used the photographs to measure the infrasternal angle between the xiphoid process, the medial margin of rib and navel on the right and left sides. The reliability of the infrasternal angle measurement was assessed by means of intraclass correlation coefficients [ICC (3,1)]. The level of statistical significance was set at p<0.05. Results: The intra- and inter-rater reliabilities of the infrasternal angle measurement for the right side at rest were excellent (ICC=0.866 and 0.813, respectively), as were those for the left side at rest (ICC=0.919 and 0.846, respectively). At $150^{\circ}$ shoulder abduction, the intra- and inter-rater reliabilities for measurement of the infrasternal angle on the right side were excellent (ICC=0.972 and 0.778, respectively), as were those for the left side (ICC=0.914 and 0.826, respectively). Conclusion: These findings suggest that this technique can be successfully used to measure the infrasternal angle, thus suggesting a new reference point for determining the length of the internal oblique and external oblique muscles in clinical situations.