• The Journal of Korean Physical Therapy
• /
• 제27권5호
• /
• pp.311-314
• /
• 2015

Purpose: This study attempted to determine intra-rater reliability and inter-rater reliability for measurement of foot form using the FPI-6 (Foot Posture Index) in patients with hemiplegia caused by stroke. Methods: Twenty two stroke patients were recruited into the research and their foot posture was evaluated using the FPI. Two raters assessed 6 items sequentially in accordance with the FPI-6 manual. This procedure involved asking the subject to take several steps in-place, prior to settling into a comfortable stance position with double limb support. Subjects were instructed to stand still with their arms by their sides and look straight ahead. FPI-6 values ranged from -2 to +2 for each of the six criteria and from -12 to +12 for the total score, indicating a position for each foot either along the supinated (negative score) to pronated (more than +6) continuum of foot posture. Results: The results showed that intra-rater reliability and inter-rater reliability for a total FPI-6 score was high: 0.807-0.888. An almost perfect agreement between the two raters was identified in the foot's morphological classification (Somer's D=0.712; p<0.05). Intra-percentage agreement was high (88.6%). Conclusion: The FPI-6 is a quick, simple, and reliable clinical tool with demonstrated good to excellent intra-rater reliability and good inter-rater reliability when used in assessment of the stroke patient's foot.

• 간호행정학회지
• /
• 제4권1호
• /
• pp.107-127
• /
• 1998

The purpose of this study was to develop an evaluation tool for the quality of nursing care in abdominal surgery patient. The target subjects of the tool were adult patients having abdominal surgery under general anesthesia. Process-outcome framework was selected for the development of the tool in this study. The results were as follows. 1. Nine standards. 40 criteria and 88 indicators were developed. A standard was summary statement of the ideal level of excellencein a dimension of quality of nursing care. which could be evaluated by criteria. Several criteria indicated a specific standard and each criterion could be measured by observable and measurable indicators. 2. The standards were divided into two dimensions. One was process dimension which contained four standards(23 criteria), the other was outcome dimension which contatined five standards(17 criteria). 3. Average CVI was .985 at 9 standards. .947 at 40 criteria. and .987 at 88 indicators. 4. The evaluation tool for the quality of nursing care in abdminal surgery patients was a criterion-referenced tool. And data collection methods of the tool were investigation of patient's record and interview( or questionnaire) with the patients. 5. Interrater reliabilities of the tool were ; r= .7572 (agreement between two raters), and pI=.8487 (intraclass correlation between five raters who rated the 84 patients). 6. Internal consistency reliability ${\alpha}$ was .6194, which was obtained from 32 criteria. Eight criteria were missed in the analyzing process because of data omission. 7. Scores of the process and the outcome dimensions showed significant. but low correlation(r= .3759, p < .001). 8. There were significant differences in total scores between the hospitals and the departments of surgery(F = 15.233. p .0001). There was also significant interaction effect between hospitals and departments to total score(F = 8.396. p = .0001). Construct validity of the toool was verified by the known-group method. these kinds of difference were expected by the nursing experts participated in the study. From these results, more specific patient classification is suggested for the development of evaluation tool of the quallity of nursing care. And indicators to be used for objective measurement for the quality of nursing care must be developed.

• The Journal of Korean Physical Therapy
• /
• 제23권4호
• /
• pp.45-51
• /
• 2011

Purpose: To determine the correct measurement methods of the ankle joint complex range of motion for measuring the neutral position and evaluate the rater reliability. In addition, the impact of training on the rater reliability was also assessed. Methods: The subjects were eleven healthy women, who were evaluated by two physical therapists and one physical therapist recorded the results of the study. Standard goniometer was used as the measurement tool. The ankle and subtalar joint neutral position and the active range of motion of the ankle and subtalar joint were measured. Intra-rater reliability and inter-rater reliability measures were analyzed with intraclass correlation coefficients. Results: Intra-rater reliability and inter-rater reliability ranged from high to medium for the neutral position of the ankle joint complex. Intra-rater reliability for dorsiflexion and plantarflexion measurements was medium, while the inter-rater reliability was high. The range of motion of the subtalar joint was measured, and the intra-rater reliability and inter-rater reliability were low and medium, respectively Also, the intra-rater reliability was increased with formal training of the measurement techniques. Intra-rater reliability was reduced in case the raters had not undertaken the training. Conclusion: In summary, the results obtained with the measurement tools and joint measurement of position, indicate the consistency of repeated measurements made by the same observers. Under the same circumstances along with repetition of the same measurement technique during training caused an increase in the rater reliability of formally trained raters.

• Journal of Preventive Medicine and Public Health
• /
• 제30권4호
• /
• pp.719-728
• /
• 1997

To guarantee the inter-reviewer reliability is very important in evaluating the quality of large number of clinical research papers by multiple reviewers. We cannot find reports on statistical methods for evaluating reliability for multiple raters in clinical research field. The purpose of this paper is to introduce the statistical methods focused on kappa statistic and five kinds of loglinear models for, which can be applied when evaluating the reliability of multiple raters. We have applied these methods to the result of a project, in which seven reviewers have evaluated the quality of 33 papers with regard to four aspects of paper contents including study hypothesis, study design, study population, study method, data analysis and interpretation. Among the five loglinear models including Symmetry model, Conditional symmetry model, Quasi-symmetry model, Independence model, and Quasi-independence model, Quasi-symmetry model shows the best model of fitting. And the level of reliability among seven reviewers revealed to be acceptable as meaningful.

• Imaging Science in Dentistry
• /
• 제47권3호
• /
• pp.141-147
• /
• 2017

Purpose: The objective of this study was to compare the outcomes of surgical mini-implant placement when potential mini-implant sites were scanned using a lower-dose $180^{\circ}$ acquisition protocol versus a conventional $360^{\circ}$ acquisition protocol. Materials and Methods: Ten dentate human skulls were used to provide sites for potential mini-implant placement. The sites were randomly divided into 2 groups: $360^{\circ}$ and $180^{\circ}$ cone-beam computed tomography (CBCT) acquisition protocols. A small-volume $180^{\circ}$ CBCT scan and a $360^{\circ}$ CBCT scan of each site were acquired using a Morita Accuitomo-170 CBCT machine and then a mini-implant was placed. A follow-up $360^{\circ}$ CBCT scan was done as a gold standard to evaluate the location of the mini-implant and root perforation. Two raters evaluated the scans. Results: Ninety-eight percent of the mini-implants placed did not perforate any root structure. Two percent of the sites had an appearance suggestive of perforation. On a Likert scale, both raters agreed that their subjective evaluation of the diagnostic quality of the protocols, ability to make and read measurements of the sites, and preferences for the specified diagnostic task were comparable. The Cohen kappa showed high inter-rater and intrarater agreement. Conclusion: In this ex vivo study, we found that the $180^{\circ}$ rotational acquisition was as effective as the conventional $360^{\circ}$ rotational acquisition for the preoperative evaluation of potential mini-implant sites.

• 대한통합의학회지
• /
• 제9권2호
• /
• pp.63-73
• /
• 2021

Purpose : Selective functional movement assessment(SFMA) is a movement-based assessment tool designed for clinicians to diagnose and treat pain and functional physical problems. This concept is used for assistance in occupations related to movement, including clinical medical personnel, such as physical therapists, physical education instructors, and athlete coaches. Although this concept is widely used by clinicians, research and scientific proofs are relatively insufficient. This study aimed to review the literature on the understanding, reliability and effectiveness of SFMA, and to consider its role in the future of rehabilitation. Methods : In this review, a total of nine articles were selected according to the eligibility criteria of three major thesis topics. The main topics covered in the literature are reliability and effectiveness of clinical use of SFMA. To gather research articles, we searched official term 'Selective Functional Movement Assessment'. Among the searched 60 studies, nine were mentioned in this study that contained overlapping information and matched our desired topic. We reviewed four reliability analyses, four case reports, and one experimental study. Results : Reliability has an intermediate degree between high raters and within raters. The validity of the SFMA system is influenced by a combination of experience and logic; hence, further improvement is needed. Therefore, if the intervention was effective based on the diagnosis result, then biomechanical evidence is necessary to further support the claim. Conclusion : In future research, to use SFMA as a diagnostic tool with high accuracy, it is necessary to improve the reliability of the main problem through breakout, support for guidelines and validity and efficiency.

• Journal of Acupuncture & Meridian Studies
• /
• 제11권6호
• /
• pp.367-374
• /
• 2018

This study describes the reliability of pragmatic combinations of acupuncture points for lateral epicondylalgia (LE) as prescribed by physiotherapists who were experts in acupuncture. Raters (n = 14; 33-59 years) independently prescribed acupuncture points for 30 simulated human patients with LE who were surveyed via a printed questionnaire. The frequency and cooccurrence of acupuncture points prescribed for patients with lateral epicondylitis were assessed. Absolute agreement and Light's kappa (${\kappa}_{Light}$) with 95% confidence interval (CI) were used to quantify the interrater agreement. Raters prescribed 103 unique acupuncture points in different combinations with a median (min-max) of 5 (0-11) acupuncture points. The most prescribed acupuncture point was LI-11 (297 of 420; 71%), and the most common cooccurring acupuncture points were LI-11 and LI-4 (160 of 420; 38%). The absolute agreement for prescribing the acupuncture points ranged from 70% (point GB-20) to 0% (points LI-10, SP-6, LI-11, GB-34, LI-12, and LI-4). Point LR-3 showed the highest interrater reliability for prescribing the acupuncture points [${\kappa}_{Light}=0.112$, 95% CI = (0.055-0.194)], whereas point LI-4 showed the lowest reliability [${\kappa}_{Light}=-0.003$, 95% CI = (-0.024 to 0.024)]. These findings suggest that pragmatic prescriptions of acupuncture points for LE are unreliable among physiotherapists who are experts in acupuncture. Explicit, high-level evidence-based rules for prescribing and teaching combinations of acupuncture points for LE are warranted.

• 대한통합의학회지
• /
• 제10권4호
• /
• pp.137-143
• /
• 2022

Purpose : The purpose of this study was to evaluate the reliability analysis of the deep tendon reflex by using electromyography (EMG). Methods : The study was tested on 30 volunteers who are women in their 20s. Using an electronic reflective hammer of EMG, deep tendon reflex was measured on all subjects with the participation of three trained physical therapists as raters. First, the subjects were comfortably seated on a table with their knees bent at 90 °. The three raters tapped the electric hammer at intervals of 10 seconds to avoid habituation until a total of 10 compound muscle action potential records were collected. Intraclass correlation coefficients (ICCs) were calculated to assess the inter-rater reliability of the deep tendon reflex with the use of EMG. The items of analysis included amplitude (mV), latency (ms), duration (ms), and area (mV × ms) of the compound evoked potentials. Results : Based on the average records of 10 compound muscle action potential, excellent reliability (ICC: .912) was achieved in terms of area, and there was good reliability in terms of latency (ICC: .795) and duration (ICC: .800). In the shortest latency of the compound muscle action potential, good reliability was achieved in terms of amplitude (ICC: .865), duration (ICC: .781), and area (ICC: .832). In the amplitude of peak-to-peak of compound muscle action potential, excellent reliability was recorded in terms of amplitude (ICC: .924), and good reliability was recorded in terms of duration (ICC: .801) and area (ICC: .874). Conclusion : The findings in this study indicate that electromyography via an electric hammer is a reliable method of assessing and measuring deep tendon reflexes. Especially, it may be an excellent gauge in the area of average values of the compound muscle action potentials and the amplitude of peak-to-peak of compound muscle action potentials.

• 한국수학교육학회지시리즈E:수학교육논문집
• /
• 제26권3호
• /
• pp.251-271
• /
• 2012

이 연구는 관찰 추천 수학영재선발 시 사용되는 자기소개서와 교사추천서 평가에서 발생하는 오차요인들의 상대적인 영향력을 살펴보고, 교사추천서와 자기소개서를 총체적 채점과 분석적 채점으로 실시했을 때 채점 방법에 따른 일반화가능도계수의 최적화 측정 조건을 탐색하고, 이를 전통적인 신뢰도 추정방법과 비교하였다. 2011학년도 수도권에 소재하고 있는 대학부설 과학영재교육원에서 관찰-추천 영재 선발에 지원한 90명의 자기소개서와 교사추천서에 대해 총체적 채점과 분석적 채점으로 2명의 교사가 각각 점수를 부여하였다. 연구결과는 다음과 같다. 첫째, 교사추천서와 자기소개서의 평가에 있어 채점방법에 따른 공통점은 피험자 관련 분산이 크게 나타났으며, 차이점은 총체적 채점이 분석적 채점보다 채점자의 영향이 더 큰 것으로 나타났다. 둘째, 적정수준의 일반화가능도계수를 얻기 위해서 채점자를 2명으로 고정하는 경우 교사추천서와 자기소개서에서 총체적 채점은 각각 내용영역이 5개, 10개 이상이 요구되어졌으며, 분석적 채점은 각각 내용영역을 4개로 고정한 경우 문항이 3개 이상, 내용영역을 6개로 고정한 경우 문항이 8개 이상이 요구되어졌다. 셋째, 교사추천서와 자기소개서 모두 채점 방법과 상관없이 문항만을 오차요인으로 보는 Cronbach ${\alpha}$가 신뢰도를 과대 추정하는 것으로 나타났다. 따라서 적정수준의 신뢰도를 확보하기 위해서는 채점자, 내용영역, 문항수와 같이 다양한 오차요인을 반영하는 일반화가능도 계수를 고려하는 것이 바람직할 것이다.

• 대한음성학회지:말소리
• /
• 제62호
• /
• pp.19-32
• /
• 2007

This study investigated the perception of emotional voices by transplanting some or all of the prosodic aspects, i.e. pitch, duration, and intensity, of the utterances produced with emotional voices onto those with normal voices and vice versa. Listening evaluation by 24 raters revealed that prosodic effect was greater than segmental & vocal quality effect on the preception of the emotion. The degree of influence of prosody and that of segments & vocal quality varied according to the type of emotion. As for fear, prosodic elements had far greater influence than segmental & vocal quality elements whereas segmental and vocal elements had as much effect as prosody on the perception of happy voices. Different amount of contribution to the perception of emotion was found among prosodic features with the descending order of pitch, duration and intensity. As for the length of the utterances, the perception of emotion was more effective with long utterances than with short utterances.