• 제목/요약/키워드: interobserver reliability

검색결과 38건 처리시간 0.036초

Reliability of cone-beam computed tomography for temporomandibular joint analysis

  • Gorucu-Coskuner, Hande;Atik, Ezgi;El, Hakan
    • 대한치과교정학회지
    • /
    • 제49권2호
    • /
    • pp.81-88
    • /
    • 2019
  • Objective: The aim was to assess the intraobserver and interobserver reliabilities of temporomandibular joint linear measurements and condylar shape classifications performed with cone-beam computed tomography (CBCT). Methods: CBCT images of 30 patients were measured at two different time points by two orthodontists using the Dolphin 3D program (n = 60). Anterior, posterior, and superior joint space measurements and sagittal joint morphology classification in the sagittal view and medial and lateral joint space and mediolateral width measurements and coronal joint morphology classification in the coronal view were recorded. Intraclass-interclass correlation coefficients (ICC) and kappa statistics were used to assess intraobserver and interobserver reliability for the measurements and morphology classifications, respectively. Results: The ICC values were good for measurements of the posterior joint space by observer I and for measurements of the posterior, medial, and lateral joint spaces by observer II, while the other intraobserver measurements were excellent. Only the mediolateral width measurements showed excellent interobserver ICC values, while the other measurements showed good interobserver ICC values. Intraobserver agreement for the sagittal morphology classifications was moderate (${\kappa}=0.479$) and almost perfect (${\kappa}=0.858$) for observers I and II, respectively, while the corresponding agreement for the coronal morphology classifications was substantial for both observers. The interobserver agreement values for sagittal and coronal morphology classifications were slight (${\kappa}=0.181$) and fair (${\kappa}=0.265$), respectively. Conclusions: Linear temporomandibular joint measurements were reproducible and reliable in both intraobserver and interobserver evaluations. However, interobserver agreement for assessments of condylar shape was low.

나선형 단층 방사선사진에서 치조정 판독 신뢰도 (Reliability of spiral tomography on the alveolar crest)

  • 윤숙자
    • Imaging Science in Dentistry
    • /
    • 제34권3호
    • /
    • pp.123-128
    • /
    • 2004
  • Purpose: To evaluate the reliability of measurements in spiral tomography through assessing the visibility of the alveolar crest and the measurements between the alveolar crest and other anatomic structures. Materials and Methods: 110 spiral tomograms of the jaws were taken by Scanora X-ray unit from the patients. The visibility of the alveolar crests was estimated by 3 observers and classified as clearly visible, questionable visibility, or not visible. 3 observers measured the distance between the alveolar crest and the reference points of anatomic structures. The measurements were repeated 2 weeks later. Results: 52.9% of alveolar crests on upper jaws and 61.5% of alveolar crests on lower jaws were visible. The interobserver and intraobserver agreements on the visibility were low. The mean ranges of the measurements were 1.39 mm (SD = 1.37 mm) on maxilla and 1.03 mm (SD = 1.01 mm) on mandible in the interobserver evaluation. The interobserver variance was greater than the intraobserver variance in the measurements of distance. Conclusion: Spiral tomography showed a relatively low reliability in the visibility and measurements of the alveolar crest.

  • PDF

Modified Barthel Index 및 Motor Assessment Scale을 이용한 검사자간의 신뢰도 검사 (Interobserver Reliabilities of Modified Barthel Index, and Motor Assessment Scale in Stroke Patients)

  • 고성규;김춘배
    • 대한한의학회지
    • /
    • 제20권1호
    • /
    • pp.60-65
    • /
    • 1999
  • We have conducted a study of the interobserver reliabilities of Modified Barthel Index and Motor Assessment Scale with 30 patients hospitalized with strokes in the department of circulatory internal medicine, Sang Ji University Oriental Hospital. The observations were performed by two staff and residents in the circulatory internal medicine department. Raters were assigned in random pairs to individual patients. Evaluations were performed independently by the two observers. In order to minimize the impact of fluctuations in the patients' clinical status, the second set of observations immediately followed the first. Each patient was used for only one pair of evaluations. The results were as follows. 1. Mean kappa value of 13 items in Modified Barthel Index(MBD was 0.742, which indicated excellent interobserver reliability. The kappa values indicated almost $perfect({\kappa}:\;0.81-1.00)$ for 4, substantial for $9({\kappa}:\;0.61-0.80)$, and moderate for $2({\kappa}:\;0.41-0.60)$ of 13 items. All items. except Grooming item, showed statistically significant interobserver agreement(p<0.01) 2. Mean kappa value of 8 items. except General tonus, in Motor Assessment Scale(MAS) was 0.823, which indicated excellent interobserver reliability. and this value of Motor Assessment Scale was more high than MBI' s value. 0.81. The kappa values indicated almost perfect for 5, substantial for 3 of 8 items. All items showed statistically significant interobserver agreement(P<0.01).

  • PDF

청각적(聽覺的) 성음분석(聲音分析)을 통한 사상체질진단(四象體質診斷)에 관한 연구(硏究) (A Study on the Sasang Constitutional Diagnosis by Perceptual Voice Analysis)

  • 유준상;김달래
    • 사상체질의학회지
    • /
    • 제16권3호
    • /
    • pp.46-58
    • /
    • 2004
  • 1. Objectives This study was performed by means of perceptual evaluation of the voices of Sasang Constitution. 2. Methods 73 female subjects were classified by means of 3 kinds of Questionnaire papers(QSCCII, QSCCI, Sasang Pattern Identification Questionnaire). So they were categorized into 3 groups, 23 Soyangin, 28 Taeumin and 22 Soeumin. 73 voice samples were presented three times to a group of 5 judges. The time interval between ratings was 14 days. The four goals of this study were to evaluate the intraobserver reliability between each rating, to evaluate the interobserver reliability, to evaluate the reliability between the each rating and Questionnaire result and to make the notion of the consensus of Sasang Constitution's Voice. 3. Results & Conclusions The intraobserver reliability between the first and second rating showed significance statistically among all observers. And the intraobserver reliability between the second and third rating showed significance except one observer. The interobserver reliability among the three ratings showed significance statistically except one to two observers in the first rating and other one to another one in the second rating. In the reliability between the each rating and Questionnaire result, one in the first rating, other one in the second rating and another two in the third rating showed significance. To make the notion of the consensus of Sasang Constitution's Voice, classification into 4 categories was made: clear/hoarse, high/low, fast/slow, powerful/powerless. The voice of Soyangin group was classified as powerful and fast, and that of Taeumin group as powerful, hoarse and low and that of Soeumin group as powerless and slow.

  • PDF

근위 갈매기 절골술 시행 전과 후의 원위 중족골 관절면각의 측정에 대한 신뢰성의 변화 (Change of Reliability for Distal Metatarsal Articular Angle Measurement before and after Proximal Chevron Osteotomy)

  • 박철현;이동열
    • 대한족부족관절학회지
    • /
    • 제20권4호
    • /
    • pp.145-151
    • /
    • 2016
  • Purpose: To evaluate the reliability of preoperative and postoperative distal metatarsal articular angle (DMAA) measurements and to determine whether such reliability is different in accordance with the foot and ankle fellowship and the number of years in practice. Materials and Methods: Between July 2012 and June 2014, a total of 20 patients (24 feet) were treated with proximal chevron osteotomy and distal soft tissue procedure for symptomatic hallux valgus deformity. DMAA were measured twice with an interval of two weeks between the preoperative and postoperative dorsoplantar radiographs by four observers; two of whom were foot and ankle surgeons (A and B), one knee surgeon, and one senior resident. The intraobserver reproducibility and interobserver reliability were assessed by intraclass correlation coefficients. Moreover, the limit of agreement between the preoperative and postoperative DMAA measurements were assessed using a Bland-Altman plot. Results: The intraobserver reproducibility of the foot and ankle surgeon A, knee surgeon, and senior resident improved from 0.796, 0.575, and 0.586 preoperatively to 0.968, 0.864, and 0.864 postoperatively, respectively. The interobserver reliability of foot and ankle surgeon A-B, foot and ankle surgeon A-knee surgeon, and foot and ankle surgeon A-senior resident improved from 0.874, 0.688, and 0.677 preoperatively to 0.971, 0.917, and 0.838 postoperatively, respectively. Conclusion: The intra- and interobserver reliabilities for DMAA measurement improved after proximal chevron osteotomy. Therefore, the necessity of additional procedures to correct the increased DMAA should be reevaluated after proximal chevron osteotomy in the hallux valgus with an increased DMAA.

Reliability and Validity of a Force-Sensing Resistor for the Measurement of Static Hindlimb Weight Distribution in Beagle Dogs

  • Heo, Su-Young;Jeong, Heejun;Jeong, Jaemin;Jeong, Seong Mok;Lee, HaeBeom
    • 한국임상수의학회지
    • /
    • 제35권5호
    • /
    • pp.206-210
    • /
    • 2018
  • The purpose of this study was to evaluate the reliability and validity of the Force-Sensing Resistor (FSR) for measurement of static hindlimb weight distribution in beagle dogs and to compare these results to a Digital Weighing Scale (DWS). Nine healthy beagle dogs were recruited for this study. Static weight distribution was evaluated four times at intervals of 5 days with each device and two observers to calculate the intra- and interobserver reliability. The intraclass correlation coefficient (ICC) values of the FSR for intraobserver reliability were moderate to good (0.74). The results for the DWS showed poor to moderate (0.56) ICC values for intraobserver reliability. The ICC values for interobserver reliability were 0.53 and 0.61 for FSR and DWS, respectively, indicating poor to moderate agreement. Our findings suggest that the Force-Sensing Resistor can be used to measure static weight distribution in veterinary medicine. However, caution should be taken when comparing measured values of static weight distribution obtained utilizing both the FSR and DWS due to their low positive correlation (R = 0.41, p < 0.01).

Measurement of Apparent Diffusion Coefficient Values from Diffusion-Weighted MRI: A Comparison of Manual and Semiautomatic Segmentation Methods

  • Kim, Seong Ho;Choi, Seung Hong;Yoon, Tae Jin;Kim, Tae Min;Lee, Se-Hoon;Park, Chul-Kee;Kim, Ji-Hoon;Sohn, Chul-Ho;Park, Sung-Hye;Kim, Il Han
    • Investigative Magnetic Resonance Imaging
    • /
    • 제19권2호
    • /
    • pp.88-98
    • /
    • 2015
  • Purpose: To compare the interobserver and intraobserver reliability of mean apparent diffusion coefficient (ADC) values using contrast-enhanced (CE) T1 weighted image (WI) and T2WI as structural images between manual and semiautomatic segmentation methods. Materials and Methods: Between January 2011 and May 2013, 28 patients who underwent brain MR with diffusion weighted image (DWI) and were pathologically confirmed as having glioblastoma participated in our study. The ADC values were measured twice in manual and semiautomatic segmentation methods using CE-T1WI and T2WI as structural images to obtain interobserver and intraobserver reliability. Moreover, intraobserver reliabilities of the different segmentation methods were assessed after subgrouping of the patients based on the MR findings. Results: Interobserver and intraobserver reliabilities were high in both manual and semiautomatic segmentation methods on CE-T1WI-based evaluation, while interobserver reliability on T2WI-based evaluation was not high enough to be used in a clinical context. The intraobserver reliability was particularly lower with the T2WI-based semiautomatic segmentation method in the subgroups with involved $lobes{\leq}2$, with partially demarcated tumor borders, poorly demarcated inner margins of the necrotic portion, and with perilesional edema. Conclusion: Both the manual and semiautomatic segmentation methods on CE-T1WI-based evaluation were clinically acceptable in the measurement of mean ADC values with high interobserver and intraobserver reliabilities.

What is the interobserver agreement of displaced humeral surgical neck fracture patterns?

  • Reinier W. A. Spek;Laura J. Kim
    • Clinics in Shoulder and Elbow
    • /
    • 제25권4호
    • /
    • pp.304-310
    • /
    • 2022
  • Background: The Boileau classification distinguishes three surgical neck fracture patterns: types A, B, and C. However, the reproducibility of this classification on plain radiographs is unclear. Therefore, we questioned what the interobserver agreement and accuracy of displaced surgical neck fracture patterns is categorized according to the modified Boileau classification. Does the reliability to recognize these fracture patterns differ between orthopedic residents and attending surgeons? Methods: This interobserver study consisted of a randomly retrieved series of 30 plain radiographs representing clinical practice in a level 1 and a level 2 trauma center. Radiographs were included from patients (≥18 years) who sustained an isolated displaced surgical neck fracture if they were taken ≤1 week after initial injury. A ground truth was established by consensus among three senior orthopedic surgeons. All images were assessed by 17 orthopedic residents and 17 attending orthopedic trauma surgeons. Results: Agreement for the modified Boileau classification was fair (κ=0.37; 95% confidence interval [CI], 0.36-0.38) with an accuracy of 62% (95% CI, 57%-66%). Comparison of interobserver variability between residents and attending surgeons revealed a significant but clinically irrelevant difference in favor of attending surgeons (0.34 vs. 0.39, respectively, Δκ=0.05, 95% CI, 0.02-0.07). Conclusions: The modified Boileau classification yields a low interobserver agreement with an unsatisfactory accuracy in a panel of orthopedic residents and attending surgeons. This supports the hypothesis that surgical neck fractures are challenging to categorize and that this classification should not be used to determine prognosis if only plain radiographs are available.

Interobserver and Intraobserver Reliability of Sub-Axial Injury Classification and Severity Scale between Radiologist, Resident and Spine Surgeon

  • Lee, Woo Jin;Yoon, Seung Hwan;Kim, Yeo Ju;Kim, Ji Yong;Park, Hyung Chun;Park, Chon Oon
    • Journal of Korean Neurosurgical Society
    • /
    • 제52권3호
    • /
    • pp.200-203
    • /
    • 2012
  • Objective : The sub-axial injury classification (SLIC) and severity scale was developed to decide whether to operate the cervical injured patient or not, but the reliability of SLIC and severity scale among the different physicians was not well known. Therefore, we evaluated the reliability of SLIC among a spine surgeon, a resident of neurosurgery and a neuro-radiologist. Methods : In retrograde review in single hospital from 2002 to 2009 years, 75 cases of sub-axial spine injured patients underwent operation. Each case was blindly reviewed for the SLIC and severity scale by 3 different observers by two times with 4 weeks interval with randomly allocated. The compared axis was the injury morphology score, the disco-ligamentous complex score, the neurological status score and total SLIC score; the neurological status score was derived from the review of medical record. The kappa value was used for the statistical analysis. Results : Interobserver agreement of SLIC and severity scale was substantial agreement in the score of injury morphology [intraclass correlation (ICC)=0.603] and total SLIC and severity sacle (ICC value=0.775), but was fair agreement in the disco-ligamentous complex score (ICC value= 0.304). Intraobserver agreements were almost perfect agreement in whole scales with ICC of 0.974 in a spine surgeon, 0.948 in a resident of neurosurgery, and 0.963 in a neuro-radiologist. Conclusion : The SLIC and severity scale is comprehensive and easily applicable tool in spine injured patient. Moreover, it is very useful tool to communicate among spine surgeons, residents of neurosurgery and neuro-radiologists with sufficient reproducibility.

무지 외반증 각변형에 대한 디지털영상의 전산화 계측: 100%와 150% 확대영상에서의 계측비교 (Computerized Measurement on Angular Parameters for Hallux Valgus: Comparison of 100% and 150% Magnified Digital Radiography)

  • 성일훈;이두연;성창호;서우영
    • 대한족부족관절학회지
    • /
    • 제16권1호
    • /
    • pp.53-57
    • /
    • 2012
  • Purpose: To study computerized measurements of angular parameters on 100% and 150% resized digital radiography of hallux valgus deformity Materials and Methods: 30 digital radiography of standing foot anteroposterior view of hallux valgus patients were included. Two observers(A, B) independently measured hallux valgus angle (HVA), 1-2 intermetatarsal angle (IMA), and distal metatarsal articular angle (DMAA) in two times on both 100%-size and 150% magnified images respectively, using computerized measurement software tools. The results were interpreted with the statistical software program, Statistical Analysis System, version 9.2. Results: In repeated measurements of each observer, measurements on 150% magnified image showed no differences of all three parameters and with 100%-size image, there were differences of HVA (observer A) and 1-2 IMA (observer B) (p>0.05). When testing interobserver reliability, both observers showed differences in measurement of HVA and DMAA (p<0.05), but no differences in measurement of 1-2 IMA in both images. Within the 95% confidence interval, limits of error of measurements between two observers on HVA, IMA and DMAA were $2.7^{\circ}$ $1.4^{\circ}$ and $5.0^{\circ}$ respectively in 100%-size images, and $2.6^{\circ}$, $1.6^{\circ}$ and $4.7^{\circ}$ respectively in 150% magnified images. Conclusion: In computerized measurements for angular parameters of hallux valgus with digital radiography, 150% magnified images showed intraobserver reliability. Both 100% and 150% magnified images failed to show interobserver reliability. Measurement of 1-2 IMA in both 100% and 150% images showed less interobserver error.