• Imaging Science in Dentistry
• /
• v.37 no.4
• /
• pp.191-195
• /
• 2007

Purpose: To study the intra- and interobserver agreement of multidetector row computed tomography (MDCT) in interpretation of degenerative changes of the mandibular condyle. Materials and Methods: Five observers independently evaluated one hundred temporomandibular joint MDCT images for signs of osteophytes, erosion, sclerosis and flattening. The intra- and interobserver agreements were calculated by using Kappa statistics. Results: The intraobserver agreement was substantial for erosion (k=0.75), flattening (k=0.74) and sclerosis (k=0.72) and almost perfect for osteophytes (k=0.84). The interobserver agreement was fair for flattening (k=0.39), moderate for erosion (k=0.58) and sclerosis (k=0.48) and substantial for osteophytes (k=0.75). Conclusion: This study shows that we can expect good agreement for the presence of osteophytes, but not for flattening in the interpretation of MDCT images of the condyle.

• Journal of Korean Neurosurgical Society
• /
• v.30 no.sup2
• /
• pp.254-258
• /
• 2001

Objective : The terminology of degenerative disc disease lacks official standardization. Lacks of such standardization may provoke some clinical and litigation problems. The authors investigated interobserver and intraobserver variability in interpretation of lumbar disc abnormality. Methods : Magnetic resonance imaging studies of the lumbar spine performed prospectively in 50 patients, were read blindly by three doctors dealing spinal disorders, using two nomenclature. Nomenclature I was normal, bulging, protrusion, extrusion. Nomenclature II was normal, bulging, herniation without neural compression, with neural compression. Intraobserver and interobserver variation were measured statistically. Results : Interobserver agreement was 70.4-80.8% for nomenclature I, 76.2-80.2% for nomenclature II. Intraobserver agreement was 84.0-88.0% for nomenclature I, 79.2-86.8% for nomenclature II. Interobserver Kappa statistic was 0.53-0.56 for nomenclature I, 0.54-0.57 for nomenclature II. Intraobserver Kappa statistic was 0.60-0.85 for nomenclature I, 0.53-0.72 for nomenclature II. Conclusion : Experienced doctors showed only moderate interobserver agreement when interpreting disc status on lumbar magnetic resonance imaging. Intraobserver agreement was superior to interbserver. The standardization of nomenclatures for lumbar disc extension beyond interspace are needed.

• The korean journal of orthodontics
• /
• v.49 no.2
• /
• pp.81-88
• /
• 2019

Objective: The aim was to assess the intraobserver and interobserver reliabilities of temporomandibular joint linear measurements and condylar shape classifications performed with cone-beam computed tomography (CBCT). Methods: CBCT images of 30 patients were measured at two different time points by two orthodontists using the Dolphin 3D program (n = 60). Anterior, posterior, and superior joint space measurements and sagittal joint morphology classification in the sagittal view and medial and lateral joint space and mediolateral width measurements and coronal joint morphology classification in the coronal view were recorded. Intraclass-interclass correlation coefficients (ICC) and kappa statistics were used to assess intraobserver and interobserver reliability for the measurements and morphology classifications, respectively. Results: The ICC values were good for measurements of the posterior joint space by observer I and for measurements of the posterior, medial, and lateral joint spaces by observer II, while the other intraobserver measurements were excellent. Only the mediolateral width measurements showed excellent interobserver ICC values, while the other measurements showed good interobserver ICC values. Intraobserver agreement for the sagittal morphology classifications was moderate (${\kappa}=0.479$) and almost perfect (${\kappa}=0.858$) for observers I and II, respectively, while the corresponding agreement for the coronal morphology classifications was substantial for both observers. The interobserver agreement values for sagittal and coronal morphology classifications were slight (${\kappa}=0.181$) and fair (${\kappa}=0.265$), respectively. Conclusions: Linear temporomandibular joint measurements were reproducible and reliable in both intraobserver and interobserver evaluations. However, interobserver agreement for assessments of condylar shape was low.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.1
• /
• pp.263-271
• /
• 2004

This article presents a new measure of chance-corrected interobserver agreement among multivariate ratings of many observers. Modifying an approach by Berry and Mielke, a new agreement measure is proposed. The important modificaton is to use the volume of simplex composed of data points as the disagreement masure. The proposed measure accounts agreement for multivariate interval observations among many observers. Hypothetical and real-life data sets are analyzed for illustrative purpose.

• Clinics in Shoulder and Elbow
• /
• v.25 no.4
• /
• pp.304-310
• /
• 2022

Background: The Boileau classification distinguishes three surgical neck fracture patterns: types A, B, and C. However, the reproducibility of this classification on plain radiographs is unclear. Therefore, we questioned what the interobserver agreement and accuracy of displaced surgical neck fracture patterns is categorized according to the modified Boileau classification. Does the reliability to recognize these fracture patterns differ between orthopedic residents and attending surgeons? Methods: This interobserver study consisted of a randomly retrieved series of 30 plain radiographs representing clinical practice in a level 1 and a level 2 trauma center. Radiographs were included from patients (≥18 years) who sustained an isolated displaced surgical neck fracture if they were taken ≤1 week after initial injury. A ground truth was established by consensus among three senior orthopedic surgeons. All images were assessed by 17 orthopedic residents and 17 attending orthopedic trauma surgeons. Results: Agreement for the modified Boileau classification was fair (κ=0.37; 95% confidence interval [CI], 0.36-0.38) with an accuracy of 62% (95% CI, 57%-66%). Comparison of interobserver variability between residents and attending surgeons revealed a significant but clinically irrelevant difference in favor of attending surgeons (0.34 vs. 0.39, respectively, Δκ=0.05, 95% CI, 0.02-0.07). Conclusions: The modified Boileau classification yields a low interobserver agreement with an unsatisfactory accuracy in a panel of orthopedic residents and attending surgeons. This supports the hypothesis that surgical neck fractures are challenging to categorize and that this classification should not be used to determine prognosis if only plain radiographs are available.

• Imaging Science in Dentistry
• /
• v.44 no.2
• /
• pp.137-141
• /
• 2014

Purpose: This study was performed to investigate the interobserver agreement on the detection of carotid artery calcifications on panoramic radiographs. Materials and Methods: This study consisted of panoramic radiographs acquired from 634 male patients of the age of 50 years or older. Having excluded carotids of no diagnostic quality, 1008 carotids from the panoramic radiographs of the patients were interpreted by two oral and maxillofacial radiologists independently for the presence of carotid artery calcifications. Statistical analysis was used to calculate the interobserver agreement. Results: Interobserver agreement was obtained for 932 carotids (92.4%). Inconsistent interpretation of 76 carotids (7.5%) between the two observers was found. Cohen's kappa value was 0.688 (p<0.001). Conclusion: The probability of a match between the two observers was substantially high.

• The Journal of Korean Medicine
• /
• v.20 no.1 s.37
• /
• pp.60-65
• /
• 1999

We have conducted a study of the interobserver reliabilities of Modified Barthel Index and Motor Assessment Scale with 30 patients hospitalized with strokes in the department of circulatory internal medicine, Sang Ji University Oriental Hospital. The observations were performed by two staff and residents in the circulatory internal medicine department. Raters were assigned in random pairs to individual patients. Evaluations were performed independently by the two observers. In order to minimize the impact of fluctuations in the patients' clinical status, the second set of observations immediately followed the first. Each patient was used for only one pair of evaluations. The results were as follows. 1. Mean kappa value of 13 items in Modified Barthel Index(MBD was 0.742, which indicated excellent interobserver reliability. The kappa values indicated almost $perfect({\kappa}:\;0.81-1.00)$ for 4, substantial for $9({\kappa}:\;0.61-0.80)$, and moderate for $2({\kappa}:\;0.41-0.60)$ of 13 items. All items. except Grooming item, showed statistically significant interobserver agreement(p<0.01) 2. Mean kappa value of 8 items. except General tonus, in Motor Assessment Scale(MAS) was 0.823, which indicated excellent interobserver reliability. and this value of Motor Assessment Scale was more high than MBI' s value. 0.81. The kappa values indicated almost perfect for 5, substantial for 3 of 8 items. All items showed statistically significant interobserver agreement(P<0.01).

• Clinics in Shoulder and Elbow
• /
• v.24 no.2
• /
• pp.98-105
• /
• 2021

Background: Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods: Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss' kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results: The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions: Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.

• Journal of Korean Neurosurgical Society
• /
• v.47 no.2
• /
• pp.89-94
• /
• 2010

Objective : To evaluate the role of cranial sonography and computed tomography in the diagnosis of neonatal intracranial hemorrhage and hypoxic-ischemic injury in an Indian set-up. Methods : The study included 100 neonates who underwent cranial sonography and computed tomography (CT) in the first month of life for suspected intracranial ischemia and hemorrhage. Two observers rated the images for possible intracranial lesions and a kappa statistic for interobserver agreement was calculated. Results : There was no significant difference in the kappa values of CT and ultrasonography (USG) for the diagnosis of germinal matrix hemorrhage/intraventricular hemorrhage (GMH/IVH) and periventricular leucomalacia (PVL) and both showed good interobserver agreement. USG, however detected more cases of GMH/IVH (24 cases) and PVL (19) cases than CT (22 cases and 16 cases of IVH and PVL, respectively). CT had significantly better interobserver agreement for the diagnosis of hypoxic ischemic injury (HII) in term infants and also detected more cases (33) as compared to USG (18). CT also detected 6 cases of extraaxial hemorrhages as compared to 1 detected by USG. Conclusion : USG is better modality for imaging preterm neonates with suspected IVH or PVL. However, USG is unreliable in the imaging of term newborns with suspected HII where CT or magnetic resonance image scan is a better modality.

• Journal of Korean Neurosurgical Society
• /
• v.52 no.3
• /
• pp.200-203
• /
• 2012

Objective : The sub-axial injury classification (SLIC) and severity scale was developed to decide whether to operate the cervical injured patient or not, but the reliability of SLIC and severity scale among the different physicians was not well known. Therefore, we evaluated the reliability of SLIC among a spine surgeon, a resident of neurosurgery and a neuro-radiologist. Methods : In retrograde review in single hospital from 2002 to 2009 years, 75 cases of sub-axial spine injured patients underwent operation. Each case was blindly reviewed for the SLIC and severity scale by 3 different observers by two times with 4 weeks interval with randomly allocated. The compared axis was the injury morphology score, the disco-ligamentous complex score, the neurological status score and total SLIC score; the neurological status score was derived from the review of medical record. The kappa value was used for the statistical analysis. Results : Interobserver agreement of SLIC and severity scale was substantial agreement in the score of injury morphology [intraclass correlation (ICC)=0.603] and total SLIC and severity sacle (ICC value=0.775), but was fair agreement in the disco-ligamentous complex score (ICC value= 0.304). Intraobserver agreements were almost perfect agreement in whole scales with ICC of 0.974 in a spine surgeon, 0.948 in a resident of neurosurgery, and 0.963 in a neuro-radiologist. Conclusion : The SLIC and severity scale is comprehensive and easily applicable tool in spine injured patient. Moreover, it is very useful tool to communicate among spine surgeons, residents of neurosurgery and neuro-radiologists with sufficient reproducibility.