• Title/Summary/Keyword: Fleiss kappa

Search Result 15, Processing Time 0.019 seconds

Diagnostic performance of stitched and non-stitched cross-sectional cone-beam computed tomography images of a non-displaced fracture of ovine mandibular bone

  • Farzane Ostovarrad;Sadra Masali Markiyeh;Zahra Dalili Kajan
    • Imaging Science in Dentistry
    • /
    • v.53 no.4
    • /
    • pp.375-381
    • /
    • 2023
  • Purpose: This study assessed the diagnostic performance of stitched and non-stitched cross-sectional cone-beam computed tomography (CBCT) images of non-displaced ovine mandibular fractures. Materials and Methods: In this ex vivo study, non-displaced fractures were artificially created in 10 ovine mandibles (20 hemi-mandibles) using a hammer. The control group comprised 8 hemi-mandibles. The non-displaced fracture lines were oblique or vertical, <0.5 mm wide, 10-20 mm long, and only in the buccal or lingual cortex. Fracture lines in the ramus and posterior mandible were created to be at the interface or borders of the 2 stitched images. CBCT images were obtained from the specimens with an 80 mm×80 mm field of view before and after fracture induction. OnDemand software (Cybermed, Seoul, Korea) was used for stitching the CBCT images. Four observers evaluated 56 (28 stitched and 28 non-stitched) images to detect fracture lines. The diagnostic performance of stitched and non-stitched images was assessed by calculating the area under the receiver operating characteristic curve (AUC). Sensitivity and specificity values were also calculated (alpha=0.05). Results: The AUC was calculated to be 0.862 and 0.825 for the stitched and non-stitched images, respectively (P=0.747). The sensitivity and specificity were 90% and 75% for the non-stitched images and 85% and 87% for the stitched images, respectively. The inter-observer reliability was shown by a Fleiss kappa coefficient of 0.79, indicating good agreement. Conclusion: No significant difference was found in the diagnostic performance of stitched and non-stitched cross-sectional CBCT images of non-displaced fractures of the ovine mandible.

Semi-Quantitative Scoring of Late Gadolinium Enhancement of the Left Ventricle in Patients with Ischemic Cardiomyopathy: Improving Interobserver Reliability and Agreement Using Consensus Guidance from the Asian Society of Cardiovascular Imaging-Practical Tutorial (ASCI-PT) 2020

  • Cherry Kim;Chul Hwan Park;Do Yeon Kim;Jaehyung Cha;Bae Young Lee;Chan Ho Park;Eun-Ju Kang;Hyun Jung Koo;Kakuya Kitagawa;Min Jae Cha;Rungroj Krittayaphong;Sang Il Choi;Sanjaya Viswamitra;Sung Min Ko;Sung Mok Kim;Sung Ho Hwang;Nguyen Ngoc Trang;Whal Lee;Young Jin Kim;Jongmin Lee;Dong Hyun Yang
    • Korean Journal of Radiology
    • /
    • v.23 no.3
    • /
    • pp.298-307
    • /
    • 2022
  • Objective: This study aimed to evaluate the effect of implementing the consensus statement from the Asian Society of Cardiovascular Imaging-Practical Tutorial 2020 (ASCI-PT 2020) on the reliability of cardiac MR with late gadolinium enhancement (CMR-LGE) myocardial viability scoring between observers in the context of ischemic cardiomyopathy. Materials and Methods: A total of 17 cardiovascular imaging experts from five different countries evaluated CMR obtained in 26 patients (male:female, 23:3; median age [interquartile range], 55.5 years [50-61.8]) with ischemic cardiomyopathy. For LGE scoring, based on the 17 segments, the extent of LGE in each segment was graded using a five-point scoring system ranging from 0 to 4 before and after exposure according to the consensus statement. All scoring was performed via web-based review. Scores for slices, vascular territories, and total scores were obtained as the sum of the relevant segmental scores. Interobserver reliability for segment scores was assessed using Fleiss' kappa, while the intraclass correlation coefficient (ICC) was used for slice score, vascular territory score, and total score. Inter-observer agreement was assessed using the limits of agreement from the mean (LoA). Results: Interobserver reliability (Fleiss' kappa) in each segment ranged 0.242-0.662 before the consensus and increased to 0.301-0.774 after the consensus. The interobserver reliability (ICC) for each slice, each vascular territory, and total score increased after the consensus (slice, 0.728-0.805 and 0.849-0.884; vascular territory, 0.756-0.902 and 0.852-0.941; total score, 0.847 and 0.913, before and after implementing the consensus statement, respectively. Interobserver agreement in scoring also improved with the implementation of the consensus for all slices, vascular territories, and total score. The LoA for the total score narrowed from ± 10.36 points to ± 7.12 points. Conclusion: The interobserver reliability and agreement for CMR-LGE scoring for ischemic cardiomyopathy improved when following guidance from the ASCI-PT 2020 consensus statement.

Diagnosis of Unruptured Intracranial Aneurysms Using Proton-Density Magnetic Resonance Angiography: A Comparison With High-Resolution Time-of-Flight Magnetic Resonance Angiography

  • Pae Sun Suh;Seung Chai Jung;Hye Hyeon Moon;Yun Hwa Roh;Yunsun Song;Minjae Kim;Jungbok Lee;Keum Mi Choi
    • Korean Journal of Radiology
    • /
    • v.25 no.6
    • /
    • pp.575-588
    • /
    • 2024
  • Objective: Differentiating intracranial aneurysms from normal variants using CT angiography (CTA) or MR angiography (MRA) poses significant challenges. This study aimed to evaluate the efficacy of proton-density MRA (PD-MRA) compared to high-resolution time-of-flight MRA (HR-MRA) in diagnosing aneurysms among patients with indeterminate findings on conventional CTA or MRA. Materials and Methods: In this retrospective analysis, we included patients who underwent both PD-MRA and HR-MRA from August 2020 to July 2022 to assess lesions deemed indeterminate on prior conventional CTA or MRA examinations. Three experienced neuroradiologists independently reviewed the lesions using HR-MRA and PD-MRA with reconstructed voxel sizes of 0.253 mm3 or 0.23 mm3, respectively. A neurointerventionist established the gold standard with digital subtraction angiography. We compared the performance of HR-MRA, PD-MRA (0.253-mm3 voxel), and PD-MRA (0.23-mm3 voxel) in diagnosing aneurysms, both per lesion and per patient. The Fleiss kappa statistic was used to calculate inter-reader agreement. Results: The study involved 109 patients (average age 57.4 ± 11.0 years; male:female ratio, 11:98) with 141 indeterminate lesions. Of these, 78 lesions (55.3%) in 69 patients were confirmed as aneurysms by the reference standard. PD-MRA (0.253-mm3 voxel) exhibited significantly higher per-lesion diagnostic performance compared to HR-MRA across all three readers: sensitivity ranged from 87.2%-91.0% versus 66.7%-70.5%; specificity from 93.7%-96.8% versus 58.7%-68.3%; and accuracy from 90.8%-92.9% versus 63.8%-69.5% (P ≤ 0.003). Furthermore, PD-MRA (0.253-mm3 voxel) demonstrated significantly superior per-patient specificity and accuracy compared to HR-MRA across all evaluators (P ≤ 0.013). The diagnostic accuracy of PD-MRA (0.23-mm3 voxel) surpassed that of HR-MRA and was comparable to PD-MRA (0.253-mm3 voxel). The kappa values for inter-reader agreements were significantly higher in PD-MRA (0.820-0.938) than in HR-MRA (0.447-0.510). Conclusion: PD-MRA outperformed HR-MRA in diagnostic accuracy and demonstrated almost perfect inter-reader consistency in identifying intracranial aneurysms among patients with lesions initially indeterminate on CTA or MRA.

Accuracy and reliability of 2-dimensional photography versus 3-dimensional soft tissue imaging

  • Ayaz, Irem;Shaheen, Eman;Aly, Medhat;Shujaat, Sohaib;Gallo, Giulia;Coucke, Wim;Politis, Constantinus;Jacobs, Reinhilde
    • Imaging Science in Dentistry
    • /
    • v.50 no.1
    • /
    • pp.15-22
    • /
    • 2020
  • Purpose: This study was conducted to objectively and subjectively compare the accuracy and reliability of 2-dimensional(2D) photography and 3-dimensional(3D) soft tissue imaging. Materials and Methods: Facial images of 50 volunteers(25 males, 25 females) were captured with a Nikon D800 2D camera (Nikon Corporation, Tokyo, Japan), 3D stereophotogrammetry (SPG), and laser scanning (LS). All subjects were imaged in a relaxed, closed-mouth position with a normal smile. The 2D images were then exported to Mirror® Software (Canfield Scientific, Inc, NJ, USA) and the 3D images into Proplan CMF® software (version 2.1, Materialise HQ, Leuven, Belgium) for further evaluation. For an objective evaluation, 2 observers identified soft tissue landmarks and performed linear measurements on subjects' faces (direct measurements) and both linear and angular measurements on all images(indirect measurements). For a qualitative analysis, 10 dental observers and an expert in facial imaging (subjective gold standard) completed a questionnaire regarding facial characteristics. The reliability of the quantitative data was evaluated using intraclass correlation coefficients, whereas the Fleiss kappa was calculated for qualitative data. Results: Linear and angular measurements carried out on 2D and 3D images showed excellent inter-observer and intra-observer reliability. The 2D photographs displayed the highest combined total error for linear measurements. SPG performed better than LS, with borderline significance (P=0.052). The qualitative assessment showed no significant differences among the 2D and 3D imaging modalities. Conclusion: SPG was found to a reliable and accurate tool for the morphological evaluation of soft tissue in comparison to 2D imaging and laser scanning.

Comparison Between Contrast-Enhanced Computed Tomography and Contrast-Enhanced Magnetic Resonance Imaging With Magnetic Resonance Cholangiopancreatography for Resectability Assessment in Extrahepatic Cholangiocarcinoma

  • Jeongin Yoo;Jeong Min Lee;Hyo-Jin Kang;Jae Seok Bae;Sun Kyung Jeon;Jeong Hee Yoon
    • Korean Journal of Radiology
    • /
    • v.24 no.10
    • /
    • pp.983-995
    • /
    • 2023
  • Objective: To compare the diagnostic performance and interobserver agreement between contrast-enhanced computed tomography (CECT) and contrast-enhanced magnetic resonance imaging (CE-MRI) with magnetic resonance cholangiopancreatography (MRCP) for evaluating the resectability in patients with extrahepatic cholangiocarcinoma (eCCA). Materials and Methods: This retrospective study included treatment-naïve patients with pathologically confirmed eCCA, who underwent both CECT and CE-MRI with MRCP using extracellular contrast media between January 2015 and December 2020. Among the 214 patients (146 males; mean age ± standard deviation, 68 ± 9 years) included, 121 (56.5%) had perihilar cholangiocarcinoma. R0 resection was achieved in 108 of the 153 (70.6%) patients who underwent curative-intent surgery. Four fellowship-trained radiologists independently reviewed the findings of both CECT and CE-MRI with MRCP to assess the local tumor extent and distant metastasis for determining resectability. The pooled area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of CECT and CE-MRI with MRCP were compared using clinical, surgical, and pathological findings as reference standards. The interobserver agreement of resectability was evaluated using Fleiss kappa (κ). Results: No significant differences were observed between CECT and CE-MRI with MRCP in the pooled AUC (0.753 vs. 0.767), sensitivity (84.7% [366/432] vs. 90.3% [390/432]), and specificity (52.6% [223/424] vs. 51.4% [218/424]) (P > 0.05 for all). The AUC for determining resectability was higher when CECT and CE-MRI with MRCP were reviewed together than when CECT was reviewed alone in patients with discrepancies between the imaging modalities or with indeterminate resectability (0.798 [0.754-0.841] vs. 0.753 [0.697-0.808], P = 0.014). The interobserver agreement for overall resectability was fair for both CECT (κ = 0.323) and CE-MRI with MRCP (κ = 0.320), without a significant difference (P = 0.884). Conclusion: CECT and CE-MRI with MRCP showed no significant differences in the diagnostic performance and interobserver agreement in determining the resectability in patients with eCCA.