• Title/Summary/Keyword: Intraobserver variation

Search Result 6, Processing Time 0.019 seconds

CT-based quantitative evaluation of radiation-induced lung fibrosis: a study of interobserver and intraobserver variations

  • Heo, Jaesung;Cho, Oyeon;Noh, O Kyu;O, Young-Taek;Chun, Mison;Kim, Mi-Hwa;Park, Hae-Jin
    • Radiation Oncology Journal
    • /
    • v.32 no.1
    • /
    • pp.43-47
    • /
    • 2014
  • Purpose: The degree of radiation-induced lung fibrosis (RILF) can be measured quantitatively by fibrosis volume (VF) on chest computed tomography (CT) scan. The purpose of this study was to investigate the interobserver and intraobserver variability in CT-based measurement of VF. Materials and Methods: We selected 10 non-small cell lung cancer patients developed with RILF after postoperative radiation therapy (PORT) and delineated VF on the follow-up chest CT scanned at more than 6 months after radiotherapy. Three radiation oncologists independently delineated VF to investigate the interobserver variability. Three times of delineation of VF was performed by two radiation oncologists for the analysis of intraobserver variability. We analysed the concordance index (CI) and inter/intra-class correlation coefficient (ICC). Results: The median CI was 0.61 (range, 0.44 to 0.68) for interobserver variability and the median CIs for intraobserver variability were 0.69 (range, 0.65 to 0.79) and 0.61(range, 0.55 to 0.65) by two observers. The ICC for interobserver variability was 0.974 (p < 0.001) and ICCs for intraobserver variability were 0.996 (p < 0.001) and 0.991 (p < 0.001), respectively. Conclusion: CT-based measurement of VF with patients who received PORT was a highly consistent and reproducible quantitative method between and within observers.

Interobserver and Interaobserver Variability in Interpretation of Lumbar Disc Abnormalities on Magnetic Resonance Images (자기공명 촬영상 요추 추간반 병변의 판독자내 및 판독자간 해석의 다양성)

  • Jeon, Een-Ho;Song, Jun-Hyeok;Park, Hyang-Kwon;Shin, Kyu-Man;Kim, Sung-Hak;Park, Dong-Been
    • Journal of Korean Neurosurgical Society
    • /
    • v.30 no.sup2
    • /
    • pp.254-258
    • /
    • 2001
  • Objective : The terminology of degenerative disc disease lacks official standardization. Lacks of such standardization may provoke some clinical and litigation problems. The authors investigated interobserver and intraobserver variability in interpretation of lumbar disc abnormality. Methods : Magnetic resonance imaging studies of the lumbar spine performed prospectively in 50 patients, were read blindly by three doctors dealing spinal disorders, using two nomenclature. Nomenclature I was normal, bulging, protrusion, extrusion. Nomenclature II was normal, bulging, herniation without neural compression, with neural compression. Intraobserver and interobserver variation were measured statistically. Results : Interobserver agreement was 70.4-80.8% for nomenclature I, 76.2-80.2% for nomenclature II. Intraobserver agreement was 84.0-88.0% for nomenclature I, 79.2-86.8% for nomenclature II. Interobserver Kappa statistic was 0.53-0.56 for nomenclature I, 0.54-0.57 for nomenclature II. Intraobserver Kappa statistic was 0.60-0.85 for nomenclature I, 0.53-0.72 for nomenclature II. Conclusion : Experienced doctors showed only moderate interobserver agreement when interpreting disc status on lumbar magnetic resonance imaging. Intraobserver agreement was superior to interbserver. The standardization of nomenclatures for lumbar disc extension beyond interspace are needed.

  • PDF

Cephalometric landmark variability among orthodontists and dentomaxillofacial radiologists: a comparative study

  • Durao, Ana Paula Reis;Morosolli, Aline;Pittayapat, Pisha;Bolstad, Napat;Ferreira, Afonso P.;Jacobs, Reinhilde
    • Imaging Science in Dentistry
    • /
    • v.45 no.4
    • /
    • pp.213-220
    • /
    • 2015
  • Purpose: The aim this study was to compare the accuracy of orthodontists and dentomaxillofacial radiologists in identifying 17 commonly used cephalometric landmarks, and to determine the extent of variability associated with each of those landmarks. Materials and Methods: Twenty digital lateral cephalometric radiographs were evaluated by two groups of dental specialists, and 17 cephalometric landmarks were identified. The x and y coordinates of each landmark were recorded. The mean value for each landmark was considered the best estimate and used as the standard. Variation in measurements of the distance between landmarks and measurements of the angles associated with certain landmarks was also assessed by a subset of two observers, and intraobserver and interobserver agreement were evaluated. Results: Intraclass correlation coefficients were excellent for intraobserver agreement, but only good for interobserver agreement. The least reliable landmark for orthodontists was the gnathion (Gn) point (standard deviation [SD], 5.92 mm), while the orbitale (Or) was the least reliable landmark (SD, 4.41 mm) for dentomaxillofacial radiologists. Furthermore, the condylion (Co)-Gn plane was the least consistent (SD, 4.43 mm). Conclusion: We established that some landmarks were not as reproducible as others, both horizontally and vertically. The most consistently identified landmark in both groups was the lower incisor border, while the least reliable points were Co, Gn, Or, and the anterior nasal spine. Overall, a lower level of reproducibility in the identification of cephalometric landmarks was observed among orthodontists.

Intra- and interobserver agreement of computed tomography in assessment of the mandibular condyle

  • Cho, Bong-Hae;Jung, Yun-Hoa
    • Imaging Science in Dentistry
    • /
    • v.37 no.4
    • /
    • pp.191-195
    • /
    • 2007
  • Purpose: To study the intra- and interobserver agreement of multidetector row computed tomography (MDCT) in interpretation of degenerative changes of the mandibular condyle. Materials and Methods: Five observers independently evaluated one hundred temporomandibular joint MDCT images for signs of osteophytes, erosion, sclerosis and flattening. The intra- and interobserver agreements were calculated by using Kappa statistics. Results: The intraobserver agreement was substantial for erosion (k=0.75), flattening (k=0.74) and sclerosis (k=0.72) and almost perfect for osteophytes (k=0.84). The interobserver agreement was fair for flattening (k=0.39), moderate for erosion (k=0.58) and sclerosis (k=0.48) and substantial for osteophytes (k=0.75). Conclusion: This study shows that we can expect good agreement for the presence of osteophytes, but not for flattening in the interpretation of MDCT images of the condyle.

  • PDF

Validation and comparison of volume measurements using 1 multidetector computed tomography and 5 cone-beam computed tomography protocols: An in vitro study

  • Juliana Andrea Correa, Travessas;Alessandra Mendonca, dos Santos;Rodrigo Pagliarini, Buligon;Nadia Assein, Arus;Priscila Fernanda Tiecher, da Silveira;Heraldo Luis Dias, da Silveira;Mariana Boessio, Vizzotto
    • Imaging Science in Dentistry
    • /
    • v.52 no.4
    • /
    • pp.399-408
    • /
    • 2022
  • Purpose: The purpose of this study was to compare volume measurements obtained using 2 image software packages on Digital Imaging and Communications in Medicine (DICOM) images acquired from 1 multidetector computed tomography and 5 cone-beam computed tomography devices, using different protocols for physical volume measurements. Materials and Methods: Four pieces of bovine leg were prepared. Marrow was removed from 3 pieces, leaving cortical bone exposed. The resulting space of 1 piece was filled with water, another was filled with propylene glycol, and the third was left unfilled. The marrow in the fourth sample was left fully intact. Volume measurements were obtained after importing DICOM images into the Dolphin Imaging 11.95 and ITK-SNAP software programs. Data were analyzed using 3-way analysis of variance with a generalized linear model to determine the effects of voxel size, software, and content on percentage mean volume differences between tomographic protocols. A significance level of 0.05 was used. Results: The intraclass correlation coefficients for intraobserver and interobserver reliability were, respectively, 0.915 and 0.764 for the Dolphin software and 0.894 and 0.766 for the ITK-SNAP software. Three sources of statistically significant variation were identified: the interaction between software and content (P=0.001), the main effect of content (P=0.014), and the main effect of software (P=0.001). Voxel size was not associated with statistically significant differences in volume measurements. Conclusion: Both content and software influenced the accuracy of volume measurements, especially when the content had gray values similar to those of the adjacent tissues.

ROC Analysis of Visual Assessments Made in Gated Blood Pool Scans of Patients with Coronary Artery Disease (관상동맥질환에서 심장풀 스캔의 육안적 평가에 대한 ROC 분석)

  • Lee, Kyun-Han;Choi, Yoon-Ho;Lee, Bum-Woo;Moon, Dae-Hyuk;Koong, Sung-Soo;Chung, June-Key;Lee, Myung-Chul;Koh, Chang-Soon
    • The Korean Journal of Nuclear Medicine
    • /
    • v.23 no.2
    • /
    • pp.175-181
    • /
    • 1989
  • Visual assessment of regional wall motion abnormality (RWMA) by gated blood pol scan (GBPS) serves as an useful parameter in the diagnosis, functional evaluation, and follow up in various clinical settings, but are still subject to some inherent limitations. On important problem may be the interobserver as well as intraobsever variation that may well be present due to the subjective nature of the interpretations. This study was carried out to determine the reliability and reproducibility of visual assessments made in GBPSs, and to observe the degree to which the results would be influenced by observer variation. Fifty two patients with coronary heart disease had resting GBPS and contrast ventriculography within 4 days appall. Contrast ventriculography-showed normal wall motion in 6 patients and the remaining 46 had RWMA in one or more segments. The anterior and left anterolateral views of all 52 GBPSs were analyzed by three independent observers, who selected from 5 scales, their level of confidence that there was RWMA in that segment. Reciever operating characteristic (ROC) curves for each analysis was plotted and the area under the curve $(\theta)$ was used as a parameter representing each observer's performance in his interpretations. The findings of contrast ventriculographies were used as the standard for RWMA. The apical and inferoapical segments showed the best correlation with contrast ventriculography ($\theta=0.90-0.94$, 0.81-0.94, respectively), and the inferior wall showed the poorest correlation $(\theta=0.70-0.74)$. The interpretations of the inferior, septal, apical, and posteroinferior, segments showed no difference between the observers, but there was significantly better performance in assessment by observer A compared to that by B or C for the anterolateral segments ($\theta=0.87$, 0.78, 0.76, respectively. p<0.01 for A vs B, p<0.05 for A vs C), as well as when all segments were considered altogether ($\theta=0.88$, 0.83, 0.82, respectively. both p<0.05). This was also true for the infero-apical segment between A and C ($\theta=0.09$, 0.81, p<0.05). The intraobserver variation, however, did not appear significant, with only the inferior segment for observer B showing any significant difference when observer A and B repeated the analysis 10 days latter. There was no difference in assessing dyskinesia, with all observers showing a high performance ($\theta=0.98$, 0.87, 0.97, respectively). The visual assessment of left ventricular ejection fraction by all three observers correlated well with the calculated value from a semiautomated method (Spearman's r = 0.91, 0.83, 0.83. p<0.01, p<0.05, p < 0.05). The assessment of LV and RV size also correlated well between the three observers (Kendall's w = 0.80, 0.51, p<0.01 for both left and right ventricles). The above findings suggest that RWMA visually assessed by GBPS correlates well with that done by contrast ventriculography. And although the observer's experience or skill may influence the results in certain segments, visual analysis of GBPS may serve as a reliable and reproducible means for evaluating ventricular function.

  • PDF