• Title/Summary/Keyword: Interobserver variation

Search Result 15, Processing Time 0.028 seconds

CT-based quantitative evaluation of radiation-induced lung fibrosis: a study of interobserver and intraobserver variations

  • Heo, Jaesung;Cho, Oyeon;Noh, O Kyu;O, Young-Taek;Chun, Mison;Kim, Mi-Hwa;Park, Hae-Jin
    • Radiation Oncology Journal
    • /
    • v.32 no.1
    • /
    • pp.43-47
    • /
    • 2014
  • Purpose: The degree of radiation-induced lung fibrosis (RILF) can be measured quantitatively by fibrosis volume (VF) on chest computed tomography (CT) scan. The purpose of this study was to investigate the interobserver and intraobserver variability in CT-based measurement of VF. Materials and Methods: We selected 10 non-small cell lung cancer patients developed with RILF after postoperative radiation therapy (PORT) and delineated VF on the follow-up chest CT scanned at more than 6 months after radiotherapy. Three radiation oncologists independently delineated VF to investigate the interobserver variability. Three times of delineation of VF was performed by two radiation oncologists for the analysis of intraobserver variability. We analysed the concordance index (CI) and inter/intra-class correlation coefficient (ICC). Results: The median CI was 0.61 (range, 0.44 to 0.68) for interobserver variability and the median CIs for intraobserver variability were 0.69 (range, 0.65 to 0.79) and 0.61(range, 0.55 to 0.65) by two observers. The ICC for interobserver variability was 0.974 (p < 0.001) and ICCs for intraobserver variability were 0.996 (p < 0.001) and 0.991 (p < 0.001), respectively. Conclusion: CT-based measurement of VF with patients who received PORT was a highly consistent and reproducible quantitative method between and within observers.

Intra- and interobserver agreement of computed tomography in assessment of the mandibular condyle

  • Cho, Bong-Hae;Jung, Yun-Hoa
    • Imaging Science in Dentistry
    • /
    • v.37 no.4
    • /
    • pp.191-195
    • /
    • 2007
  • Purpose: To study the intra- and interobserver agreement of multidetector row computed tomography (MDCT) in interpretation of degenerative changes of the mandibular condyle. Materials and Methods: Five observers independently evaluated one hundred temporomandibular joint MDCT images for signs of osteophytes, erosion, sclerosis and flattening. The intra- and interobserver agreements were calculated by using Kappa statistics. Results: The intraobserver agreement was substantial for erosion (k=0.75), flattening (k=0.74) and sclerosis (k=0.72) and almost perfect for osteophytes (k=0.84). The interobserver agreement was fair for flattening (k=0.39), moderate for erosion (k=0.58) and sclerosis (k=0.48) and substantial for osteophytes (k=0.75). Conclusion: This study shows that we can expect good agreement for the presence of osteophytes, but not for flattening in the interpretation of MDCT images of the condyle.

  • PDF

Interobserver variation in target volume for salvage radiotherapy in recurrent prostate cancer patients after radical prostatectomy using CT versus combined CT and MRI: a multicenter study (KROG 13-11)

  • Lee, Eonju;Park, Won;Ahn, Sung Hwan;Cho, Jae Ho;Kim, Jin Hee;Cho, Kwan Ho;Choi, Young Min;Kim, Jae-Sung;Kim, Jin Ho;Jang, Hong-Seok;Kim, Young-Seok;Nam, Taek-Keun
    • Radiation Oncology Journal
    • /
    • v.36 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • Purpose: To investigate interobserver variation in target volume delineations for prostate cancer salvage radiotherapy using planning computed tomography (CT) versus combined planning CT and magnetic resonance imaging (MRI). Materials and Methods: Ten radiation oncologists independently delineated a target volume on the planning CT scans of five cases with different pathological status after radical prostatectomy. Two weeks later, this was repeated with the addition of planning MRI. The volumes obtained with CT only and combined CT and MRI were compared, and the effect of the addition of planning MRI on interobserver variability was assessed. Results: There were large differences in clinical target volume (CTV) delineated by each observer, regardless of the addition of planning MRI ($9.44-139.27cm^3$ in CT only and $7.77-122.83cm^3$ in CT plus MRI) and no significant differences in the mean and standard deviation of CTV. However, there were decreases in mean volume and standard deviation as a result of using the planning MRI. Conclusion: This study showed substantial interobserver variation in target volume delineation for salvage radiotherapy. The combination of planning MRI with CT tended to decrease the target volume and the variation.

Interobserver and Interaobserver Variability in Interpretation of Lumbar Disc Abnormalities on Magnetic Resonance Images (자기공명 촬영상 요추 추간반 병변의 판독자내 및 판독자간 해석의 다양성)

  • Jeon, Een-Ho;Song, Jun-Hyeok;Park, Hyang-Kwon;Shin, Kyu-Man;Kim, Sung-Hak;Park, Dong-Been
    • Journal of Korean Neurosurgical Society
    • /
    • v.30 no.sup2
    • /
    • pp.254-258
    • /
    • 2001
  • Objective : The terminology of degenerative disc disease lacks official standardization. Lacks of such standardization may provoke some clinical and litigation problems. The authors investigated interobserver and intraobserver variability in interpretation of lumbar disc abnormality. Methods : Magnetic resonance imaging studies of the lumbar spine performed prospectively in 50 patients, were read blindly by three doctors dealing spinal disorders, using two nomenclature. Nomenclature I was normal, bulging, protrusion, extrusion. Nomenclature II was normal, bulging, herniation without neural compression, with neural compression. Intraobserver and interobserver variation were measured statistically. Results : Interobserver agreement was 70.4-80.8% for nomenclature I, 76.2-80.2% for nomenclature II. Intraobserver agreement was 84.0-88.0% for nomenclature I, 79.2-86.8% for nomenclature II. Interobserver Kappa statistic was 0.53-0.56 for nomenclature I, 0.54-0.57 for nomenclature II. Intraobserver Kappa statistic was 0.60-0.85 for nomenclature I, 0.53-0.72 for nomenclature II. Conclusion : Experienced doctors showed only moderate interobserver agreement when interpreting disc status on lumbar magnetic resonance imaging. Intraobserver agreement was superior to interbserver. The standardization of nomenclatures for lumbar disc extension beyond interspace are needed.

  • PDF

The Polymerase Chain Reaction in Diagnosis of Small B-Cell Non-Hodgkin Lymphomas

  • Antoro, Ester Lianawati;Dwianingsih, Ery Kus;Indrawati, Indrawati;Triningsih, FX Ediati;Harijadi, Harijadi
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.2
    • /
    • pp.491-495
    • /
    • 2016
  • Background: Small B-cell non-Hodgkins lymphoma (NHL) is difficult to be distinguished from non-neoplastic reactive processes using conventional haematoxylin-eosin (HE) staining due to different interpretations among pathologists with diagnosis based on morphologic features. Ancillary examinations such as immunohistochemical (IHC) staining are essential. However, negative or doubtful results are still sometimes obtained due to unsatisfactory tissue processing or IHC technique. The polymerase chain reaction (PCR) as a molecular diagnostic technique is very sensitive and specific. Clonality detection of heavy chain immunoglobulin (IgH) gene rearrangement has been widely used to establish diagnosis of B-cell NHL. Aims: To elaborate interobserver variation in small B-cell NHL diagnosis based on morphologic features only and to confirm sensitivity and specificity of the PCR technique as an ancillary method. Materials and Methods: A toptal of 28 samples of small B cell NHL and suspicious lymphoma were interpreted by 3 pathologists in Sardjito General Hospital based on their morphology only. The reliability of assessment and the coefficient of interobserver agreement were calculated by Fleiss kappa statistics. Interpretation results were confirmed with IHC staining (CD20, CD3, Bcl2). PCR was performed to analyze the clonality of IgH gene rearrangement. Results: Interobserver agreement in morphologic evalution of small B cell NHL and chronic lymphadenitis revealed kappa coefficient 0.69 included in the substantial agreement category. The cases were divided into 3 groups based on morphology and IHC results; lymphoma, reactive process and undetermined group. PCR analysis showed 90% sensitivity and 60% specificity. Conclusions: The present study revealed a substantial agreement among pathologists in small B-cell NHL diagnosis. For difficult cases, PCR is useful as complementary method to morphologic and IHC examinations to establish definitive diagnosis.

Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging

  • Alkaduhimi, Hassanin;Saarig, Aimane;Amajjar, Ihsan;van der Linde, Just A.;van Wier, Marieke F.;Willigenburg, Nienke W.;van den Bekerom, Michel P.J.
    • Clinics in Shoulder and Elbow
    • /
    • v.24 no.2
    • /
    • pp.98-105
    • /
    • 2021
  • Background: Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods: Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss' kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results: The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions: Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.

Comparison of One- and Two-Region of Interest Strain Elastography Measurements in the Differential Diagnosis of Breast Masses

  • Hee Jeong Park;Sun Mi Kim;Bo La Yun;Mijung Jang;Bohyoung Kim;Soo Hyun Lee;Hye Shin Ahn
    • Korean Journal of Radiology
    • /
    • v.21 no.4
    • /
    • pp.431-441
    • /
    • 2020
  • Objective: To compare the diagnostic performance and interobserver variability of strain ratio obtained from one or two regions of interest (ROI) on breast elastography. Materials and Methods: From April to May 2016, 140 breast masses in 140 patients who underwent conventional ultrasonography (US) with strain elastography followed by US-guided biopsy were evaluated. Three experienced breast radiologists reviewed recorded US and elastography images, measured strain ratios, and categorized them according to the American College of Radiology breast imaging reporting and data system lexicon. Strain ratio was obtained using the 1-ROI method (one ROI drawn on the target mass), and the 2-ROI method (one ROI in the target mass and another in reference fat tissue). The diagnostic performance of the three radiologists among datasets and optimal cut-off values for strain ratios were evaluated. Interobserver variability of strain ratio for each ROI method was assessed using intraclass correlation coefficient values, Bland-Altman plots, and coefficients of variation. Results: Compared to US alone, US combined with the strain ratio measured using either ROI method significantly improved specificity, positive predictive value, accuracy, and area under the receiver operating characteristic curve (AUC) (all p values < 0.05). Strain ratio obtained using the 1-ROI method showed higher interobserver agreement between the three radiologists without a significant difference in AUC for differentiating breast cancer when the optimal strain ratio cut-off value was used, compared with the 2-ROI method (AUC: 0.788 vs. 0.783, 0.693 vs. 0.715, and 0.691 vs. 0.686, respectively, all p values > 0.05). Conclusion: Strain ratios obtained using the 1-ROI method showed higher interobserver agreement without a significant difference in AUC, compared to those obtained using the 2-ROI method. Considering that the 1-ROI method can reduce performers' efforts, it could have an important role in improving the diagnostic performance of breast US by enabling consistent management of breast lesions.

Interobserver Variation in the Diagnosis of Gastric Epithelial Dysplasia and Carcinoma between Two Pathologists in Japan and Korea

  • Kushima, Ryoji;Kim, Kyoung-Mee
    • Journal of Gastric Cancer
    • /
    • v.11 no.3
    • /
    • pp.141-145
    • /
    • 2011
  • Although the biological potential of gastric epithelial dysplasia (GED) as a precursor of gastric cancer has never been in doubt, the classification of these lesions has been controversial and fraught with marked variations in approach to diagnosis across the world. The complexity of cyto-architectural features has been considered to be of paramount importance for the diagnosis of carcinoma in Japan, while breach of the basement membrane and invasion into the lamina propria has been considered the sine qua non of malignancy and hence a pre-requisite for the diagnosis of cancer in the West. In Korea, although the incidence of gastric cancer is similar to Japan, the diagnostic approach to GED or cancer seems to lie midway between Western and Japanese criteria. In this review, we will discuss the difference in the diagnosis of GED and cancer between two pathologists working in the comprehensive cancer center located in Japan and Korea, one of the most prevalent areas in the world for gastric cancer.

Cephalometric landmark variability among orthodontists and dentomaxillofacial radiologists: a comparative study

  • Durao, Ana Paula Reis;Morosolli, Aline;Pittayapat, Pisha;Bolstad, Napat;Ferreira, Afonso P.;Jacobs, Reinhilde
    • Imaging Science in Dentistry
    • /
    • v.45 no.4
    • /
    • pp.213-220
    • /
    • 2015
  • Purpose: The aim this study was to compare the accuracy of orthodontists and dentomaxillofacial radiologists in identifying 17 commonly used cephalometric landmarks, and to determine the extent of variability associated with each of those landmarks. Materials and Methods: Twenty digital lateral cephalometric radiographs were evaluated by two groups of dental specialists, and 17 cephalometric landmarks were identified. The x and y coordinates of each landmark were recorded. The mean value for each landmark was considered the best estimate and used as the standard. Variation in measurements of the distance between landmarks and measurements of the angles associated with certain landmarks was also assessed by a subset of two observers, and intraobserver and interobserver agreement were evaluated. Results: Intraclass correlation coefficients were excellent for intraobserver agreement, but only good for interobserver agreement. The least reliable landmark for orthodontists was the gnathion (Gn) point (standard deviation [SD], 5.92 mm), while the orbitale (Or) was the least reliable landmark (SD, 4.41 mm) for dentomaxillofacial radiologists. Furthermore, the condylion (Co)-Gn plane was the least consistent (SD, 4.43 mm). Conclusion: We established that some landmarks were not as reproducible as others, both horizontally and vertically. The most consistently identified landmark in both groups was the lower incisor border, while the least reliable points were Co, Gn, Or, and the anterior nasal spine. Overall, a lower level of reproducibility in the identification of cephalometric landmarks was observed among orthodontists.

Diagnostic Meaning of High Resolution Computed Tomography Compared with Chest Radiography for Screening of Welder's lung (용접공진폐증 집단검진을 위한 단순 흉부방사선 촬영과 고해상 흉부전산화 단층촬영의 진단적 의의)

  • Kang, J.H.;Chun, J.H.;Gu, H.W.;Ko, K.S.;Yu, B.C.;Sohn, H.S.;Lee, J.T.;Lee, C.U.;Kim, K.I.;Choi, S.J.
    • Journal of Preventive Medicine and Public Health
    • /
    • v.29 no.4 s.55
    • /
    • pp.853-861
    • /
    • 1996
  • Pneumoconiosis is one of the major problem in the field of occupational health at Korea. Therefore, the efficient diagnosis of pneumoconiosis is a hot issue on the occupational health program. The author executed this study to estimate the diagnostic value of high resolution computed tomography(HRCT) compared with chest radiography for screening of welder's lung. HRCT was introduced very recently for the diagnosis of pneumoconiosis, however, the diagnostic value for screening of welder's lung - principally nonfibrogenic and reversible - has not been evaluated. The subjects were fifty cases of welder's lung or suspected cases who had been collected between 1989 and 1994 from one shipyard and continuously followed-up on the basis of in-plant periodic health check program. We applied both chest radiography and HRCT on the same subjects from May 1 to 30, 1996. The images were evaluated by two careered radiologists independently. The findings of chest radiography were classified into four category by ILO classification, and the findings of HRCT according to the criteria of Bergin et al. The concordance between two radiologists expressed with Kendall's tau-b was 0.72 by chest radiography and 0.44 by HRCT- that is, interobserver variation of HRCT was bigger than that of chest radiography. The concordance between the two different methods was highly variable as 0.44 by radiologist A and 0.06 by radiologist B - that is, interobserver variation was very big. However, HRCT looked more detectable for the minor parenchymal change. These findings suggested that it is not appropriate to use HRCT routinely for screening of welder's lung due to lack of diagnostic criteria, and feasibility, acceptability and economic aspects. Nevertheless, HRCT might be recommendable in the case of equivocal parenchymal features on the chest radiography, unexplained respiratory symptoms, and/or lung function abnormalities suggestive of interstitial fibrosis.

  • PDF