• 제목/요약/키워드: operating characteristic

검색결과 1,742건 처리시간 0.032초

Deep Learning-Assisted Diagnosis of Pediatric Skull Fractures on Plain Radiographs

  • Jae Won Choi;Yeon Jin Cho;Ji Young Ha;Yun Young Lee;Seok Young Koh;June Young Seo;Young Hun Choi;Jung-Eun Cheon;Ji Hoon Phi;Injoon Kim;Jaekwang Yang;Woo Sun Kim
    • Korean Journal of Radiology
    • /
    • 제23권3호
    • /
    • pp.343-354
    • /
    • 2022
  • Objective: To develop and evaluate a deep learning-based artificial intelligence (AI) model for detecting skull fractures on plain radiographs in children. Materials and Methods: This retrospective multi-center study consisted of a development dataset acquired from two hospitals (n = 149 and 264) and an external test set (n = 95) from a third hospital. Datasets included children with head trauma who underwent both skull radiography and cranial computed tomography (CT). The development dataset was split into training, tuning, and internal test sets in a ratio of 7:1:2. The reference standard for skull fracture was cranial CT. Two radiology residents, a pediatric radiologist, and two emergency physicians participated in a two-session observer study on an external test set with and without AI assistance. We obtained the area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity along with their 95% confidence intervals (CIs). Results: The AI model showed an AUROC of 0.922 (95% CI, 0.842-0.969) in the internal test set and 0.870 (95% CI, 0.785-0.930) in the external test set. The model had a sensitivity of 81.1% (95% CI, 64.8%-92.0%) and specificity of 91.3% (95% CI, 79.2%-97.6%) for the internal test set and 78.9% (95% CI, 54.4%-93.9%) and 88.2% (95% CI, 78.7%-94.4%), respectively, for the external test set. With the model's assistance, significant AUROC improvement was observed in radiology residents (pooled results) and emergency physicians (pooled results) with the difference from reading without AI assistance of 0.094 (95% CI, 0.020-0.168; p = 0.012) and 0.069 (95% CI, 0.002-0.136; p = 0.043), respectively, but not in the pediatric radiologist with the difference of 0.008 (95% CI, -0.074-0.090; p = 0.850). Conclusion: A deep learning-based AI model improved the performance of inexperienced radiologists and emergency physicians in diagnosing pediatric skull fractures on plain radiographs.

Use of Artificial Intelligence for Reducing Unnecessary Recalls at Screening Mammography: A Simulation Study

  • Yeon Soo Kim;Myoung-jin Jang;Su Hyun Lee;Soo-Yeon Kim;Su Min Ha;Bo Ra Kwon;Woo Kyung Moon;Jung Min Chang
    • Korean Journal of Radiology
    • /
    • 제23권12호
    • /
    • pp.1241-1250
    • /
    • 2022
  • Objective: To conduct a simulation study to determine whether artificial intelligence (AI)-aided mammography reading can reduce unnecessary recalls while maintaining cancer detection ability in women recalled after mammography screening. Materials and Methods: A retrospective reader study was performed by screening mammographies of 793 women (mean age ± standard deviation, 50 ± 9 years) recalled to obtain supplemental mammographic views regarding screening mammography-detected abnormalities between January 2016 and December 2019 at two screening centers. Initial screening mammography examinations were interpreted by three dedicated breast radiologists sequentially, case by case, with and without AI aid, in a single session. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and recall rate for breast cancer diagnosis were obtained and compared between the two reading modes. Results: Fifty-four mammograms with cancer (35 invasive cancers and 19 ductal carcinomas in situ) and 739 mammograms with benign or negative findings were included. The reader-averaged AUC improved after AI aid, from 0.79 (95% confidence interval [CI], 0.74-0.85) to 0.89 (95% CI, 0.85-0.94) (p < 0.001). The reader-averaged specificities before and after AI aid were 41.9% (95% CI, 39.3%-44.5%) and 53.9% (95% CI, 50.9%-56.9%), respectively (p < 0.001). The reader-averaged sensitivity was not statistically different between AI-unaided and AI-aided readings: 89.5% (95% CI, 83.1%-95.9%) vs. 92.6% (95% CI, 86.2%-99.0%) (p = 0.053), although the sensitivities of the least experienced radiologists before and after AI aid were 79.6% (43 of 54 [95% CI, 66.5%-89.4%]) and 90.7% (49 of 54 [95% CI, 79.7%-96.9%]), respectively (p = 0.031). With AI aid, the reader-averaged recall rate decreased by from 60.4% (95% CI, 57.8%-62.9%) to 49.5% (95% CI, 46.5%-52.4%) (p < 0.001). Conclusion: AI-aided reading reduced the number of recalls and improved the diagnostic performance in our simulation using women initially recalled for supplemental mammographic views after mammography screening.

99mTc-3PRGD2 SPECT/CT Imaging for Diagnosing Lymph Node Metastasis of Primary Malignant Lung Tumors

  • Liming Xiao;Shupeng Yu;Weina Xu;Yishan Sun;Jun Xin
    • Korean Journal of Radiology
    • /
    • 제24권11호
    • /
    • pp.1142-1150
    • /
    • 2023
  • Objective: To evaluate 99mtechnetium-three polyethylene glycol spacers-arginine-glycine-aspartic acid (99mTc-3PRGD2) single-photon emission computed tomography (SPECT)/computed tomography (CT) imaging for diagnosing lymph node metastasis of primary malignant lung neoplasms. Materials and Methods: We prospectively enrolled 26 patients with primary malignant lung tumors who underwent 99mTc-3PRGD2 SPECT/CT and 18F-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)/CT imaging. Both imaging methods were analyzed in qualitative (visual dichotomous and 5-point grades for lymph nodes and lung tumors, respectively) and semiquantitative (maximum tissue-to-background radioactive count) manners for the lymph nodes and lung tumors. The performance of the differentiation of lymph nodes with and without metastasis was determined at the per-lymph node station and per-patient levels using histopathological results as the reference standard. Results: Total 42 stations had metastatic lymph nodes and 136 stations had benign lymph nodes. The differences between metastatic and benign lymph nodes in the visual qualitative and semiquantitative analyses of 99mTc-3PRGD2 SPECT/CT and 18F-FDG PET/CT were statistically significant (all P < 0.001). The area under the receiver operating characteristic curve (AUC) in the semi-quantitative analysis of 99mTc-3PRGD2 SPECT/CT was 0.908 (95% confidence interval [CI], 0.851-0.966), and the sensitivity, specificity, positive predictive value, and negative predictive value were 0.86 (36/42), 0.88 (120/136), 0.69 (36/52), and 0.95 (120/126), respectively. Among the 26 patients (including two patients each with two lung tumors), 15 had pathologically confirmed lymph node metastasis. The difference between primary lung lesions in patients with and without lymph node metastasis was statistically significant only in the semi-quantitative analysis of 99mTc-3PRGD2 SPECT/CT (P = 0.007), with an AUC of 0.807 (95% CI, 0.641-0.974). Conclusion: 99mTc-3PRGD2 SPECT/CT imaging may notably perform in the direct diagnosis of lymph node metastasis of primary malignant lung tumors and indirectly predict the presence of lymph node metastasis through uptake in the primary lesions.

A Prospective Study on the Value of Ultrasound Microflow Assessment to Distinguish Malignant from Benign Solid Breast Masses: Association between Ultrasound Parameters and Histologic Microvessel Densities

  • Ah Young Park;Myoungae Kwon;Ok Hee Woo;Kyu Ran Cho;Eun Kyung Park;Sang Hoon Cha;Sung Eun Song;Ju-Han Lee;JaeHyung Cha;Gil Soo Son;Bo Kyoung Seo
    • Korean Journal of Radiology
    • /
    • 제20권5호
    • /
    • pp.759-772
    • /
    • 2019
  • Objective: To investigate the value of ultrasound (US) microflow assessment in distinguishing malignant from benign solid breast masses as well as the association between US parameters and histologic microvessel density (MVD). Materials and Methods: Ninety-eight breast masses (57 benign and 41 malignant) were examined using Superb Microvascular Imaging (SMI) and contrast-enhanced US (CEUS) before biopsy. Two radiologists evaluated the quantitative and qualitative vascular parameters on SMI (vascular index, morphology, distribution, and penetration) and CEUS (time-intensity curve analysis and enhancement characteristics). US parameters were compared between benign and malignant masses and the diagnostic performance was compared between SMI and CEUS. Subgroup analysis was performed according to lesion size. The effect of vascular parameters on downgrading Breast Imaging Reporting and Data System (BI-RADS) category 4A masses was evaluated. The association between histologic MVD and US parameters was analyzed. Results: Malignant masses were associated with a higher vascular index (15.1 ± 7.3 vs. 5.9 ± 5.6), complex vessel morphology (82.9% vs. 42.1%), central vascularity (95.1% vs. 59.6%), penetrating vessels (80.5% vs. 31.6%) on SMI (all, p < 0.001), as well as higher peak intensity (37.1 ± 25.7 vs. 17.0 ± 15.8, p < 0.001), slope (10.6 ± 11.2 vs. 3.9 ± 4.2, p = 0.001), area (1035.7 ± 726.9 vs. 458.2 ± 410.2, p < 0.001), hyperenhancement (95.1% vs. 70.2%, p = 0.005), centripetal enhancement (70.7% vs. 45.6%, p = 0.023), penetrating vessels (65.9% vs. 22.8%, p < 0.001), and perfusion defects (31.7% vs. 3.5%, p < 0.001) on CEUS (p ≤ 0.023). The areas under the receiver operating characteristic curve (AUCs) of SMI and CEUS were 0.853 and 0.841, respectively (p = 0.803). In 19 masses measuring < 10 mm, central vascularity on SMI was associated with malignancy (100% vs. 38.5%, p = 0.018). Considering all benign SMI parameters on the BI-RADS assessment, unnecessary biopsies could be avoided in 12 category 4A masses with improved AUCs (0.500 vs. 0.605, p < 0.001). US vascular parameters associated with malignancy showed higher MVD (p ≤ 0.016). MVD was higher in malignant masses than in benign masses, and malignant masses negative for estrogen receptor or positive for Ki67 had higher MVD (p < 0.05). Conclusion: US microflow assessment using SMI and CEUS is valuable in distinguishing malignant from benign solid breast masses, and US vascular parameters are associated with histologic MVD.

Development of algorithm for work intensity evaluation using excess overwork index of construction workers with real-time heart rate measurement device

  • Jae-young Park;Jung Hwan Lee;Mo-Yeol Kang;Tae-Won Jang;Hyoung-Ryoul Kim;Se-Yeong Kim;Jongin Lee
    • Annals of Occupational and Environmental Medicine
    • /
    • 제35권
    • /
    • pp.24.1-24.15
    • /
    • 2023
  • Background: The construction workers are vulnerable to fatigue due to high physical workload. This study aimed to investigate the relationship between overwork and heart rate in construction workers and propose a scheme to prevent overwork in advance. Methods: We measured the heart rates of construction workers at a construction site of a residential and commercial complex in Seoul from August to October 2021 and develop an index that monitors overwork in real-time. A total of 66 Korean workers participated in the study, wearing real-time heart rate monitoring equipment. The relative heart rate (RHR) was calculated using the minimum and maximum heart rates, and the maximum acceptable working time (MAWT) was estimated using RHR to calculate the workload. The overwork index (OI) was defined as the cumulative workload evaluated with the MAWT. An appropriate scenario line (PSL) was set as an index that can be compared to the OI to evaluate the degree of overwork in real-time. The excess overwork index (EOI) was evaluated in real-time during work performance using the difference between the OI and the PSL. The EOI value was used to perform receiver operating characteristic (ROC) curve analysis to find the optimal cut-off value for classification of overwork state. Results: Of the 60 participants analyzed, 28 (46.7%) were classified as the overwork group based on their RHR. ROC curve analysis showed that the EOI was a good predictor of overwork, with an area under the curve of 0.824. The optimal cut-off values ranged from 21.8% to 24.0% depending on the method used to determine the cut-off point. Conclusion: The EOI showed promising results as a predictive tool to assess overwork in real-time using heart rate monitoring and calculation through MAWT. Further research is needed to assess physical workload accurately and determine cut-off values across industries.

Diagnostic Performance of 18F-Fluorodeoxyglucose Positron Emission Tomography/CT for Chronic Empyema-Associated Malignancy

  • Miju Cheon;Jang Yoo;Seung Hyup Hyun;Kyung Soo Lee;Hojoong Kim;Jhingook Kim;Jae Il Zo;Young Mog Shim;Joon Young Choi
    • Korean Journal of Radiology
    • /
    • 제20권8호
    • /
    • pp.1293-1299
    • /
    • 2019
  • Objective: The purpose of this study was to evaluate the diagnostic performance of 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) for chronic empyema-associated malignancy (CEAM). Materials and Methods: We retrospectively reviewed the 18F-FDG PET/CT images of 33 patients with chronic empyema, and analyzed the following findings: 1) shape of the empyema cavity, 2) presence of fistula, 3) maximum standardized uptake value (SUV) of the empyema cavity, 4) uptake pattern of the empyema cavity, 5) presence of a protruding soft tissue mass within the empyema cavity, and 6) involvement of adjacent structures. Final diagnosis was determined based on histopathology or clinical follow-up for at least 6 months. The abovementioned findings were compared between the 18F-FDG PET/CT images of CEAM and chronic empyema. A receiver operating characteristic (ROC) analysis was also performed. Results: Six lesions were histopathologically proven as malignant; there were three cases of diffuse large B-cell lymphoma, two of squamous cell carcinoma, and one of poorly differentiated carcinoma. Maximum SUV within the empyema cavity (p < 0.001) presence of a protruding soft tissue mass (p = 0.002), and involvement of the adjacent structures (p < 0.001) were significantly different between the CEAM and chronic empyema images. The maximum SUV exhibited the highest diagnostic performance, with the highest specificity (96.3%, 26/27), positive predictive value (85.7%, 6/7), and accuracy (97.0%, 32/33) among all criteria. On ROC analysis, the area under the curve of maximum SUV was 0.994. Conclusion: 18F-FDG PET/CT can be useful for diagnosing CEAM in patients with chronic empyema. The maximum SUV within the empyema cavity is the most accurate 18F-FDG PET/CT diagnostic criterion for CEAM.

Comparison of Monoexponential, Biexponential, Stretched-Exponential, and Kurtosis Models of Diffusion-Weighted Imaging in Differentiation of Renal Solid Masses

  • Jianjian Zhang;Shiteng Suo;Guiqin Liu;Shan Zhang;Zizhou Zhao;Jianrong Xu;Guangyu Wu
    • Korean Journal of Radiology
    • /
    • 제20권5호
    • /
    • pp.791-800
    • /
    • 2019
  • Objective: To compare various models of diffusion-weighted imaging including monoexponential apparent diffusion coefficient (ADC), biexponential (fast diffusion coefficient [Df], slow diffusion coefficient [Ds], and fraction of fast diffusion), stretched-exponential (distributed diffusion coefficient and anomalous exponent term [α]), and kurtosis (mean diffusivity and mean kurtosis [MK]) models in the differentiation of renal solid masses. Materials and Methods: A total of 81 patients (56 men and 25 women; mean age, 57 years; age range, 30-69 years) with 18 benign and 63 malignant lesions were imaged using 3T diffusion-weighted MRI. Diffusion model selection was investigated in each lesion using the Akaike information criteria. Mann-Whitney U test and receiver operating characteristic (ROC) analysis were used for statistical evaluations. Results: Goodness-of-fit analysis showed that the stretched-exponential model had the highest voxel percentages in benign and malignant lesions (90.7% and 51.4%, respectively). ADC, Ds, and MK showed significant differences between benign and malignant lesions (p < 0.05) and between low- and high-grade clear cell renal cell carcinoma (ccRCC) (p < 0.05). α was significantly lower in the benign group than in the malignant group (p < 0.05). All diffusion measures showed significant differences between ccRCC and non-ccRCC (p < 0.05) except Df and α (p = 0.143 and 0.112, respectively). α showed the highest diagnostic accuracy in differentiating benign and malignant lesions with an area under the ROC curve of 0.923, but none of the parameters from these advanced models revealed significantly better performance over ADC in discriminating subtypes or grades of renal cell carcinoma (RCC) (p > 0.05). Conclusion: Compared with conventional diffusion parameters, α may provide additional information for differentiating benign and malignant renal masses, while ADC remains the most valuable parameter for differentiation of RCC subtypes and for ccRCC grading.

Distinguishing between Thymic Epithelial Tumors and Benign Cysts via Computed Tomography

  • Sang Hyup Lee;Soon Ho Yoon;Ju Gang Nam;Hyung Jin Kim;Su Yeon Ahn;Hee Kyung Kim;Hyun Ju Lee;Hwan Hee Lee;Gi Jeong Cheon;Jin Mo Goo
    • Korean Journal of Radiology
    • /
    • 제20권4호
    • /
    • pp.671-682
    • /
    • 2019
  • Objective: To investigate whether computed tomography (CT) and fluorine-18-labeled fluoro-2-deoxy-D-glucose (FDG) positron emission tomography (PET) may be applied to distinguish thymic epithelial tumors (TETs) from benign cysts in the anterior mediastinum. Materials and Methods: We included 262 consecutive patients with pathologically proven TETs and benign cysts 5 cm or smaller who underwent preoperative CT scans. In addition to conventional morphological and ancillary CT findings, the relationship between the lesion and the adjacent mediastinal pleura was evaluated qualitatively and quantitatively. Mean lesion attenuation was measured on CT images. The maximum standardized uptake value (SUVmax) was obtained with FDG-PET scans in 40 patients. CT predictors for TETs were identified with multivariate logistic regression analysis. For validation, we assessed the diagnostic accuracy and inter-observer agreement between four radiologists in a size-matched set of 24 cysts and 24 TETs using a receiver operating characteristic curve before and after being informed of the study findings. Results: The multivariate analysis showed that post-contrast attenuation of 60 Hounsfield unit or higher (odds ratio [OR], 12.734; 95% confidence interval [CI], 2.506-64.705; p = 0.002) and the presence of protrusion from the mediastinal pleura (OR, 9.855; 95% CI, 1.749-55.535; p = 0.009) were the strongest CT predictors for TETs. SUVmax was significantly higher in TETs than in cysts (5.3 ± 2.4 vs. 1.1 ± 0.3; p < 0.001). After being informed of the study findings, the readers' area under the curve improved from 0.872-0.955 to 0.949-0.999 (p = 0.066-0.149). Inter-observer kappa values for protrusion were 0.630-0.941. Conclusion: Post-contrast CT attenuation, protrusion from the mediastinal pleura, and SUVmax were useful imaging features for distinguishing TETs from cysts in the anterior mediastinum.

Role of Myocardial Extracellular Volume Fraction Measured with Magnetic Resonance Imaging in the Prediction of Left Ventricular Functional Outcome after Revascularization of Chronic Total Occlusion of Coronary Arteries

  • Yinyin Chen;Xinde Zheng;Hang Jin;Shengming Deng;Daoyuan Ren;Andreas Greiser;Caixia Fu;Hongxiang Gao;Mengsu Zeng
    • Korean Journal of Radiology
    • /
    • 제20권1호
    • /
    • pp.83-93
    • /
    • 2019
  • Objective: The purpose of this study was to prospectively investigate the value of the myocardial extracellular volume fraction (ECV) in predicting myocardial functional outcome after revascularization of coronary chronic total occlusion (CTO). Materials and Methods: Thirty patients with CTO underwent cardiovascular magnetic resonance (CMR) before and 6 months after revascularization. Three baseline markers of functional outcome were evaluated in the dysfunctional segments assigned to the CTO vessels: ECV, transmural extent of infarction (TEI), and unenhanced rim thickness (RIM). At the global level, the ECV values of the whole myocardium with and without a hyperenhanced region (global and remote ECV) were respectively measured. Results: In per-segment analysis, ECV was superior to TEI and RIM in predicting functional recovery (area under receiver operating characteristic curve [AUC]: 0.86 vs. 0.75 and 0.73, all p values < 0.010), and it emerged as the only independent predictor of regional functional outcome (odds ratio [OR] = 0.83, 95% confidence interval [CI]: 0.77-0.89; p < 0.001) independent of collateral circulation. In per-patient analysis, global baseline ECV was indicative of ejection fraction (EF) at the follow-up examination (β = -0.61, p < 0.001) and changes in EF (β = -0.57, p = 0.001) in multivariate regression analysis. A patient with global baseline ECV less than 30.0% (AUC, 0.93; sensitivity 94%, specificity 80%) was more likely to demonstrate significant EF improvement (OR: 0.38; 95% CI: 0.17-0.85; p = 0.019). Conclusion: Extracellular volume fraction obtained by CMR may provide incremental value for the prediction of functional recovery both at the segmental and global levels in CTO patients, and may facilitate the identification of patients who can benefit from revascularization.

만성폐쇄성폐질환자에서 기류제한 및 COPD 복합지수와 말초산소포화도의 연관성 (Association of Airflow Limitation and COPD Composite Index with Peripheral Oxygen Saturation in Patients with Chronic Obstructive Pulmonary Disease)

  • 이종성;신재훈;백진이;손혜림;최병순
    • 한국산업보건학회지
    • /
    • 제34권1호
    • /
    • pp.57-66
    • /
    • 2024
  • Objective: Chronic obstructive pulmonary disease (COPD) is characterized by progressive airflow obstruction that is only partly reversible, inflammation in the airways, and systemic effects. This study aimed to investigate the association between low peripheral oxygen saturation levels (SpO2), and composite indices predicting death in male patients with (COPD). Method: A total of 140 participants with post-bronchodilator FEV1/FVC ratio less than 0.7 were included. Three composite indices (ADO, DOSE, BODEx) were calculated using six variables such as age (A), airflow obstruction (O), body mass index (B), dyspnea (D), exacerbation history (E or Ex), and smoking status (S). Severity of airflow limitation was classified according to Global Initiative for Obstructive Lung Disease (GOLD) guidelines. SpO2 was measured by pulse oximetry, and anemia and iron deficiency were assessed based on blood hemoglobin levels and serum markers such as ferritin, transferrin saturation, or soluble transferrin receptor. Results: Participants with low SpO2 (<95%) showed significantly lower levels of %FEV1 predicted (p=0.020) and %FEV1/FVC ratio (p=0.002) compared to those with normal SpO2 levels. The mMRC dyspnea scale (p<0.001) and GOLD grade (p=0.002) showed a significant increase in the low SpO2 group. Receiver Operating Characteristic analysis revealed higher area under the curve for %FEV1 (p=0.020), %FEV1/FVC(p=0.002), mMRC dyspnea scale (p=0.001), GOLD grade (p=0.010), ADO (p=0.004), DOSE (p=0.002), and BODEx (p=0.011) in the low SpO2 group. Conclusion: These results suggest that low SpO2 levels are related to increased airflow limitation and the composite indices of COPD.