Improving the Performance of Radiologists Using Artificial Intelligence-Based Detection Support Software for Mammography: A Multi-Reader Study
-
- Korean Journal of Radiology
- /
- v.23 no.5
- /
- pp.505-516
- /
- 2022
Objective: To evaluate whether artificial intelligence (AI) for detecting breast cancer on mammography can improve the performance and time efficiency of radiologists reading mammograms. Materials and Methods: A commercial deep learning-based software for mammography was validated using external data collected from 200 patients, 100 each with and without breast cancer (40 with benign lesions and 60 without lesions) from one hospital. Ten readers, including five breast specialist radiologists (BSRs) and five general radiologists (GRs), assessed all mammography images using a seven-point scale to rate the likelihood of malignancy in two sessions, with and without the aid of the AI-based software, and the reading time was automatically recorded using a web-based reporting system. Two reading sessions were conducted with a two-month washout period in between. Differences in the area under the receiver operating characteristic curve (AUROC), sensitivity, specificity, and reading time between reading with and without AI were analyzed, accounting for data clustering by readers when indicated. Results: The AUROC of the AI alone, BSR (average across five readers), and GR (average across five readers) groups was 0.915 (95% confidence interval, 0.876-0.954), 0.813 (0.756-0.870), and 0.684 (0.616-0.752), respectively. With AI assistance, the AUROC significantly increased to 0.884 (0.840-0.928) and 0.833 (0.779-0.887) in the BSR and GR groups, respectively (p = 0.007 and p < 0.001, respectively). Sensitivity was improved by AI assistance in both groups (74.6% vs. 88.6% in BSR, p < 0.001; 52.1% vs. 79.4% in GR, p < 0.001), but the specificity did not differ significantly (66.6% vs. 66.4% in BSR, p = 0.238; 70.8% vs. 70.0% in GR, p = 0.689). The average reading time pooled across readers was significantly decreased by AI assistance for BSRs (82.73 vs. 73.04 seconds, p < 0.001) but increased in GRs (35.44 vs. 42.52 seconds, p < 0.001). Conclusion: AI-based software improved the performance of radiologists regardless of their experience and affected the reading time.
This study was conducted to investigate the plant-parasitic nematodes of ornamental foliage plants, citrus orchards, and tea plantations from July to December 2022. As a result of the investigation of plant-parasitic nematodes in 415 foliage plants, root-lesion nematodes were detected most frequently, followed by root-knot nematodes, pin nematodes, and other nematodes. In tea plantations, spiral nematodes, cyst nematodes, and root-knot nematodes were detected. Citrus nematodes, ring nematodes, and root-knot nematodes were discovered in citrus orchards. In foliage plants, tea plantations, and citrus orchards, the detection rate of plant-parasitic nematodes was not high, but root-lesion nematodes were detected. Therefore, it is necessary to apply appropriate control methods to manage root-lesion nematodes during the cultivation of foliage, tea, and citrus plants.
Objective: To investigate the clinical feasibility of synthetic diffusion-weighted imaging (sDWI) at different b-values in patients with breast cancer by assessing the diagnostic image quality and the quantitative measurements compared with conventional diffusion-weighted imaging (cDWI). Materials and Methods: Fifty patients with breast cancer were assessed using cDWI at b-values of 800 and 1500 s/mm2 (cDWI800 and cDWI1500) and sDWI at b-values of 1000 and 1500 s/mm2 (sDWI1000 and sDWI1500). Qualitative analysis (normal glandular tissue suppression, overall image quality, and lesion conspicuity) was performed using a 4-point Likert-scale for all DWI sets and the cancer detection rate (CDR) was calculated. We also evaluated cancer-to-parenchyma contrast ratios for each DWI set in 45 patients with the lesion identified on any of the DWI sets. Statistical comparisons were performed using Friedman test, one-way analysis of variance, and Cochran's Q test. Results: All parameters of qualitative analysis, cancer-to-parenchyma contrast ratios, and CDR increased with increasing b-values, regardless of the type of imaging (synthetic or conventional) (p < 0.001). Additionally, sDWI1500 provided better lesion conspicuity than cDWI1500 (3.52 ± 0.92 vs. 3.39 ± 0.90, p < 0.05). Although cDWI1500 showed better normal glandular tissue suppression and overall image quality than sDWI1500 (3.66 ± 0.78 and 3.73 ± 0.62 vs. 3.32 ± 0.90 and 3.35 ± 0.81, respectively; p < 0.05), there was no significant difference in their CDR (90.0%). Cancer-to-parenchyma contrast ratios were greater in sDWI1500 than in cDWI1500 (0.63 ± 0.17 vs. 0.55 ± 0.18, p < 0.001). Conclusion: sDWI1500 can be feasible for evaluating breast cancers in clinical practice. It provides higher tumor conspicuity, better cancer-to-parenchyma contrast ratio, and comparable CDR when compared with cDWI1500.
Purpose This study aimed to compare the diagnostic performance of cardiac CT and transthoracic echocardiogram (TTE) depending on the degree of valvular calcification and bicuspid aortic valve (BAV) subtype. Materials and Methods This retrospective study included 266 consecutive patients (106 with BAV and 160 with tricuspid aortic valve) who underwent cardiac CT and TTE before aortic valve replacement. Cardiac CT was used to evaluate the morphology of the aortic valve, and a calcium scoring scan was used to quantify valve calcium. The aortic valves were classified into fused and two-sinus types. The diagnostic accuracy of cardiac CT and TTE was calculated using a reference standard for intraoperative inspection. Results CT demonstrated significantly higher sensitivity, negative predictive value, and accuracy than TTE in detecting BAV (p < 0.001, p < 0.001, and p = 0.003, respectively). The TTE sensitivity tended to decrease as valvular calcification increased. The error rate of TTE for CT was 10.9% for the twosinus type of BAV and 28.3% for the fused type (p = 0.044). Conclusion Cardiac CT had a higher diagnostic performance in detecting BAV than TTE and may help diagnose BAV, particularly in patients with severe valvular calcification.
Background/Aims: Epidermal growth factor receptor (EGFR) mutation is important in determining the treatment strategy for advanced lung cancer patients with malignant pleural effusion (MPE). Contrary to serum carcinoembryonic antigen (S-CEA) levels, the associations between pleural fluid CEA (PF-CEA) levels and EGFR mutation status as well as between PF-CEA levels and treatment efficacy have rarely been investigated in lung adenocarcinoma patients with MPE. Methods: This retrospective study enrolled lung adenocarcinoma patients with MPE and available PF-CEA levels and EGFR mutation results. The patients were categorized based on PF-CEA levels: < 10 ng/mL, 10-100 ng/mL, 100-500 ng/mL, and ≥ 500 ng/mL. The association between PF-CEA levels and EGFR mutation status as well as their therapeutic impact on overall survival was compared among the four groups. Results: This study included 188 patients. PF-CEA level was found to be an independent predictor of EGFR mutation but not S-CEA level. The EGFR mutation rates were higher as the PF-CEA levels increased, regardless of cytology results or sample types. Among EGFR-mutant lung adenocarcinoma patients receiving EGFR-tyrosine kinase inhibitor (TKI) treatment, those with high PF-CEA levels had significantly better survival outcomes than those with low PF-CEA levels. Conclusion: High PF-CEA levels were associated with high EGFR mutation rate and may lead to a favorable clinical outcome of EGFR-TKI treatment in EGFR-mutant lung adenocarcinoma patients with MPE. These findings highlight the importance of actively investigating EGFR mutation detection in patients with suspected MPE and elevated PF-CEA levels despite negative cytology results.
Recently, there have been cases reported in the news of individuals experiencing symptoms of food poisoning after consuming raw beef purchased from online platforms, or reviews claiming that cherry tomatoes tasted bitter. This suggests the potential for analyzing food reviews on online platforms to detect food hazards, enabling government agencies, food manufacturers, and distributors to manage consumer food safety risks. This study proposes a classification model that uses sentiment analysis and large language models to analyze food reviews and detect negative ones, multi-labeling key food safety hazards (food poisoning, spoilage, chemical odors, foreign objects). The sentiment analysis model effectively minimized the misclassification of negative reviews with a low False Positive rate using a 'funnel' model. The multi-labeling model for food safety hazards showed high performance with both recall and accuracy over 96% when using GPT-4 Turbo compared to GPT-3.5. Government agencies, food manufacturers, and distributors can use the proposed model to monitor consumer reviews in real-time, detect potential food safety issues early, and manage risks. Such a system can protect corporate brand reputation, enhance consumer protection, and ultimately improve consumer health and safety.
Massive multiplayer online role playing game (MMORPG) is a common type of game these days. Predicting user churn in MMORPG is a crucial task. The retention rate of users is deeply associated with the lifespan and revenue of the service. If the churn of a specific user can be predicted in advance, targeted promotions can be used to encourage their stay. Therefore, not only the accuracy of churn prediction but also the speed at which signs of churn can be detected is important. In this paper, we propose methods to identify early signs of churn by utilizing the daily predicted user retention probabilities. We train various deep learning and machine learning models using log data and estimate user retention probabilities. By analyzing the change patterns in these probabilities, we provide empirical rules for early identification of users at high risk of churn. Performance evaluations confirm that our methodology is more effective at detecting high risk users than existing methods based on login days. Finally, we suggest novel methods for customized marketing strategies. For this purpose, we provide guidelines of the percentage of accessed users who are at risk of churn.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The objective of this study was to investigate the characteristics of various estrous behavior and ovulation time in dairy cows and heifers. In total, 73 ovulations and 61 estrous detection were observed in 89 Holstein cows. Various estrous behavior were observed during 72 hours from two days after