• Title/Summary/Keyword: Performance reporting

Search Result 317, Processing Time 0.023 seconds

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography

  • Ji Soo Choi;Boo-Kyung Han;Eun Sook Ko;Jung Min Bae;Eun Young Ko;So Hee Song;Mi-ri Kwon;Jung Hee Shin;Soo Yeon Hahn
    • Korean Journal of Radiology
    • /
    • v.20 no.5
    • /
    • pp.749-758
    • /
    • 2019
  • Objective: To investigate whether a computer-aided diagnosis (CAD) system based on a deep learning framework (deep learning-based CAD) improves the diagnostic performance of radiologists in differentiating between malignant and benign masses on breast ultrasound (US). Materials and Methods: B-mode US images were prospectively obtained for 253 breast masses (173 benign, 80 malignant) in 226 consecutive patients. Breast mass US findings were retrospectively analyzed by deep learning-based CAD and four radiologists. In predicting malignancy, the CAD results were dichotomized (possibly benign vs. possibly malignant). The radiologists independently assessed Breast Imaging Reporting and Data System final assessments for two datasets (US images alone or with CAD). For each dataset, the radiologists' final assessments were classified as positive (category 4a or higher) and negative (category 3 or lower). The diagnostic performances of the radiologists for the two datasets (US alone vs. US with CAD) were compared Results: When the CAD results were added to the US images, the radiologists showed significant improvement in specificity (range of all radiologists for US alone vs. US with CAD: 72.8-92.5% vs. 82.1-93.1%; p < 0.001), accuracy (77.9-88.9% vs. 86.2-90.9%; p = 0.038), and positive predictive value (PPV) (60.2-83.3% vs. 70.4-85.2%; p = 0.001). However, there were no significant changes in sensitivity (81.3-88.8% vs. 86.3-95.0%; p = 0.120) and negative predictive value (91.4-93.5% vs. 92.9-97.3%; p = 0.259). Conclusion: Deep learning-based CAD could improve radiologists' diagnostic performance by increasing their specificity, accuracy, and PPV in differentiating between malignant and benign masses on breast US.

Diagnostic Performance of Digital Breast Tomosynthesis with the Two-Dimensional Synthesized Mammogram for Suspicious Breast Microcalcifications Compared to Full-Field Digital Mammography in Stereotactic Breast Biopsy (정위적 유방 조직검사 시 미세석회화 의심 병변에서의 디지털 유방단층영상합성법과 전역 디지털 유방촬영술의 진단능 비교)

  • Jiwon Shin;Ok Hee Woo;Hye Seon Shin;Sung Eun Song;Kyu Ran Cho;Bo Kyoung Seo
    • Journal of the Korean Society of Radiology
    • /
    • v.83 no.5
    • /
    • pp.1090-1103
    • /
    • 2022
  • Purpose To evaluate the diagnostic performance of digital breast tomosynthesis (DBT) with the two-dimensional synthesized mammogram (2DSM), compared to full-field digital mammography (FFDM), for suspicious microcalcifications in the breast ahead of stereotactic biopsy and to assess the diagnostic image visibility of the images. Materials and Methods This retrospective study involved 189 patients with microcalcifications, which were histopathologically verified by stereotactic breast biopsy, who underwent DBT with 2DSM and FFDM between January 8, 2015, and January 20, 2020. Two radiologists assessed all cases of microcalcifications based on Breast Imaging Reporting and Data System (BI-RADS) independently. They were blinded to the histopathologic outcome and additionally evaluated lesion visibility using a fivepoint scoring scale. Results Overall, the inter-observer agreement was excellent (0.9559). Under the setting of category 4A as negative due to the low possibility of malignancy and to avoid the dilution of malignancy criteria in our study, McNemar tests confirmed no significant difference between the performances of the two modalities in detecting microcalcifications with a high potential for malignancy (4B, 4C, or 5; p = 0.1573); however, the tests showed a significant difference between their performances in detecting microcalcifications with a high potential for benignancy (4A; p = 0.0009). DBT with 2DSM demonstrated superior visibility and diagnostic performance than FFDM in dense breasts. Conclusion DBT with 2DSM is superior to FFDM in terms of total diagnostic accuracy and lesion visibility for benign microcalcifications in dense breasts. This study suggests a promising role for DBT with 2DSM as an accommodating tool for stereotactic biopsy in female with dense breasts and suspicious breast microcalcifications.

Assessment of Additional MRI-Detected Breast Lesions Using the Quantitative Analysis of Contrast-Enhanced Ultrasound Scans and Its Comparability with Dynamic Contrast-Enhanced MRI Findings of the Breast (유방자기공명영상에서 추가적으로 발견된 유방 병소에 대한 조영증강 초음파의 정량적 분석을 통한 진단 능력 평가와 동적 조영증강 유방 자기공명영상 결과와의 비교)

  • Sei Young Lee;Ok Hee Woo;Hye Seon Shin;Sung Eun Song;Kyu Ran Cho;Bo Kyoung Seo;Soon Young Hwang
    • Journal of the Korean Society of Radiology
    • /
    • v.82 no.4
    • /
    • pp.889-902
    • /
    • 2021
  • Purpose To assess the diagnostic performance of contrast-enhanced ultrasound (CEUS) for additional MR-detected enhancing lesions and to determine whether or not kinetic pattern results comparable to dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) of the breast can be obtained using the quantitative analysis of CEUS. Materials and Methods In this single-center prospective study, a total of 71 additional MR-detected breast lesions were included. CEUS examination was performed, and lesions were categorized according to the Breast Imaging-Reporting and Data System (BI-RADS). The sensitivity, specificity, and diagnostic accuracy of CEUS were calculated by comparing the BI-RADS category to the final pathology results. The degree of agreement between CEUS and DCE-MRI kinetic patterns was evaluated using weighted kappa. Results On CEUS, 46 lesions were assigned as BI-RADS category 4B, 4C, or 5, while 25 lesions category 3 or 4A. The diagnostic performance of CEUS for enhancing lesions on DCE-MRI was excellent, with 84.9% sensitivity, 94.4% specificity, and 97.8% positive predictive value. A total of 57/71 (80%) lesions had correlating kinetic patterns and showed good agreement (weighted kappa = 0.66) between CEUS and DCE-MRI. Benign lesions showed excellent agreement (weighted kappa = 0.84), and invasive ductal carcinoma (IDC) showed good agreement (weighted kappa = 0.69). Conclusion The diagnostic performance of CEUS for additional MR-detected breast lesions was excellent. Accurate kinetic pattern assessment, fairly comparable to DCE-MRI, can be obtained for benign and IDC lesions using CEUS.

Analysis of Basic Life Support Performance According to Video simulation training of EMT Students (응급구조과 학생의 동영상 시뮬레이션 교육에 따른 기본소생술 수행능력 분석)

  • Won, Young-Duck
    • The Korean Journal of Emergency Medical Services
    • /
    • v.15 no.3
    • /
    • pp.5-17
    • /
    • 2011
  • purpose : The purpose of this study was to analyze the effect of basic life support performance by video simulation training. Methods : The subjects in this study consisted of 24 persons of experimental group and 24 persons of control group in freshmen and sophomore EMT students. The data were collected from September 1 to 30, 2010. Results : 1. Hypothesis one: experimental group is meaningful higher than control group at the operation point (p<0.05) of adult/infant's basic life support for one person. In subcategory that identifying breath, artificial respiration, pulse rate, 30 compressions, Ability to perform all the processes, the experimental group showed statistically higher score (p<0.05) than control group, and sequence from checking reaction to keeping airway management isn't statistically significant difference between experimental group and control. 2. Hypothesis two: In the hypothesis, the experimental group's point of adult basic life support by two persons and use of Automated External Defibrillator is good in experimental group than control group's point(p<0.05). As the result of researching 11 contents of check list about adult basic life support by two persons and Automated External Defibrillator(AED), by dividing into 7 subcategories, every subcategory shows that the experimental group is significant higher than control group(p<0.05). 3. Hypothesis three: In the hypothesis, the experimental group gets higher point of infant basic life support by one or two persons than the control group (p<0.05). As the results of researching 15 contents of check list about infant basic life support by one or two persons, by dividing into 8 subcategories, the experimental group is statistically meaningful higher (p<0.05) than the control group in process of keeping airway, indentifying breathing, identifying pulse, 30 compressions, Ability to perform all the processes. There isn't statistically significant difference between the groups in process of checking reaction, reporting 119, and artificial respiration by giving 2 breaths(p<0.05). Conclusion : As summarizing the results, the group, receiving using video, gets higher points of knowledge of basic life support and operating skill than the general educated group. It is found that the Video simulation training could be effective, because of these positive effects to improve clinical working performance of students, who participate in the department of Emergency Medical Technology.

Should Threshold Growth Be Considered a Major Feature in the Diagnosis of Hepatocellular Carcinoma Using LI-RADS?

  • Jae Hyon Park;Yong Eun Chung;Nieun Seo;Jin-Young Choi;Mi-Suk Park;Myeong-Jin Kim
    • Korean Journal of Radiology
    • /
    • v.22 no.10
    • /
    • pp.1628-1639
    • /
    • 2021
  • Objective: Based on the Liver Imaging Reporting and Data System version 2018 (LI-RADS, v2018), this study aimed to analyze LR-5 diagnostic performance for hepatocellular carcinoma (HCC) when threshold growth as a major feature is replaced by a more HCC-specific ancillary feature, as well as the frequency of threshold growth in HCC and non-HCC malignancies and its association with tumor size. Materials and Methods: This retrospective study included treatment-naive patients who underwent gadoxetate disodium-enhanced MRIs for focal hepatic lesions and surgery between January 2009 and December 2016. The frequency of major and ancillary features was evaluated for HCC and non-HCC malignancies, and the LR-category was assessed. Ancillary features that were significantly more prevalent in HCC were then used to either replace threshold growth or were added as additional major features, and the diagnostic performance of the readjusted LR category was compared to the LI-RADS v2018. Results: A total of 1013 observations were analyzed. Unlike arterial phase hyperenhancement, washout, or enhancing capsule which were more prevalent in HCCs than in non-HCC malignancies (521/616 vs. 18/58, 489/616 vs. 19/58, and 181/616 vs. 5/58, respectively; p < 0.001), threshold growth was more prevalent in non-HCC malignancies than in HCCs (11/23 vs. 17/119; p < 0.001). The mean size of non-HCC malignancies showing threshold growth was significantly smaller than that of non-HCC malignancies without threshold growth (22.2 mm vs. 42.9 mm, p = 0.040). Similar results were found for HCCs; however, the difference was not significant (26.8 mm vs. 33.1 mm, p = 0.184). Additionally, Fat-in-nodule was more frequent in HCCs than in non-HCC malignancies (99/616 vs. 2/58, p = 0.010). When threshold growth and fat-in-nodule were considered as ancillary and major features, respectively, LR-5 sensitivity (73.2% vs. 73.9%, p = 0.289) and specificity (98.2% vs. 98.5%, p > 0.999) were comparable to the LI-RADS v2018. Conclusion: Threshold growth is not a significant diagnostic indicator of HCC and is more common in non-HCC malignancies. The diagnostic performance of LR-5 was comparable when threshold growth was recategorized as an ancillary feature and replaced by a more HCC-specific ancillary feature.

Comparison of One- and Two-Region of Interest Strain Elastography Measurements in the Differential Diagnosis of Breast Masses

  • Hee Jeong Park;Sun Mi Kim;Bo La Yun;Mijung Jang;Bohyoung Kim;Soo Hyun Lee;Hye Shin Ahn
    • Korean Journal of Radiology
    • /
    • v.21 no.4
    • /
    • pp.431-441
    • /
    • 2020
  • Objective: To compare the diagnostic performance and interobserver variability of strain ratio obtained from one or two regions of interest (ROI) on breast elastography. Materials and Methods: From April to May 2016, 140 breast masses in 140 patients who underwent conventional ultrasonography (US) with strain elastography followed by US-guided biopsy were evaluated. Three experienced breast radiologists reviewed recorded US and elastography images, measured strain ratios, and categorized them according to the American College of Radiology breast imaging reporting and data system lexicon. Strain ratio was obtained using the 1-ROI method (one ROI drawn on the target mass), and the 2-ROI method (one ROI in the target mass and another in reference fat tissue). The diagnostic performance of the three radiologists among datasets and optimal cut-off values for strain ratios were evaluated. Interobserver variability of strain ratio for each ROI method was assessed using intraclass correlation coefficient values, Bland-Altman plots, and coefficients of variation. Results: Compared to US alone, US combined with the strain ratio measured using either ROI method significantly improved specificity, positive predictive value, accuracy, and area under the receiver operating characteristic curve (AUC) (all p values < 0.05). Strain ratio obtained using the 1-ROI method showed higher interobserver agreement between the three radiologists without a significant difference in AUC for differentiating breast cancer when the optimal strain ratio cut-off value was used, compared with the 2-ROI method (AUC: 0.788 vs. 0.783, 0.693 vs. 0.715, and 0.691 vs. 0.686, respectively, all p values > 0.05). Conclusion: Strain ratios obtained using the 1-ROI method showed higher interobserver agreement without a significant difference in AUC, compared to those obtained using the 2-ROI method. Considering that the 1-ROI method can reduce performers' efforts, it could have an important role in improving the diagnostic performance of breast US by enabling consistent management of breast lesions.

Diagnostic Performance of 2018 KLCA-NCC Practice Guideline for Hepatocellular Carcinoma on Gadoxetic Acid-Enhanced MRI in Patients with Chronic Hepatitis B or Cirrhosis: Comparison with LI-RADS Version 2018

  • Sang Min Lee;Jeong Min Lee;Su Joa Ahn;Hyo-Jin Kang;Hyun Kyung Yang;Jeong Hee Yoon
    • Korean Journal of Radiology
    • /
    • v.22 no.7
    • /
    • pp.1066-1076
    • /
    • 2021
  • Objective: To evaluate the performance of the 2018 Korean Liver Cancer Association-National Cancer Center (KLCA-NCC) Practice Guidelines (hereafter, PG) for the diagnosis of hepatocellular carcinoma (HCC) using gadoxetic acid-enhanced MRI, compared to the Liver Imaging-Reporting and Data System (LI-RADS) version 2018 (hereafter, v2018). Materials and Methods: From January 2013 to October 2015, treatment-naïve hepatic lesions (≥ 1 cm) on gadoxetic acid-enhanced MRI in consecutive patients with chronic hepatitis B or cirrhosis were retrospectively evaluated. For each lesion, three radiologists independently analyzed the imaging features and classified the lesions into categories according to the 2018 KLCA-NCC PG and LI-RADS v2018. The imaging features and categories were determined by consensus. Generalized estimating equation (GEE) models were used to compare the per-lesion diagnostic performance of the 2018 KLCA-NCC PG and LI-RADS v2018 using the consensus data. Results: In total, 422 lesions (234 HCCs, 45 non-HCC malignancies, and 143 benign lesions) from 387 patients (79% male; mean age, 59 years) were included. In all lesions, the definite HCC (2018 KLCA-NCC PG) had a higher sensitivity and lower specificity than LR-5 (LI-RADS v2018) (87.2% [204/234] vs. 80.8% [189/234], p < 0.001; 86.2% [162/188] vs. 91.0% [171/188], p = 0.002). However, in lesions of size ≥ 2 cm, the definite HCC had a higher sensitivity than the LR-5 (86.8% [164/189] vs. 82.0 (155/189), p = 0.002) without a reduction in the specificity (80.0% [48/60] vs. 83.3% [50/60], p = 0.15). In all lesions, the sensitivity and specificity of the definite/probable HCC (2018 KLCA-NCC PG) and LR-5/4 did not differ significantly (89.7% [210/234] vs. 91.5% [214/234], p = 0.204; 83.5% [157/188] vs. 79.3% [149/188], p = 0.071). Conclusion: For the diagnosis of HCC of size ≥ 2 cm, the definite HCC (2018 KLCA-NCC PG) had a higher sensitivity than LR-5, without a reduction in specificity. The definite/probable HCC (2018 KLCA-NCC PG) had a similar sensitivity and specificity to that those of the LR-5/4.

Improving the Performance of Radiologists Using Artificial Intelligence-Based Detection Support Software for Mammography: A Multi-Reader Study

  • Jeong Hoon Lee;Ki Hwan Kim;Eun Hye Lee;Jong Seok Ahn;Jung Kyu Ryu;Young Mi Park;Gi Won Shin;Young Joong Kim;Hye Young Choi
    • Korean Journal of Radiology
    • /
    • v.23 no.5
    • /
    • pp.505-516
    • /
    • 2022
  • Objective: To evaluate whether artificial intelligence (AI) for detecting breast cancer on mammography can improve the performance and time efficiency of radiologists reading mammograms. Materials and Methods: A commercial deep learning-based software for mammography was validated using external data collected from 200 patients, 100 each with and without breast cancer (40 with benign lesions and 60 without lesions) from one hospital. Ten readers, including five breast specialist radiologists (BSRs) and five general radiologists (GRs), assessed all mammography images using a seven-point scale to rate the likelihood of malignancy in two sessions, with and without the aid of the AI-based software, and the reading time was automatically recorded using a web-based reporting system. Two reading sessions were conducted with a two-month washout period in between. Differences in the area under the receiver operating characteristic curve (AUROC), sensitivity, specificity, and reading time between reading with and without AI were analyzed, accounting for data clustering by readers when indicated. Results: The AUROC of the AI alone, BSR (average across five readers), and GR (average across five readers) groups was 0.915 (95% confidence interval, 0.876-0.954), 0.813 (0.756-0.870), and 0.684 (0.616-0.752), respectively. With AI assistance, the AUROC significantly increased to 0.884 (0.840-0.928) and 0.833 (0.779-0.887) in the BSR and GR groups, respectively (p = 0.007 and p < 0.001, respectively). Sensitivity was improved by AI assistance in both groups (74.6% vs. 88.6% in BSR, p < 0.001; 52.1% vs. 79.4% in GR, p < 0.001), but the specificity did not differ significantly (66.6% vs. 66.4% in BSR, p = 0.238; 70.8% vs. 70.0% in GR, p = 0.689). The average reading time pooled across readers was significantly decreased by AI assistance for BSRs (82.73 vs. 73.04 seconds, p < 0.001) but increased in GRs (35.44 vs. 42.52 seconds, p < 0.001). Conclusion: AI-based software improved the performance of radiologists regardless of their experience and affected the reading time.

Dieticians' Perceived Performance Level and Obstructive Factors of HACCP System among Elementary School Food Services in Gyeongbuk Province (경북지역 초등학교 영양(교)사의 학교급식 HACCP 시스템 수행 수준 및 장애요인 인식)

  • Yang, Ji Hye;Sung, Bo Mi;Kim, Mi Hwa;Jung, Hyun Sook;Cha, Myeong Hwa;Ryu, Kyung
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.43 no.11
    • /
    • pp.1774-1784
    • /
    • 2014
  • The purpose of this study was to determine obstructive factors and performance level of the HACCP system among elementary schools in Gyeongbuk province. E-mail survey targeted 320 dieticians, and recovery rate was 74.1%. Consequently, 227 responses were analyzed. The questionnaire was composed of 58 items under four sections (general characteristics, dieticians' perceived HACCP performance level, dieticians' perceived CCP performance level, and obstructive factors of HACCP system implementation). The item with the highest rate of HACCP performance level was 'HACCP training for foodservice employees in schools ($4.02{\pm}0.70$)' while the lowest counterpart was 'implementation of HACCP team meeting, reporting, and maintenance ($2.74{\pm}0.99$)'. The performance level of the item 'HACCP training for foodservice employees in schools' was perceived as highest when the number of students eating school meals was greater than 1,101 (P<0.05). Moreover, CCP 4 ($4.44{\pm}0.53$) and CP 5 ($4.44{\pm}0.51$) showed the best performance, whereas CCP 1 showed the lowest performance level ($3.90{\pm}0.60$). Therefore, reinforcement of hygiene instruction in menu planning is perceived as necessary. CCP 1, CCP 6 (P<0.05), and CCP 3 (P<0.001) showed significant differences in performance based on the number of students eating school meals. Further, according to results regarding obstructive factors of HACCP system execution, 'general factor' was the most severe obstructive factor in the application of HACCP ($3.46{\pm}0.62$). Among the 'factors pertaining to dieticians', the item 'hardship of proper monitoring and micro-management due to overwhelming workload' was most influential ($3.46{\pm}0.96$). Furthermore, the item 'low budget allocation by educational offices ($3.90{\pm}0.88$)' was influential among the 'factors pertaining to school administrations'. In conclusion, the results of this research can help solve obstructive factors of elementary school food services and provide knowledge that is essential for the proper implementation of HACCP.

A Case Study of Metastatic Cholangiocarcinoma with Sepsis who Showed Symptomatic Improvement after Treated with Handayeolso-tang, Fel Tauri, and Antibiotics (전이된 담도암 환자의 패혈증을 한다열소탕 및 우담과 항생제를 병행하여 치료한 환자 1례)

  • Lee, Soo-Min;Choi, Seong-Heon;Song, An-Na;Lee, Ji-Young;Chae, Jin;Jung, Eu-Hong;Lee, Soo-Kyung
    • Journal of Sasang Constitutional Medicine
    • /
    • v.25 no.4
    • /
    • pp.432-441
    • /
    • 2013
  • Objectives Despite the treatment with antibiotics, patients with sepsis has a high mortality (80%) in the underlying disease group. The aim of this study was to report the improvement of septic condition of the cholangiocarcinoma patient after the treatment with Handayeolso-tang, Fel Tauri, and antibiotics. Methods We retrospectively reviewed the medical records. The patient's subjective symptoms such as chilling and abdominal pain were evaluated by NRS and the performance status was evaluated by ECOG. This case was literally compared with relevant published studies on prognosis of sepsis. Results Despite poor prognostic factor(MEDS score 18), the patient's symptoms such as fever, chilling, abdominal pain, and diarrhea and ECOG(Eastern Cooperative Oncology Group) improved. The patient was hemodynamically stabilized on 3rd day from the treatment, and her laboratory test results were normalized on 7th day. Conclusions A female patient of metastatic cholangiocarcinoma came to the hospital for cholangitis, later causing septic shock. Both her symptoms and laboratory tests showed significant improvement after the treatment of antibiotics, Handayeolso-tang and Fel Tauri. To our knowledge, this is the first case reporting the synergistic combination of Korean oriental medicine and Western medicine approaching to sepsis.