• Title/Summary/Keyword: Diagnostic validation

Search Result 167, Processing Time 0.024 seconds

Validation of a Diagnostic Model for Core Competencies at the Higher Education Institute in Korea

  • Kim, Sung-Wan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.1
    • /
    • pp.197-206
    • /
    • 2019
  • The purpose of this study is to develop and validate a model for diagnosing core competencies at the higher education level. Based on literature reviews, a potential model for core competencies at university was suggested. A tool for validating the model was composed of 24 items, which were delivered to 226 professors and administrative staffs, 730 students, and 134 graduates & external industrial experts. Five constructs (core competencies) were extracted from the data collected among professors and administrative staff responding to the importance of the items. The results of importance and performance surveys on core competencies with students were respectively 3.28 to 3.66 and 2.68 to 3.28 (4-point Likert scale). Statistical differences between importance level and performance level were found in all the sub-categories of core competencies. Borich priority determination formula and Locus for Focus Model were used for the determination of the priority of needs. Importance survey among graduates and external experts showed that the mean of each items ranged from 2.80 to 3.76 (4-point Likert scale). The overall results of the analyses suggest that the final model is appropriate for measuring the core competencies.

Exosomal miR-181b-5p Downregulation in Ascites Serves as a Potential Diagnostic Biomarker for Gastric Cancer-associated Malignant Ascites

  • Yun, Jieun;Han, Sang-Bae;Kim, Hong Jun;Go, Se-il;Lee, Won Sup;Bae, Woo Kyun;Cho, Sang-Hee;Song, Eun-Kee;Lee, Ok-Jun;Kim, Hee Kyung;Yang, Yaewon;Kwon, Jihyun;Chae, Hee Bok;Lee, Ki Hyeong;Han, Hye Sook
    • Journal of Gastric Cancer
    • /
    • v.19 no.3
    • /
    • pp.301-314
    • /
    • 2019
  • Purpose: Peritoneal carcinomatosis in gastric cancer (GC) patients results in extremely poor prognosis. Malignant ascites samples are the most appropriate biological material to use to evaluate biomarkers for peritoneal carcinomatosis. This study identified exosomal MicroRNAs (miRNAs) differently expressed between benign liver cirrhosis-associated ascites (LC-ascites) and malignant gastric cancer-associated ascites (GC-ascites), and validated their role as diagnostic biomarkers for GC-ascites. Materials and Methods: Total RNA was extracted from exosomes isolated from 165 ascites samples (73 LC-ascites and 92 GC-ascites). Initially, microarrays were used to screen the expression levels of 2,006 miRNAs in the discovery cohort (n=22). Subsequently, quantitative reverse transcriptase-polymerase chain reaction (qRT-PCR) analyses were performed to validate the expression levels of selected exosomal miRNAs in the training (n=70) and validation (n=73) cohorts. Furthermore, carcinoembryonic antigen (CEA) levels were determined in ascites samples. Results: The miR-574-3p, miR-181b-5p, miR-4481, and miR-181d were significantly downregulated in the GC-ascites samples compared to the LC-ascites samples, and miR-181b-5p showed the best diagnostic performance for GC-ascites (area under the curve [AUC]=0.798 and 0.846 for the training and validation cohorts, respectively). The diagnostic performance of CEA for GC-ascites was improved by the combined analysis of miR-181b-5p and CEA (AUC=0.981 and 0.946 for the training and validation cohorts, respectively). Conclusions: We identified exosomal miRNAs capable of distinguishing between non-malignant and GC-ascites, showing that the combined use of miR-181b-5p and CEA could improve diagnosis.

Development and Validation of a Model Using Radiomics Features from an Apparent Diffusion Coefficient Map to Diagnose Local Tumor Recurrence in Patients Treated for Head and Neck Squamous Cell Carcinoma

  • Minjae Kim;Jeong Hyun Lee;Leehi Joo;Boryeong Jeong;Seonok Kim;Sungwon Ham;Jihye Yun;NamKug Kim;Sae Rom Chung;Young Jun Choi;Jung Hwan Baek;Ji Ye Lee;Ji-hoon Kim
    • Korean Journal of Radiology
    • /
    • v.23 no.11
    • /
    • pp.1078-1088
    • /
    • 2022
  • Objective: To develop and validate a model using radiomics features from apparent diffusion coefficient (ADC) map to diagnose local tumor recurrence in head and neck squamous cell carcinoma (HNSCC). Materials and Methods: This retrospective study included 285 patients (mean age ± standard deviation, 62 ± 12 years; 220 male, 77.2%), including 215 for training (n = 161) and internal validation (n = 54) and 70 others for external validation, with newly developed contrast-enhancing lesions at the primary cancer site on the surveillance MRI following definitive treatment of HNSCC between January 2014 and October 2019. Of the 215 and 70 patients, 127 and 34, respectively, had local tumor recurrence. Radiomics models using radiomics scores were created separately for T2-weighted imaging (T2WI), contrast-enhanced T1-weighted imaging (CE-T1WI), and ADC maps using non-zero coefficients from the least absolute shrinkage and selection operator in the training set. Receiver operating characteristic (ROC) analysis was used to evaluate the diagnostic performance of each radiomics score and known clinical parameter (age, sex, and clinical stage) in the internal and external validation sets. Results: Five radiomics features from T2WI, six from CE-T1WI, and nine from ADC maps were selected and used to develop the respective radiomics models. The area under ROC curve (AUROC) of ADC radiomics score was 0.76 (95% confidence interval [CI], 0.62-0.89) and 0.77 (95% CI, 0.65-0.88) in the internal and external validation sets, respectively. These were significantly higher than the AUROC values of T2WI (0.53 [95% CI, 0.40-0.67], p = 0.006), CE-T1WI (0.53 [95% CI, 0.40-0.67], p = 0.012), and clinical parameters (0.53 [95% CI, 0.39-0.67], p = 0.021) in the external validation set. Conclusion: The radiomics model using ADC maps exhibited higher diagnostic performance than those of the radiomics models using T2WI or CE-T1WI and clinical parameters in the diagnosis of local tumor recurrence in HNSCC following definitive treatment.

Scoping Review of Machine Learning and Deep Learning Algorithm Applications in Veterinary Clinics: Situation Analysis and Suggestions for Further Studies

  • Kyung-Duk Min
    • Journal of Veterinary Clinics
    • /
    • v.40 no.4
    • /
    • pp.243-259
    • /
    • 2023
  • Machine learning and deep learning (ML/DL) algorithms have been successfully applied in medical practice. However, their application in veterinary medicine is relatively limited, possibly due to a lack in the quantity and quality of relevant research. Because the potential demands for ML/DL applications in veterinary clinics are significant, it is important to note the current gaps in the literature and explore the possible directions for advancement in this field. Thus, a scoping review was conducted as a situation analysis. We developed a search strategy following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. PubMed and Embase databases were used in the initial search. The identified items were screened based on predefined inclusion and exclusion criteria. Information regarding model development, quality of validation, and model performance was extracted from the included studies. The current review found 55 studies that passed the criteria. In terms of target animals, the number of studies on industrial animals was similar to that on companion animals. Quantitative scarcity of prediction studies (n = 11, including duplications) was revealed in both industrial and non-industrial animal studies compared to diagnostic studies (n = 45, including duplications). Qualitative limitations were also identified, especially regarding validation methodologies. Considering these gaps in the literature, future studies examining the prediction and validation processes, which employ a prospective and multi-center approach, are highly recommended. Veterinary practitioners should acknowledge the current limitations in this field and adopt a receptive and critical attitude towards these new technologies to avoid their abuse.

Chest Radiography of Tuberculosis: Determination of Activity Using Deep Learning Algorithm

  • Ye Ra Choi;Soon Ho Yoon;Jihang Kim;Jin Young Yoo;Hwiyoung Kim;Kwang Nam Jin
    • Tuberculosis and Respiratory Diseases
    • /
    • v.86 no.3
    • /
    • pp.226-233
    • /
    • 2023
  • Background: Inactive or old, healed tuberculosis (TB) on chest radiograph (CR) is often found in high TB incidence countries, and to avoid unnecessary evaluation and medication, differentiation from active TB is important. This study develops a deep learning (DL) model to estimate activity in a single chest radiographic analysis. Methods: A total of 3,824 active TB CRs from 511 individuals and 2,277 inactive TB CRs from 558 individuals were retrospectively collected. A pretrained convolutional neural network was fine-tuned to classify active and inactive TB. The model was pretrained with 8,964 pneumonia and 8,525 normal cases from the National Institute of Health (NIH) dataset. During the pretraining phase, the DL model learns the following tasks: pneumonia vs. normal, pneumonia vs. active TB, and active TB vs. normal. The performance of the DL model was validated using three external datasets. Receiver operating characteristic analyses were performed to evaluate the diagnostic performance to determine active TB by DL model and radiologists. Sensitivities and specificities for determining active TB were evaluated for both the DL model and radiologists. Results: The performance of the DL model showed area under the curve (AUC) values of 0.980 in internal validation, and 0.815 and 0.887 in external validation. The AUC values for the DL model, thoracic radiologist, and general radiologist, evaluated using one of the external validation datasets, were 0.815, 0.871, and 0.811, respectively. Conclusion: This DL-based algorithm showed potential as an effective diagnostic tool to identify TB activity, and could be useful for the follow-up of patients with inactive TB in high TB burden countries.

Identifying Atrial Fibrillation With Sinus Rhythm Electrocardiogram in Embolic Stroke of Undetermined Source: A Validation Study With Insertable Cardiac Monitors

  • Ki-Hyun Jeon;Jong-Hwan Jang;Sora Kang;Hak Seung Lee;Min Sung Lee;Jeong Min Son;Yong-Yeon Jo;Tae Jun Park;Il-Young Oh;Joon-myoung Kwon;Ji Hyun Lee
    • Korean Circulation Journal
    • /
    • v.53 no.11
    • /
    • pp.758-771
    • /
    • 2023
  • Background and Objectives: Paroxysmal atrial fibrillation (AF) is a major potential cause of embolic stroke of undetermined source (ESUS). However, identifying AF remains challenging because it occurs sporadically. Deep learning could be used to identify hidden AF based on the sinus rhythm (SR) electrocardiogram (ECG). We combined known AF risk factors and developed a deep learning algorithm (DLA) for predicting AF to optimize diagnostic performance in ESUS patients. Methods: A DLA was developed to identify AF using SR 12-lead ECG with the database consisting of AF patients and non-AF patients. The accuracy of the DLA was validated in 221 ESUS patients who underwent insertable cardiac monitor (ICM) insertion to identify AF. Results: A total of 44,085 ECGs from 12,666 patient were used for developing the DLA. The internal validation of the DLA revealed 0.862 (95% confidence interval, 0.850-0.873) area under the curve (AUC) in the receiver operating curve analysis. In external validation data from 221 ESUS patients, the diagnostic accuracy of DLA and AUC were 0.811 and 0.827, respectively, and DLA outperformed conventional predictive models, including CHARGE-AF, C2HEST, and HATCH. The combined model, comprising atrial ectopic burden, left atrial diameter and the DLA, showed excellent performance in AF prediction with AUC of 0.906. Conclusions: The DLA accurately identified paroxysmal AF using 12-lead SR ECG in patients with ESUS and outperformed the conventional models. The DLA model along with the traditional AF risk factors could be a useful tool to identify paroxysmal AF in ESUS patients.

Deep-learning-based system-scale diagnosis of a nuclear power plant with multiple infrared cameras

  • Ik Jae Jin;Do Yeong Lim;In Cheol Bang
    • Nuclear Engineering and Technology
    • /
    • v.55 no.2
    • /
    • pp.493-505
    • /
    • 2023
  • Comprehensive condition monitoring of large industry systems such as nuclear power plants (NPPs) is essential for safety and maintenance. In this study, we developed novel system-scale diagnostic technology based on deep-learning and IR thermography that can efficiently and cost-effectively classify system conditions using compact Raspberry Pi and IR sensors. This diagnostic technology can identify the presence of an abnormality or accident in whole system, and when an accident occurs, the type of accident and the location of the abnormality can be identified in real-time. For technology development, the experiment for the thermal image measurement and performance validation of major components at each accident condition of NPPs was conducted using a thermal-hydraulic integral effect test facility with compact infrared sensor modules. These thermal images were used for training of deep-learning model, convolutional neural networks (CNN), which is effective for image processing. As a result, a proposed novel diagnostic was developed that can perform diagnosis of components, whole system and accident classification using thermal images. The optimal model was derived based on the modern CNN model and performed prompt and accurate condition monitoring of component and whole system diagnosis, and accident classification. This diagnostic technology is expected to be applied to comprehensive condition monitoring of nuclear power plants for safety.

Diagnostic methods for assessing maxillary skeletal and dental transverse deficiencies: A systematic review

  • Sawchuk, Dena;Currie, Kris;Vich, Manuel Lagravere;Palomo, Juan Martin;Flores-Mir, Carlos
    • The korean journal of orthodontics
    • /
    • v.46 no.5
    • /
    • pp.331-342
    • /
    • 2016
  • Objective: To evaluate the accuracy and reliability of the diagnostic tools available for assessing maxillary transverse deficiencies. Methods: An electronic search of three databases was performed from their date of establishment to April 2015, with manual searching of reference lists of relevant articles. Articles were considered for inclusion if they reported the accuracy or reliability of a diagnostic method or evaluation technique for maxillary transverse dimensions in mixed or permanent dentitions. Risk of bias was assessed in the included articles, using the Quality Assessment of Diagnostic Accuracy Studies tool-2. Results: Nine articles were selected. The studies were heterogeneous, with moderate to low methodological quality, and all had a high risk of bias. Four suggested that the use of arch width prediction indices with dental cast measurements is unreliable for use in diagnosis. Frontal cephalograms derived from cone-beam computed tomography (CBCT) images were reportedly more reliable for assessing intermaxillary transverse discrepancies than posteroanterior cephalograms. Two studies proposed new three-dimensional transverse analyses with CBCT images that were reportedly reliable, but have not been validated for clinical sensitivity or specificity. No studies reported sensitivity, specificity, positive or negative predictive values or likelihood ratios, or ROC curves of the methods for the diagnosis of transverse deficiencies. Conclusions: Current evidence does not enable solid conclusions to be drawn, owing to a lack of reliable high quality diagnostic studies evaluating maxillary transverse deficiencies. CBCT images are reportedly more reliable for diagnosis, but further validation is required to confirm CBCT's accuracy and diagnostic superiority.

Analysis of Feature Variables for Breast Cancer Diagnosis

  • Jung, Yong Gyu;Kim, Jang Il;Sihn, Sung Chul;Heo, Jun
    • International journal of advanced smart convergence
    • /
    • v.2 no.2
    • /
    • pp.36-39
    • /
    • 2013
  • It is becoming more important as the growing of health information and increasing in cancer patients diagnose over the time gradually. Among the various types of cancer, we focuses on breast cancer diagnosis. The accuracy of breast cancer diagnosis is increasing when the diagnosis is based on evidence and statistics. To do this we use the weka data mining tools and analysis algorithms significantly associated with the decision tree uses rules. In addition, the data pre-processing and cross-validation are used to increase the reliability of the results. The number and cause of the disease becomes important to increase evidence-based medical doctors. As the evidence-based medical, the data obtained from patients in the past through the disease by calculating the probability for future patients to diagnose and predict disease and treatment plan. It can be found by improving the survival rate plays an important role.

The Detection of Esophagitis by Using Back Propagation Network Algorithm

  • Seo, Kwang-Wook;Min, Byeong-Ro;Lee, Dae-Weon
    • Journal of Mechanical Science and Technology
    • /
    • v.20 no.11
    • /
    • pp.1873-1880
    • /
    • 2006
  • The results of this study suggest the use of a Back Propagation Network (BPN) algorithm for the detection of esophageal erosions or abnormalities - which are the important signs of esophagitis - in the analysis of the color and textural aspects of clinical images obtained by endoscopy. The authors have investigated the optimization of the learning condition by the number of neurons in the hidden layer within the structure of the neural network. By optimizing learning parameters, we learned and have validated esophageal erosion images and/or ulcers functioning as the critical diagnostic criteria for esophagitis and associated abnormalities. Validation was established by using twenty clinical images. The success rates for detection of esophagitis during calibration and during validation were 97.91% and 96.83%, respectively.