• Title/Summary/Keyword: receiver operating characteristic analysis

Search Result 401, Processing Time 0.034 seconds

Interpretation of Receiver Operating Characteristics (ROC) (ROC(receiver operating characteristics) 해석)

  • Kim Jae-Duk
    • Imaging Science in Dentistry
    • /
    • v.30 no.3
    • /
    • pp.155-158
    • /
    • 2000
  • The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

  • PDF

Evaluation of Waist Circumference Cut-off Values as a Marker for Fatty Liver among Japanese Workers

  • Abe, Naomi;Honda, Sumihisa;Jahng, Doosub
    • Safety and Health at Work
    • /
    • v.3 no.4
    • /
    • pp.287-293
    • /
    • 2012
  • Objectives: Metabolic syndrome has received attention as a risk factor for cardiovascular disease, with particular importance attached to visceral fat accumulation, which is associated with lifestyle-related diseases and is strongly correlated with waist circumference. In this study, our aim is to propose waist circumference cut-off values that can be used as a marker for fatty liver based on a sample of workers receiving health checkups in Japan. Methods: This study was conducted in a total of 21,866 workers who underwent periodic health checkups between January 2007 and December 2007. The mean age of the subjects was 47.4 years for men (standard deviation [SD]: 8.0) and 44.7 years for women (SD: 6.9). Evaluation included abdominal ultrasound and measurement of waist circumference, body mass index, fasting blood glucose, triglycerides, high-density lipoprotein cholesterol, and blood pressure. Results: Based on receiver operating characteristic curve analysis, the optimal waist circumference cut-off values were shown as 85.0 cm (sensitivity 0.72, specificity 0.69) for men and 80.0 cm (sensitivity 0.75, specificity 0.78) for women. Conclusion: Abdominal ultrasound is the most efficient means of diagnosing fatty liver, but this examination seldom occurs because the test is not routinely performed at workers' health checkups. In people found to have a high risk of fatty liver, recommendations can be made for abdominal ultrasound based on the waist circumference cut-off values obtained in this study. That is, waist circumference can be used in high risk individuals as an effective marker for early detection of fatty liver.

Exploring the Predictive Factors of Passing the Korean Physical Therapist Licensing Examination (한국 물리치료사 국가 면허시험 합격 여부의 예측요인 탐색)

  • Kim, So-Hyun;Cho, Sung-Hyoun
    • Journal of The Korean Society of Integrative Medicine
    • /
    • v.10 no.3
    • /
    • pp.107-117
    • /
    • 2022
  • Purpose : The purpose of this study was to establish a model of the predictive factors for success or failure of examinees undertaking the Korean physical therapist licensing examination (KPTLE). Additionally, we assessed the pass/fail cut-off point. Methods : We analyzed the results of 10,881 examinees who undertook the KPTLE, using data provided by the Korea Health Personnel Licensing Examination Institute. The target variable was the test result (pass or fail), and the input variables were: sex, age, test subject, and total score. Frequency analysis, chi-square test, descriptive statistics, independent t-test, correlation analysis, binary logistic regression, and receiver operating characteristic (ROC) curve analyses were performed on the data. Results : Sex and age were not significant predictors of attaining a pass (p>.05). The test subjects with the highest probability of passing were, in order, medical regulation (MR) (Odds ratio (OR)=2.91, p<.001), foundations of physical therapy (FPT) (OR=2.86, p<.001), diagnosis and evaluation for physical therapy (DEPT) (OR=2.74, p<.001), physical therapy intervention (PTI) (OR=2.66, p<.001), and practical examination (PE) (OR=1.24, p<.001). The cut-off points for each subject were: FPT, 32.50; DEPT, 29.50; PTI, 44.50; MR, 14.50; and PE, 50.50. The total score (TS) was 164.50. The sensitivity, specificity, and the classification accuracy of the prediction model was 99 %, 98 %, and 99 %, respectively, indicating high accuracy. Area under the curve (AUC) values for each subject were: FPT, .958; DEPT, .968; PTI, .984; MR, .885; PE, .962; and TS, .998, indicating a high degree of fit. Conclusion : In our study, the predictive factors for passing KPTLE were identified, and the optimal cut-off point was calculated for each subject. Logistic regression was adequate to explain the predictive model. These results will provide universities and examinees with useful information for predicting their success or failure in the KPTLE.

Comparison of the Pediatric Balance Scale and Fullerton Advanced Balance Scale for Predicting Falls in Children With Cerebral Palsy

  • Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.23 no.4
    • /
    • pp.63-70
    • /
    • 2016
  • Background: The Pediatric Balance Scale (PBS) and the Fullerton Advanced Balance (FAB) scale were used to assess balance function in patients with balance problem. These multidimensional clinical balance scales provide information about potential risk factors for falls. Objects: The purpose of this study was to investigate and compare the predictive properties of the PBS and FAB scales relative to fall risk in children with cerebral palsy (CP) using a receiver operating characteristic analysis. Methods: In total, 49 children with CP (boy=21, girl=28) who were diagnosed with level 1 or 2 according to the Gross Motor Function Classification System participated in this study. The PBS and FAB were performed, and verified cut-off score, sensitivity, specificity, and the area of under the curve (AUC). Results: In this study, the PBS scale was as a predictive measure of fall risk, but the FAB was not significant in children with CP. A cut-off score of 45.5 points provided optimal sensitivity of .90 and specificity of .69 on the PBS, and a cut-off score of 21.5 points provided optimal sensitivity of .90 and specificity of .62 on the FAB. Both scales showed moderately accurate of AUC with .79 and .76, respectively. Conclusion: The PBS is a useful screening tool for predicting fall risk in children with cerebral palsy, and those who score 45.5 or lower indicate a high risk for falls and are in need of balance intervention.

Poor Treatment Outcome of Neuroblastoma and Other Peripheral Nerve Cell Tumors May be Related to Under Usage of Radiotherapy and Socio-Economic Disparity: A US SEER Data Analysis

  • Cheung, Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.13 no.9
    • /
    • pp.4587-4592
    • /
    • 2012
  • Purpose: This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) neuroblastoma (NB) and other peripheral nerve cell tumors (PNCT) outcome data. This study found under usage of radiotherapy in these patients. Materials and methods: This study analyzed socio-economic, staging and treatment factors available in the SEER database for NB and other PNCT. For the risk modeling, each factor was fitted by a generalized linear model to predict the outcome (soft tissue specific death, yes/no). The area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. A random sampling algorithm was used to estimate the modeling errors. Risk of neuroendocrine (other endocrine including thymus as coded in SEER) death was computed for the predictors. Results: There were 5261 patients diagnosed from 1973 to 2009 were included in this study. The mean follow up time (S.D.) was 83.8 (97.6) months. The mean (SD) age was 18 (25) years. About 30.45% of patients were un-staged. The SEER staging has high ROC (SD) area of 0.58 (0.01) among the factors tested. We simplified the 4-layered risk levels (local, regional, distant, un-staged/others) to a simpler 3-tiered model with comparable ROC area of 0.59 (0.01). Less than 50% of PNCT patients received radiotherapy (RT) including the ones with localized disease. This avoidance of RT use occurred in adults and children. Conclusion: The high under-staging rate may have precented patients from selecting definitive radiotherapy (RT) after surgery. Using RT for, especially, adult PNCT patients is a potential way to improve outcome.

Serum Levels of Interleukin-8 and Tumor Necrosis Factor-alpha in Coal Workers' Pneumoconiosis: One-year Follow-up Study

  • Lee, Jong-Seong;Shin, Jae-Hoon;Lee, Joung-Oh;Lee, Kyung-Myung;Kim, Ji-Hong;Choi, Byung-Soon
    • Safety and Health at Work
    • /
    • v.1 no.1
    • /
    • pp.69-79
    • /
    • 2010
  • Objectives: Various cytokines induced by inhalation of coal dust may mediate inflammation and lead to tissue damage or fibrosis, such as coal workers' pneumoconiosis (CWP). Methods: To investigate the relevance of serum cytokines in CWP, the levels of serum interleukin-8 (IL-8) and tumor necrosis factor-alpha (TNF-${\alpha}$) as CWP biomarkers in 110 retired coal miners (22 controls and 88 CWP subjects) were related to cross sectional findings and 1-year progressive changes of the pneumoconiosis. Progressive changes of CWP were evaluated by paired comparison of chest radiographs. Analysis by a receiver operating characteristic curve assessed the biomarker potential of each cytokine. Results: The mean serum IL-8 level was significantly higher in CWP compared to controls and IL-8 levels correlated with the degree of CWP. The median serum TNF-${\alpha}$ level was significantly higher in subjects with progressive CWP compared to subjects without CWP progression. The area under the ROC curve for IL-8 (0.70) and TNF-${\alpha}$ (0.72) for CWP identification and progression, respectively, indicated the biomarker potential of the two cytokines. Serum cutoff values of IL-8 and TNF-${\alpha}$ were 11.63 pg/mL(sensitivity, 69%; specificity, 64%) and 4.52 pg/mL (sensitivity, 67%; specificity, 79%), respectively. Conclusion: The results suggest that high levels of serum IL-8 are associated with the presence of CWP and those of serum TNF-${\alpha}$ are associated with the progression of CWP.

Evaluation of Clinical Usefulness of Gamma Glutamyl Transferase as a Surrogate Marker for Metabolic Syndrome in Non Obese Adult Men (비만하지 않은 성인 남성에서 대사증후군의 대리 표지자로서 감마 글루타밀 전이효소의 임상적 유용성 평가)

  • Shin, Kyung-A;Kim, Eun Jae
    • Journal of Convergence for Information Technology
    • /
    • v.10 no.12
    • /
    • pp.146-155
    • /
    • 2020
  • This study was to evaluate the usefulness of gamma glutamyl transferase (GGT) as a surrogate marker predicting metabolic syndrome. 7,155 non obese men over the age of 20 were studied as subjects. The criteria for diagnosing MetS were the National Cholesterol Education Program - Third Adult Treatment Panel (NCEP-ATP III). The risk of developing MetS according to GGT was conducted logistic regression analysis, and the ROC (receiver operating characteristic) curve was obtained to confirm GGT ability to predict the risk of MetS. Regardless of age and body mass index, MetS had a 7.09 times higher risk of onset in the fourth quartile than in the first quartile of GGT (p<0.001). The AUC (area under the curve) of GGT for the diagnosis of MetS was 0.715, and the cutoff value of GGT was 40.0 U/L, the sensitivity was 65.0%, and the specificity was 70.2%. Therefore, GGT is considered to be a useful diagnostic index for diagnosing MetS.

Hydrocephalus: Ventricular Volume Quantification Using Three-Dimensional Brain CT Data and Semiautomatic Three-Dimensional Threshold-Based Segmentation Approach

  • Hyun Woo Goo
    • Korean Journal of Radiology
    • /
    • v.22 no.3
    • /
    • pp.435-441
    • /
    • 2021
  • Objective: To evaluate the usefulness of the ventricular volume percentage quantified using three-dimensional (3D) brain computed tomography (CT) data for interpreting serial changes in hydrocephalus. Materials and Methods: Intracranial and ventricular volumes were quantified using the semiautomatic 3D threshold-based segmentation approach for 113 brain CT examinations (age at brain CT examination ≤ 18 years) in 38 patients with hydrocephalus. Changes in ventricular volume percentage were calculated using 75 serial brain CT pairs (time interval 173.6 ± 234.9 days) and compared with the conventional assessment of changes in hydrocephalus (increased, unchanged, or decreased). A cut-off value for the diagnosis of no change in hydrocephalus was calculated using receiver operating characteristic curve analysis. The reproducibility of the volumetric measurements was assessed using the intraclass correlation coefficient on a subset of 20 brain CT examinations. Results: Mean intracranial volume, ventricular volume, and ventricular volume percentage were 1284.6 ± 297.1 cm3, 249.0 ± 150.8 cm3, and 19.9 ± 12.8%, respectively. The volumetric measurements were highly reproducible (intraclass correlation coefficient = 1.0). Serial changes (0.8 ± 0.6%) in ventricular volume percentage in the unchanged group (n = 28) were significantly smaller than those in the increased and decreased groups (6.8 ± 4.3% and 5.6 ± 4.2%, respectively; p = 0.001 and p < 0.001, respectively; n = 11 and n = 36, respectively). The ventricular volume percentage was an excellent parameter for evaluating the degree of hydrocephalus (area under the receiver operating characteristic curve = 0.975; 95% confidence interval, 0.948-1.000; p < 0.001). With a cut-off value of 2.4%, the diagnosis of unchanged hydrocephalus could be made with 83.0% sensitivity and 100.0% specificity. Conclusion: The ventricular volume percentage quantified using 3D brain CT data is useful for interpreting serial changes in hydrocephalus.