• Journal of Preventive Medicine and Public Health
• /
• v.32 no.3
• /
• pp.361-373
• /
• 1999

Objectives: Receive Operating Characteristic(ROC) curve with the area under the ROC curve(AUC) is one of the most popular indicator to evaluate the criterion validity of the measurement tool. This study was conducted to develop a standardized questionnaire to discriminate workers at high-risk of work-related musculoskeletal disorders using ROC analysis. Methods: The diagnostic results determined by rehabilitation medicine specialists in 370 persons(89 shipyard CAD workers, 113 telephone directory assistant operators, 79 women with occupation, and 89 housewives) were compared with participant's own replies to 'the questionnair on the worker's subjective physical symptoms'(Kwon, 1996). The AUC's from four models with different methods in item selection and weighting were compared with each other. These 4 models were applied to 225 persons, working in an assembly line of motor vehicle, for the purpose of AUC reliability test. Results: In a weighted model with 11 items, the AUC was 0.8155 in the primary study population, and 0.8026 in the secondary study population(p=0.3780). It was superior in the aspects of discriminability, reliability and convenience. A new questionnaire of musculoskeletal disorder could be constructed by this model. Conclusion: A more valid questionnaire with a small number of items and the quantitative weight scores useful for the relative comparisons are the main results of this study. While the absolute reference value applicable to the wide range of populations was not estimated, the basic intent of this study, developing a surveillance fool through quantitative validation of the measures, would serve for the systematic disease prevention activities.

• International Journal of Highway Engineering
• /
• v.20 no.2
• /
• pp.35-44
• /
• 2018

PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

• The korean journal of orthodontics
• /
• v.25 no.2 s.49
• /
• pp.153-163
• /
• 1995

In this study, Receiver Operating Characteristic(ROC) analysis was used to evaluate the ability of cephalometric measurements to identify patients with Class III malocclusions. ROC analysis is the method for determining the validity of a diagnostic measure and for evaluating the relative value of diagnostic tests. The sample consisted of 496 patients with malocclusion. Class III malocclusion is defined as the dental relationship for which The mesiobuccal groove of the lower first molar is deviated mesially from the mesiobuccal cusp of the upper first molar. Of the total sample of 496 patients, 245 had Class III malocclusions. 16 cephalometric measurements were selected, each of which was treated as a diagnostic test. The ROC curves were generated for each cephalometric measurement with intervals of $1.0^{\circ}$ for angular measurements, 1.0mm for linear measurements. The area under the ROC curves was measured for direct comparison among different diagnostic tests. The results were as follows; 1. The 'Wits' appraisal was found to be a better diagnostic criterion for the presence of Class III malocclusion than any other commonly'used cephalometric measurement. 2. AB plane angle, ANB angle, App-Bpp distance, AF-BF distance, APDI, Distance of point A and Pog to N perpendicular, maxillomandibular differential had high diagnostic value. 3. Cephalometric measurements which evaluate the position of the mandible had moderate diagnostic value. 4. Cephalometric measurements related to the maxilla discriminated least between patients with and without Class III malocclusion.

• The Journal of the Convergence on Culture Technology
• /
• v.6 no.3
• /
• pp.457-462
• /
• 2020

Osteoporosis is a disease that occurs mainly in the elderly and increases the risk of fractures due to structural deterioration of bone mass and tissues. The purpose of this study are to assess the relationship between nutritional components and osteoporosis and to evaluate models for predicting osteoporosis based on nutrient components. In experimental method, association was performed using binary logistic regression, and predictive models were generated using the naive Bayes algorithm and variable subset selection methods. The analysis results for single variables indicated that food intake and vitamin B2 showed the highest value of the area under the receiver operating characteristic curve (AUC) for predicting osteoporosis in men. In women, monounsaturated fatty acids showed the highest AUC value. In prediction model of female osteoporosis, the models generated by the correlation based feature subset and wrapper based variable subset methods showed an AUC value of 0.662. In men, the model by the full variable obtained an AUC of 0.626, and in other male models, the predictive performance was very low in sensitivity and 1-specificity. The results of these studies are expected to be used as the basic information for the treatment and prevention of osteoporosis.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.8
• /
• pp.67-73
• /
• 2015

In a distribution of digital image, there is a serious problem that is the image alteration by a forger. For the problem solution, this paper proposes the forensic decision algorithm of a median filtering (MF) image using the feature vector based on a coefficient of variation (c.v.) of Fourier transform. In the proposed algorithm, we compute Fourier transform (FT) coefficients of row and column line respectively of an image first, then c.v. between neighboring lines is computed. Subsquently, 10 Dim. feature vector is defined for the MF detection. On the experiment of MF detection, the proposed scheme is compared to MFR (Median Filter Residual) and Rhee's MF detection schemes that have the same 10 Dim. feature vector both. As a result, the performance is excellent at Unaltered, JPEG (QF=90), Down scaling (0.9) and Up scaling (1.1) images, and it showed good performance at Gaussian filtering ($3{\times}3$) image. However, in the performance evaluation of all measured items of the proposed scheme, AUC (Area Under ROC (Receiver Operating Characteristic) Curve) by the sensitivity and 1-specificity approached to 1 thus, it is confirmed that the grade of the performance evaluation is rated as 'Excellent (A)'.

• Journal of Korean Institute of Industrial Engineers
• /
• v.40 no.3
• /
• pp.325-332
• /
• 2014

High cognitive workload decreases a driver's ability of judgement and response in traffic situation and could result in a traffic accident. Electrocardiography (ECG) has been used for evaluation of drivers' cognitive workload; however, individual differences in ECG response corresponding to cognitive workload have not been fully considered. The present study developed an evaluation method of individual driver's cognitive workload based on ECG data, and evaluated its usefulness through an experiment in a driving simulator. The evaluation method developed by the present study determined the optimal ECG evaluation condition for individual participant by analysis of area under the receiver operating characteristic curve (AUC) for various conditions (total number of conditions = 144) in terms of four aspects (ECG measure, window span, update rate, and workload level). AUC analysis on the various conditions showed that the optimal ECG evaluation condition for each participant was significantly different. In addition, the optimal ECG evaluation condition could accurately detect changes in cognitive workload for 47% of the total participants (n = 15). The evaluation method proposed in the present study can be utilized in the evaluation of individual driver's cognitive workload for an intelligent vehicle.

• Journal of the Korean Society of Radiology
• /
• v.11 no.3
• /
• pp.131-137
• /
• 2017

This study investigated the risk factor of Gallbladder stone in Busan and Kyungnam area. The subjects of the experiment was performed with patients by abdominal ultrasonography among the patients who came to the P hospital from June 2016 to December 2016. Among them, risk factors were analyzed on 353 people at the same time when abdominal ultrasonography and hematological test. The statistical analysis of risk factors related to the Gallbladder stone was performed by independent t-test and chi-square test. In consider of difference verification result for calculations odds ratio about independent variables, multiple logistic regression analysis to conduct verify adequacy by calculating forecasting model from variable. As a result, Gallbladder stone risk factors have relevance to age ${\gamma}GTP$ with probability model and values to calculated. Age was showed sensitivity 49.7%, specificity 82.2%, receiver operating characteristic area under curve 0.724. Forecasting probability sensitivity 69.3%, specificity 62.4%, receiver operating characteristic area under curve 0.699 showed, ${\gamma}GTP$ confirmed validity of forecasting model.

• Journal of the korean academy of Pediatric Dentistry
• /
• v.45 no.1
• /
• pp.57-64
• /
• 2018

Pre-eruptive intracoronal resorption (PEIR) is a developmental defect in the crown of a pre-eruptive tooth. The purpose of this study was to investigate the relationship between the size of the pre-eruptive buccal pit radiolucency, which is suspected as PEIR on a panoramic radiography, and the need for restoration after the eruption of a mandibular first molar. The experimental group included 35 mandibular first molars, in which lesions requiring definite restoration were observed during eruption. The control group consisted of 64 sound mandibular first molars after eruption. The sex, age, tooth position, tooth formation stage, size of the pre-eruptive buccal pit radiolucency, and restoration methods in the experimental group and control group were examined. Compared with the control group, the experimental group showed a statistically significant difference in the size of the buccal pit before eruption. The buccal pit size for predicting the need for restoration was further examined by receiver operating characteristic curve analyses, and the area under the curve was $0.813{\pm}0.047$. If radiolucency is observed at the buccal pit of the mandibular first molar before eruption, periodic observations and post-eruption examinations are required.

• Journal of Trauma and Injury
• /
• v.34 no.1
• /
• pp.3-12
• /
• 2021

Purpose: To evaluate the severity of trauma, many scoring systems and predictive models have been presented. The quick Sequential Organ Failure Assessment (qSOFA) is a simple scoring system based on vital signs, and we expect it to be easier to apply to trauma patients than other trauma assessment tools. Methods: This study was a cross-sectional study of trauma patients who visited the emergency department of Jeju National University Hospital. We excluded patients under the age of 18 years and unknown outcomes. We calculated the qSOFA, the Modified Early Warning Score (mEWS), Revised Trauma Score (RTS), and Injury Severity Score (ISS) based on patients' initial vital signs and assessments performed in the emergency department (ED). The primary outcome was mortality within 14 days of trauma. We analyzed qSOFA scores using multivariate logistic regression analysis and compared the predictive accuracy of these scoring systems using the area under the receiver operating characteristic curve (AUROC). Results: In total, 27,764 patients were analyzed. In the multivariate logistic regression analysis of the qSOFA, the adjusted odds ratios with 95% confidence interval (CI) for mortality relative to a qSOFA score of 0 were 27.82 (13.63-56.79) for a qSOFA score of 1, 373.31 (183.47-759.57) for a qSOFA score of 2, and 494.07 (143.75-1698.15) for a qSOFA score of 3. In the receiver operating characteristic (ROC) curve analysis for the qSOFA, mEWS, ISS, and RTS in predicting the outcomes, for mortality, the AUROC for the qSOFA (AUROC [95% CI]; 0.912 [0.871-0.952]) was significantly greater than those for the ISS (0.700 [0.608-0.793]) and RTS (0.160 [0.108-0.211]). Conclusions: The qSOFA was useful for predicting the prognosis of trauma patients evaluated in the ED.

• Journal of the Korean Society of Radiology
• /
• v.83 no.6
• /
• pp.1298-1311
• /
• 2022

Purpose To develop and validate a deep learning-based screening tool for the early diagnosis of scoliosis using chest radiographs with a semi-supervised generative adversarial network (GAN). Materials and Methods Using a semi-supervised learning framework with a GAN, a screening tool for diagnosing scoliosis was developed and validated through the chest PA radiographs of patients at two different tertiary hospitals. Our proposed method used training GAN with mild to severe scoliosis only in a semi-supervised manner, as an upstream task to learn scoliosis representations and a downstream task to perform simple classification for differentiating between normal and scoliosis states sensitively. Results The area under the receiver operating characteristic curve, negative predictive value (NPV), positive predictive value, sensitivity, and specificity were 0.856, 0.950, 0.579, 0.985, and 0.285, respectively. Conclusion Our deep learning-based artificial intelligence software in a semi-supervised manner achieved excellent performance in diagnosing scoliosis using the chest PA radiographs of young individuals; thus, it could be used as a screening tool with high NPV and sensitivity and reduce the burden on radiologists for diagnosing scoliosis through health screening chest radiographs.