• 제목/요약/키워드: receiver operating characteristic analysis

Search Result 406, Processing Time 0.024 seconds

Development of an Evaluation Method for a Driver's Cognitive Workload Using ECG Signal (ECG 기반의 운전자별 인지 부하 평가 방법 개발)

  • Hong, Wongi;Lee, Wonsup;Jung, Kihyo;Lee, Baekhee;Park, Jangwoon;Park, Suwan;Park, Yunsuk;Son, Joonwoo;Park, Seikwon;You, Heecheon
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.40 no.3
    • /
    • pp.325-332
    • /
    • 2014
  • High cognitive workload decreases a driver's ability of judgement and response in traffic situation and could result in a traffic accident. Electrocardiography (ECG) has been used for evaluation of drivers' cognitive workload; however, individual differences in ECG response corresponding to cognitive workload have not been fully considered. The present study developed an evaluation method of individual driver's cognitive workload based on ECG data, and evaluated its usefulness through an experiment in a driving simulator. The evaluation method developed by the present study determined the optimal ECG evaluation condition for individual participant by analysis of area under the receiver operating characteristic curve (AUC) for various conditions (total number of conditions = 144) in terms of four aspects (ECG measure, window span, update rate, and workload level). AUC analysis on the various conditions showed that the optimal ECG evaluation condition for each participant was significantly different. In addition, the optimal ECG evaluation condition could accurately detect changes in cognitive workload for 47% of the total participants (n = 15). The evaluation method proposed in the present study can be utilized in the evaluation of individual driver's cognitive workload for an intelligent vehicle.

Seasonal Effects Removal of Unsupervised Change Detection based Multitemporal Imagery (다시기 원격탐사자료 기반 무감독 변화탐지의 계절적 영향 제거)

  • Park, Hong Lyun;Choi, Jae Wan;Oh, Jae Hong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.36 no.2
    • /
    • pp.51-58
    • /
    • 2018
  • Recently, various satellite sensors have been developed and it is becoming more convenient to acquire multitemporal satellite images. Therefore, various researches are being actively carried out in the field of utilizing change detection techniques such as disaster and land monitoring using multitemporal satellite images. In particular, researches related to the development of unsupervised change detection techniques capable of extracting rapidly change regions have been conducted. However, there is a disadvantage that false detection occurs due to a spectral difference such as a seasonal change. In order to overcome the disadvantages, this study aimed to reduce the false alarm detection due to seasonal effects using the direction vector generated by applying the $S^2CVA$ (Sequential Spectral Change Vector Analysis) technique, which is one of the unsupervised change detection methods. $S^2CVA$ technique was applied to RapidEye images of the same and different seasons. We analyzed whether the change direction vector of $S^2CVA$ can remove false positives due to seasonal effects. For the quantitative evaluation, the ROC (Receiver Operating Characteristic) curve and the AUC (Area Under Curve) value were calculated for the change detection results and it was confirmed that the change detection performance was improved compared with the change detection method using only the change magnitude vector.

Deep Learning in Thyroid Ultrasonography to Predict Tumor Recurrence in Thyroid Cancers (인공지능 딥러닝을 이용한 갑상선 초음파에서의 갑상선암의 재발 예측)

  • Jieun Kil;Kwang Gi Kim;Young Jae Kim;Hye Ryoung Koo;Jeong Seon Park
    • Journal of the Korean Society of Radiology
    • /
    • v.81 no.5
    • /
    • pp.1164-1174
    • /
    • 2020
  • Purpose To evaluate a deep learning model to predict recurrence of thyroid tumor using preoperative ultrasonography (US). Materials and Methods We included representative images from 229 US-based patients (male:female = 42:187; mean age, 49.6 years) who had been diagnosed with thyroid cancer on preoperative US and subsequently underwent thyroid surgery. After selecting each representative transverse or longitudinal US image, we created a data set from the resulting database of 898 images after augmentation. The Python 2.7.6 and Keras 2.1.5 framework for neural networks were used for deep learning with a convolutional neural network. We compared the clinical and histological features between patients with and without recurrence. The predictive performance of the deep learning model between groups was evaluated using receiver operating characteristic (ROC) analysis, and the area under the ROC curve served as a summary of the prognostic performance of the deep learning model to predict recurrent thyroid cancer. Results Tumor recurrence was noted in 49 (21.4%) among the 229 patients. Tumor size and multifocality varied significantly between the groups with and without recurrence (p < 0.05). The overall mean area under the curve (AUC) value of the deep learning model for prediction of recurrent thyroid cancer was 0.9 ± 0.06. The mean AUC value was 0.87 ± 0.03 in macrocarcinoma and 0.79 ± 0.16 in microcarcinoma. Conclusion A deep learning model for analysis of US images of thyroid cancer showed the possibility of predicting recurrence of thyroid cancer.

Identifying Personal Values Influencing the Lifestyle of Older Adults: Insights From Relative Importance Analysis Using Machine Learning (중고령 노인의 개인적 가치에 따른 라이프스타일 분류: 머신러닝을 활용한 상대적 중요도 분석 )

  • Lim, Seungju;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.13 no.2
    • /
    • pp.69-84
    • /
    • 2024
  • Objective : This study aimed to categorize the lifestyles of older adults into two types - healthy and unhealthy, and use machine learning to identify the personal values that influence these lifestyles. Methods : This cross-sectional study targeting middle-aged and older adults (55 years and above) living in local communities in South Korea. Data were collected from 300 participants through online surveys. Lifestyle types were dichotomized by the Yonsei Lifestyle Profile (YLP)-Active, Balanced, Connected, and Diverse (ABCD) responses using latent profile analysis. Personal value information was collected using YLP-Values (YLP-V) and analyzed using machine learning to identify the relative importance of personal values on lifestyle types. Results : The lifestyle of older adults was categorized into healthy (48.87%) and unhealthy (51.13%). These two types showed the most significant difference in social relationship characteristics. Among the machine learning models used in this study, the support vector machine showed the highest classification performance, achieving 96% accuracy and 95% area under the receiver operating characteristic (ROC) curve. The model indicated that individuals who prioritized a healthy diet, sought health information, and engaged in hobbies or cultural activities were more likely to have a healthy lifestyle. Conclusion : This study suggests the need to encourage the expansion of social networks among older adults. Furthermore, it highlights the necessity to comprehensively intervene in individuals' perceptions and values that primarily influence lifestyle adherence.

An adaptive method of multi-scale edge detection for underwater image

  • Bo, Liu
    • Ocean Systems Engineering
    • /
    • v.6 no.3
    • /
    • pp.217-231
    • /
    • 2016
  • This paper presents a new approach for underwater image analysis using the bi-dimensional empirical mode decomposition (BEMD) technique and the phase congruency information. The BEMD algorithm, fully unsupervised, it is mainly applied to texture extraction and image filtering, which are widely recognized as a difficult and challenging machine vision problem. The phase information is the very stability feature of image. Recent developments in analysis methods on the phase congruency information have received large attention by the image researchers. In this paper, the proposed method is called the EP model that inherits the advantages of the first two algorithms, so this model is suitable for processing underwater image. Moreover, the receiver operating characteristic (ROC) curve is presented in this paper to solve the problem that the threshold is greatly affected by personal experience when underwater image edge detection is performed using the EP model. The EP images are computed using combinations of the Canny detector parameters, and the binaryzation image results are generated accordingly. The ideal EP edge feature extractive maps are estimated using correspondence threshold which is optimized by ROC analysis. The experimental results show that the proposed algorithm is able to avoid the operation error caused by manual setting of the detection threshold, and to adaptively set the image feature detection threshold. The proposed method has been proved to be accuracy and effectiveness by the underwater image processing examples.

Low Income and Rural County of Residence Increase Mortality from Bone and Joint Sarcomas

  • Cheung, Min Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.14 no.9
    • /
    • pp.5043-5047
    • /
    • 2013
  • Background: This is a part of a larger effort to characterize the effects on socio-economic factors (SEFs) on cancer outcome. Surveillance, Epidemiology and End Result (SEER) bone and joint sarcoma (BJS) data were used to identify potential disparities in cause specific survival (CSS). Materials and Methods: This study analyzed SEFs in conjunction with biologic and treatment factors. Absolute BJS specific risks were calculated and the areas under the receiver operating characteristic (ROC) curve were computed for predictors. Actuarial survival analysis was performed with Kaplan-Meier method. Kolmogorov-Smirnov's 2-sample test was used to for comparing two survival curves. Cox proportional hazard model was used for multivariate analysis. Results: There were 13501 patients diagnosed BJS from 1973 to 2009. The mean follow up time (SD) was 75.6 (90.1) months. Staging was the highest predictive factor of outcome (ROC area of 0.68). SEER stage, histology, primary site and sex were highly significant pre-treatment predictors of CSS. Under multivariate analysis, patients living in low income neighborhoods and rural areas had a 2% and 5% disadvantage in cause specific survival respectively. Conclusions: This study has found 2-5% decrement of CSS of BJS due to SEFs. These data may be used to generate testable hypothesis for future clinical trials to eliminate BJS outcome disparities.

A Moving Window Principal Components Analysis Based Anomaly Detection and Mitigation Approach in SDN Network

  • Wang, Mingxin;Zhou, Huachun;Chen, Jia
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.8
    • /
    • pp.3946-3965
    • /
    • 2018
  • Network anomaly detection in Software Defined Networking, especially the detection of DDoS attack, has been given great attention in recent years. It is convenient to build the Traffic Matrix from a global view in SDN. However, the monitoring and management of high-volume feature-rich traffic in large networks brings significant challenges. In this paper, we propose a moving window Principal Components Analysis based anomaly detection and mitigation approach to map data onto a low-dimensional subspace and keep monitoring the network state in real-time. Once the anomaly is detected, the controller will install the defense flow table rules onto the corresponding data plane switches to mitigate the attack. Furthermore, we evaluate our approach with experiments. The Receiver Operating Characteristic curves show that our approach performs well in both detection probability and false alarm probability compared with the entropy-based approach. In addition, the mitigation effect is impressive that our approach can prevent most of the attacking traffic. At last, we evaluate the overhead of the system, including the detection delay and utilization of CPU, which is not excessive. Our anomaly detection approach is lightweight and effective.

Rapid Screening of Phospholipid Biomarker Candidates from Prostate Cancer Urine Samples by Multiple Reaction Monitoring of UPLC-ESI-MS/MS and Statistical Approaches

  • Lim, Sangsoo;Bang, Dae Young;Rha, Koon Ho;Moon, Myeong Hee
    • Bulletin of the Korean Chemical Society
    • /
    • v.35 no.4
    • /
    • pp.1133-1138
    • /
    • 2014
  • Ultrahigh performance liquid chromatography-electrospray ionization-tandem mass spectrometry (UPLC-ESI- MS/MS) provides a high-speed method to screen a large number of samples for small molecules with specific properties. In this study, UPLC-ESI-MS/MS with multiple reaction monitoring (MRM) was employed to screen urinary phospholipid (PL) content for biomarkers of prostate cancer. From lists of urinary PLs structurally identified using nanoflow LC-ESI-MS/MS, 52 PL species were selected for quantitative analysis in urine samples between 22 cancer-free urologic patients as controls and 45 prostate cancer patients. Statistical treatment of data by receiver operating characteristic (ROC) analysis yielded 14 PL species that differed significantly in relative concentrations (area under curve (AUC) > 0.8) between the two groups. Among PLs present at higher levels in prostate cancer urine, phosphatidylcholines (PCs) and phosphatidylinositols (PIs) constituted the major head group PLs (3 PCs and 7 PIs). For technical reasons, PL species of low abundance may be underrepresented in data from UPLC-ESI-MS/MS performed in MRM mode. However, the proposed method enables the rapid screening of large numbers of plasma or urine samples in the search for biomarkers of human disease.

Sentiment Analysis From Images - Comparative Study of SAI-G and SAI-C Models' Performances Using AutoML Vision Service from Google Cloud and Clarifai Platform

  • Marcu, Daniela;Danubianu, Mirela
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.9
    • /
    • pp.179-184
    • /
    • 2021
  • In our study we performed a sentiments analysis from the images. For this purpose, we used 153 images that contain: people, animals, buildings, landscapes, cakes and objects that we divided into two categories: images that suggesting a positive or a negative emotion. In order to classify the images using the two categories, we created two models. The SAI-G model was created with Google's AutoML Vision service. The SAI-C model was created on the Clarifai platform. The data were labeled in a preprocessing stage, and for the SAI-C model we created the concepts POSITIVE (POZITIV) AND NEGATIVE (NEGATIV). In order to evaluate the performances of the two models, we used a series of evaluation metrics such as: Precision, Recall, ROC (Receiver Operating Characteristic) curve, Precision-Recall curve, Confusion Matrix, Accuracy Score and Average precision. Precision and Recall for the SAI-G model is 0.875, at a confidence threshold of 0.5, while for the SAI-C model we obtained much lower scores, respectively Precision = 0.727 and Recall = 0.571 for the same confidence threshold. The results indicate a lower classification performance of the SAI-C model compared to the SAI-G model. The exception is the value of Precision for the POSITIVE concept, which is 1,000.

Meta-analysis of the Diagnostic Test Accuracy of Pediatric Inpatient Fall Risk Assessment Scales

  • Kim, Eun Joo;Lim, Ji Young;Kim, Geun Myun;Lee, Mi Kyung
    • Child Health Nursing Research
    • /
    • v.25 no.1
    • /
    • pp.56-64
    • /
    • 2019
  • Purpose: This study was conducted to obtain data for the development of an effective fall risk assessment tool for pediatric inpatients through a systematic review and meta-analysis of the diagnostic test accuracy of existing scales. Methods: A literature search using Medline, Science Direct, CINAHL, EMBASE, and the Cochrane Library was performed between March 1 and 31, 2018. Of 890 identified papers, 10 were selected for review. Nine were used in the meta-analysis. Stata version 14.0 was used to create forest plots of sensitivity and specificity. A summary receiver operating characteristic curve was used to compare all diagnostic test accuracies. Results: Four studies used the Humpty Dumpty Falls Scale. The most common items included the patient's diagnoses, use of sedative medications, and mobility. The pooled sensitivity and specificity of the nine studies were .79 and .36, respectively. Conclusion: Considering the low specificity of the pediatric fall risk assessment scales currently available, there is a need to subdivide scoring categories and to minimize items that are evaluated using nurses' subjective judgment alone. Fall risk assessment scales should be incorporated into the electronic medical record system and an automated scoring system should be developed.