• 응용통계연구
• /
• 제22권5호
• /
• pp.911-921
• /
• 2009

신용평가 연구에서 부도와 정상차주에 대한 판별력을 평가하는 방법으로 Receiver Operating Characteristic(ROC)와 Cumulative Accuracy Profile(CAP) 곡선을 사용한다. ROC 곡선에서 최적의 분류정확도를 갖는 분류점과 CAP 곡선에서 최대의 이익을 나타내는 분류점은 일반적인 정확도의 개념으로 정의된 동일한 성과를 가진 접선을 사용하여 구한다. 본 연구에서는 정확도의 대안적인 측도로 진실율을 제안하고, 이 진실율을 이용하여 ROC와 CAP 곡선에서 대안적인 최적의 분류점을 구한다. 대부분 실제 차주의 모집단에서 부도차주는 정상차주보다 훨씬 수가 적다. 이러한 경우에 진실율은 정확도보다 비용함수의 측면에서 더욱 효율적일 수 있다. 진실율을 이용하여 최적의 분류정확도를 나타내는 분류점과 최대의 이익을 의미하는 분류점에 대응하는 스코어는 동일하다는 것을 보였으며, 이 스코어는 부도와 정상 차주의 분포함수의 동일성을 검정하는 Kolmogorov-Smirnov 통계량에 대응하는 스코어와도 일치하는 것을 발견하였다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제4권5호
• /
• pp.910-924
• /
• 2010

As Internet usage has increased, the risk of adolescents being exposed to adult content and harmful information on the Internet has also risen. To help prevent adolescents accessing this content, a novel detection method for adult images is proposed. The proposed method involves three steps. First, the Image Of Interest (IOI) is extracted from the image background. Second, the IOI is distinguished from the segmented image using a novel weighting mask, and it is determined to be acceptable or unacceptable. Finally, the features (color and texture) of the IOI or original image are compared to a critical value; if they exceed that value then the image is deemed to be an adult image. A Receiver Operating Characteristic (ROC) curve analysis was performed to define this optimal critical value. And, the textural features are identified using a gray level co-occurrence matrix. The proposed method increased the precision level of detection by applying a novel weighting mask and a receiver operating characteristic curve. To demonstrate the effectiveness of the proposed method, 2850 adult and non-adult images were used for experimentation.

• 수면정신생리
• /
• 제6권1호
• /
• pp.26-31
• /
• 1999

"Attention" is not defined sufficiently. This term incorporates several dimensions or complex information processes such as alertness, spatial distribution, focused attention, sustained attention, divided attention and supervisory attentional control. In practice, however, various aspects of attention cannot be assessed separately with a single test. Moreover, a particular test is never assessing attention only, because the several intervening variables may influence the attentional component. Therefore, one can only assess a certain aspect of human behavior with special interest for its attentional component. This paper attempted to clarify various concepts of attention, reviewed signal detection theories with receiver operating characteristic(ROC) curves, and listed practical methods for assessment of attention.

• Journal of Information Processing Systems
• /
• 제12권1호
• /
• pp.109-128
• /
• 2016

This paper presents a new combined forecasting method that is guided by the soft set theory (CFBSS) to predict business failures with different sample sizes. The proposed method combines both qualitative analysis and quantitative analysis to improve forecasting performance. We considered an expert system (ES), logistic regression (LR), and support vector machine (SVM) as forecasting components whose weights are determined by the receiver operating characteristic (ROC) curve. The proposed procedure was applied to real data sets from Chinese listed firms. For performance comparison, single ES, LR, and SVM methods, the combined forecasting method based on equal weights (CFBEWs), the combined forecasting method based on neural networks (CFBNNs), and the combined forecasting method based on rough sets and the D-S theory (CFBRSDS) were also included in the empirical experiment. CFBSS obtains the highest forecasting accuracy and the second-best forecasting stability. The empirical results demonstrate the superior forecasting performance of our method in terms of accuracy and stability.

• Communications for Statistical Applications and Methods
• /
• 제14권1호
• /
• pp.169-182
• /
• 2007

Receive operating characteristic (ROC) approach can be employed to rank candidate genes from a microarray experiment, in particular, for the biomarker development with the purpose of population screening of a cancer. In the cancer microarray experiment based on n patients the researcher often wants to compare the tumor tissue with the normal tissue within the same individual using a common reference RNA. Ideally, this experiment produces n pairs of microarray data. However, it is often the case that there are missing values either in the normal or tumor tissue data. Practically, we have $n_1$ pairs of complete observations, $n_2$ "normal only" and $n_3$ "tumor only" data for the microarray. We refer to this data set as a mixed data set. We develop a ROC approach on the mixed data set to rank candidate genes for the biomarker development for the colorectal cancer screening. It turns out that the correlation between two ranks in terms of ROC and t statistics based on the top 50 genes of ROC rank is less than 0.6. This result indicates that employing a right approach of ranking candidate genes for the biomarker development is important for the allocation of resources.

• Asian Pacific Journal of Cancer Prevention
• /
• 제15권2호
• /
• pp.867-870
• /
• 2014

Purpose: This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) ependymoma data to identify predictive models and potential disparity in outcome. Materials and Methods: This study analyzed socio-economic, staging and treatment factors available in the SEER database for ependymoma. For the risk modeling, each factor was fitted by a Generalized Linear Model to predict the outcome ('brain and other nervous systems' specific death in yes/no). The area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. A random sampling algorithm was used to estimate the modeling errors. Risk of ependymoma death was computed for the predictors for comparison. Results: A total of 3,500 patients diagnosed from 1973 to 2009 were included in this study. The mean follow up time (S.D.) was 79.8 (82.3) months. Some 46% of the patients were female. The mean (S.D.) age was 34.4 (22.8) years. Age was the most predictive factor of outcome. Unknown grade demonstrated a 15% risk of cause specific death compared to 9% for grades I and II, and 36% for grades III and IV. A 5-tiered grade model (with a ROC area 0.48) was optimized to a 3-tiered model (with ROC area of 0.53). This ROC area tied for the second with that for surgery. African-American patients had 21.5% risk of death compared with 16.6% for the others. Some 72.7% of patient who did not get RT had cerebellar or spinal ependymoma. Patients undergoing surgery had 16.3% risk of death, as compared to 23.7% among those who did not have surgery. Conclusion: Grading ependymoma may dramatically improve modeling of data. RT is under used for cerebellum and spinal cord ependymoma and it may be a potential way to improve outcome.

• 대한방사선기술학회지:방사선기술과학
• /
• 제32권2호
• /
• pp.147-151
• /
• 2009

ROC에 의한 의료영상을 평가하는 방법으로 지금까지는 5단계로 평가하는 평정확신도법이 일반적으로 사용되었다. 이 평정확신도법에서는 TPF나 FPF의 산출을 쉽게 구하는 것이 가능하나, 실험에 있어서 부드럽게 ROC곡선의 추정을 하기 위해서 관찰자에 대해 적당한 카테고리 배분이 요구되거나 또 짜여진 카테고리 배분을 위해 그 데이터가 무효해지는 경우가 많다. 이러한 문제를 해결하기 위해 또는 관찰실험 이외의 데이터에도 ROC해석의 응용이 가능해지도록 카테고리 분류가 되어 있지 않은 연속적으로 분포된 실험결과를 이용 ROC 해석을 행하는 방법인 연속확신도법이 보고 되었다. 하지만 국내에서는 의료영상의 평가에 연속확신도법을 적용한 예가 거의 없어서 흉부 디지털영상의 평가에 적용해 보았다. 그 결과 상용화된 프로그램에 의하여 부드러운 ROC곡선을 그릴 수 있었으며, 특성값을 쉽게 측정할 수 있어 디지털 의료영상의 평가에 적절히 사용될 수 있으리라 사료된다.

• Communications for Statistical Applications and Methods
• /
• 제17권2호
• /
• pp.275-292
• /
• 2010

동일 환자에게 적용된 2가지 진단검사의 정확성을 비교하기 위한 방법들 중에서 두개의 ROC곡선 아래 면적(AUC; Area Under Curve)의 차이는 주요한 잣대 중 하나이다. 본 연구에서는 AUC의 차이를 추정하는 방법으로 비모수적방법, 최대가능도법, 일반화추축량에 의한 방법, 붓스트랩방법의 4가지를 포함확률(coverage probability), 기대길이 (expected length) 측면에서 모의실험을 통하여 비교하였다.

• 대한치과교정학회지
• /
• 제25권2호
• /
• pp.153-163
• /
• 1995

본 연구는 III급 부정 교합을 판별하는데 있어, 수평 부조화의 진단에 이용되는 여러 진단 항목들의 진단학적 효율과 타당성을 ROC analysis로 비교하는데 그 목적이 있다. ROC(Receiver Operating Characteristic) analysis는 연속적으로 변하는 cut-off value에서의 sensitivity와 1-specificity에 의해 그려지는 곡선으로서 진단 방법의 타당성을 결정하고, 여러 진단 방법들을 비교하는 분석법으로 알려져 있다. 부정교합자 496명을 대상으로 측모 두부 X-선 계측사진과 진단모형을 이용하여, 진단모형 계측을 통해 부정교합군을 분류하였으며, 이중 III급 부정 교합자는 245명이었다. 측모 두부 X-선계측사진에서 16개의 계측항목을 선정하였으며, 이 계측항목들과 III급 부정교합의 관계를 알아보고자 각도 계측항목에서는 $1^{\circ}$ 간격으로, 선계측항목에서는 1mm의 간격으로 sensitivity와 specificity를 구해 ROC curve를 그렸다. 그리고, 이 계측항목들의 직접적인 비교를 위해 ROC curve 아래의 면적을 계산해냈다. 결과는 다음과 같다. 1. III급 부정교합을 판별하는데 있어, "Wits" appraisal이 다른 계측 항목에 비해 더 나은 진단 효율을 보였다. 2. AB plane angle, ANB angle, App-Bpp distance, AF-BF distance, APDI, N perpendicular to A 와 Pog to N perpendicular의 차이, maxillomandibular differential도 높은 진단 가치를 보였다. 3. 하악골의 위치를 평가하는 계측항목은 중정도의 진단 효율을 보였다. 4. 상악골에 대한 계측항목은 III급 부정교합의 판별에 대한 진단 가치가 낮았다.

• 대한간호학회지
• /
• 제33권2호
• /
• pp.162-169
• /
• 2003

Purpose: This study was to compare the predictive validity of Norton Scale(1962), Cubbin & Jackson Scale(1991), and Song & Choi Scale(1991). Method: Data were collected three times per week from 48~72hours after admission based on the four pressure sore risk assessment scales and a skin assessment tool for pressure sore on 112 intensive care unit(ICU) patients in a educational hospital Ulsan during Dec, 11, 2000 to Feb, 10, 2001. Four indices of validity and area under the curve(AUC) of receiver operating characteristic(ROC) were calculated. Result: Based on the cut off point presented by the developer, sensitivity, specificity, positive predictive value, negative predictive value were as follows : Norton Scale : 97%, 18%, 35%, 93% respectively; Cubbin & Jackson Scale : 89%, 61%, 51%, 92%, respectively; and Song & Choi Scale : 100%, 18%, 36%, 100% respectively. Area under the curves(AUC) of receiver operating characteristic(ROC) were Norton Scale .737, Cubbin & Jackson Scale .826, Song & Choi Scale .683. Conclusion: The Cubbin & Jackson Scale was found to be the most valid pressure sore risk assessment tool. Further studies on patients with chronic conditions may be helpful to validate this finding.