• 제목/요약/키워드: False negative rate

검색결과 160건 처리시간 0.027초

False Alarm Rate 변화에 따른 DoS/DDoS 탐지 알고리즘의 성능 분석 (Performance Analysis of DoS/DDoS Attack Detection Algorithms using Different False Alarm Rates)

  • 장범수;이주영;정재일
    • 한국시뮬레이션학회논문지
    • /
    • 제19권4호
    • /
    • pp.139-149
    • /
    • 2010
  • 인터넷은 확장성과 최선형 라우팅 서비스를 목적으로 설계되었기 때문에 보안상에 취약점을 가진다. 이에 IP spoofing과 DoS/DDoS 공격을 탐지하기 위한 다양한 공격 탐지 방법들이 제안되었다. DoS/DDoS 공격은 공격이 시작되고 짧은 시간 내에 목적을 이루기 때문에 공격 탐지 알고리즘들은 빠른 시간 내에 정확한 탐지를 하는 것이 중요하다. 공격 탐지 알고리즘들은 미탐지율과 오탐지율로 이루어진 오경고율을 가지며 공격 탐지 알고리즘의 성능을 평가하는 중요한 요소가 된다. 본 논문에서는 공격 탐지 알고리즘의 특징을 살펴보고 그 성능을 분석하였다. 공격 탐지 알고리즘의 성능은 미탐지율과 오탐지율을 변화시켰을 시, 공격 트래픽 및 일반 트래픽에 미치는 영향을 시뮬레이션을 통해 각각 분석하였다. 이를 통해 전송되는 공격 패킷의 수는 미탐지율에 비례하며, 전송되는 일반 패킷의 수는 일정 치 이하의 미탐지율과 오탐지율에 반비례하는 것을 확인하였다. 또 공격 탐지 알고리즘의 미탐지율 변화에 따른 오탐지율의 변화를 분석하여 미탐지율과 오탐지율의 관계를 도출하고 공격탐지 알고리즘의 한계를 분석하였다. 이러한 한계를 극복하기 위해 정확한 네트워크 상태를 판단하여 공격 탐지 알고리즘의 한계를 줄이고 성능을 개선하는 방안을 제안하였고 그 결과, 공격 탐지 알고리즘의 성능이 보다 향상됨을 확인하였다.

TPR-TNR plot for confusion matrix

  • Hong, Chong Sun;Oh, Tae Gyu
    • Communications for Statistical Applications and Methods
    • /
    • 제28권2호
    • /
    • pp.161-169
    • /
    • 2021
  • The two-dimensional confusion matrix used in credit assessment, biostatistics, and many other fields consists of true positive, true negative, false positive, and false negative. Their rates, such as the true positive rate (TPR), true negative rate (TNR), false positive rate, and false negative rate, can be applied to measure its accuracy. In this study, we propose the TPR-TNR plot, a graphical method that can geometrically describe and explain these rates based on the confusion matrix. The proposed TPR-TNR plot consists of two right-angled triangles. We obtain that the TPR and TNR describe the acute angles of right-angled triangles in the plot. These acute angles can be used to determine optimal thresholds corresponding to lots of accuracy measures.

판정행렬을 기반한 일체형 PET-MRI의 폐암 진단 유용성 평가 (Evaluation of Usefulness for Diagnosis of Lung Cancer on Integrated PET-MRI Using Decision Matrix)

  • 김정수;양현진;김유미;권형진;박찬록
    • 대한방사선기술학회지:방사선기술과학
    • /
    • 제44권6호
    • /
    • pp.635-643
    • /
    • 2021
  • The results of empirical researches on the diagnosis of lung cancer are insufficient, so it is limited to objectively judge the clinical possibility and utilization according to the accuracy of diagnosis. Thus, this study retrospectively analyzed the lung cancer diagnostic performance of PET-MRI (Positron Emission Tomography-Magnetic Resonance Imaging) by using the decision matrix. This study selected and experimented total 165 patients who received both hematological CEA (Carcinoembryonic Antigen) test and hybrid PET-MRI (18F-FDG, 5.18 MBq/kg / Body TIM coil. VIVE-Dixon). After setting up the result of CEA (positive:>4 ㎍/ℓ. negative:<2.5㎍/ℓ) as golden data, the lung cancer was found in the image of PET-MRI, and then the SUVmax (positive:>4, negative:<1.5) was measured, and then evaluated the correlation and significance of results of relative diagnostic performance of PET-MRI compared to CEA through the statistical verification (t-test, P>0.05). Through this, the PET-MRI was analyzed as 96.29% of sensitivity, 95.23% of specificity, 3.70% of false negative rate, 4.76% of false positive rate, and 95.75% of accuracy. The false negative rate was 1.06% lower than the false positive rate. The PET-MRI that significant accuracy of diagnosis through high sensitivity and specificity, and low false negative rate and false positive rate of lung cancer, could acquire the fusion image of specialized soft tissue by combining the radio-pharmaceuticals with various sequences, so its clinical value and usefulness are regarded as latently sufficient.

갑상선 병변의 세침흡인 세포검사의 유용성에 관한 연구 (A Study of Usefulness of Fine Needle Aspiration Cytology of the Thyroid Lesions)

  • 진계현;진소영;이동화
    • 대한세포병리학회지
    • /
    • 제7권2호
    • /
    • pp.111-121
    • /
    • 1996
  • Fine needle aspiration cytology(FNAC) is preferred because of simplicity, safety, and reliability in the evaluation of patients with thyroid nodule or hyperplasia. However, there are a few limitations such as false-negative or false-positive cases and non-diagnostic material. To evaluate the usefulness of FNAC in thyroid lesions, we reviewed 704 FNAC cases of thyroid nodules from 1988 to 1994 at Soonchunhyang University Hospital. The results are as follows. 1. Among 704 FNAC cases of thyroid gland, 571(81.1%) cases were benign, 12(1.7%) were suspicious, 71(10.1%) were malignancy, and 50(7.1%) were material insufficiency. The cytologic diagnoses of the benign lesions included 168 cases of follicular neoplasm, 139 cases of adenomatous goiter, 162 cases of follicular lesion such as follicular neoplasm or adenomatous goiter, 61 cases of Hashimoto's thyroiditis, 13 cases of subacute thyroiditis, and 28 cases of colloidal nodule or benign nodule. The malignant lesions included 68 cases of papillary carcinona, two medullary carcinomas and a case of metastatic colon cancer. 2. The average number of cytologic smear slides was $4.12{\pm}1.81$ in material insufficiency and $5.63{\pm}1.79$ in diagnostic cases. This difference was statistically significant(p<0.00001). 3. Histological assessment of 150 cases revealed 2 false negative and 1 false positive cases. The false negative cases were a case of marked sclerosis in papillary carcinoma and an occult case of papillary carcinoma. The false positive case resulted from pseudo-ground glass nuclei due to marked dry artifact. 4. Comparison between the FNAC and the histologic diagnosis revealed that FNAC had a sensitivity of 93.5%, a specificity of 99.2%, a false negative rate of 6.6%, a false positive rate of 0.8%, and an overall diagnostic accuracy of 98.0%. Therefore, FNAC of thyroid gland is a very reliable diagnostic method with excellent accuracy rate.

  • PDF

포트 스캐닝 기법 기반의 공격을 탐지하기 위한 실시간 스캔 탐지 시스템 구현 (A Real Time Scan Detection System against Attacks based on Port Scanning Techniques)

  • 송중석;권용진
    • 한국정보과학회논문지:정보통신
    • /
    • 제31권2호
    • /
    • pp.171-178
    • /
    • 2004
  • 포트 스캐닝 탐지 시스템은 “False Positive”(실제 공격이 아닌데 공격이라고 탐지, 오탐지)와 “False Negative”(실제 공격인데 공격이 아니라고 탐지, 미탐지)가 낮아야 하는 등의 시스템 성능에 관한 요구사항과, 해당 탐지 시스템을 활용한 보안관리가 용이해야 하는 등의 사용자 친화적인 요구사항을 만족할 필요가 있다. 그러나 공개되어 있는 실시간 스캔 탐지 시스템은 False Positive가 높고 다양한 스캔 기법에 대한 탐지가 잘 이루어지지 않고 있다. 또한 실시간 스캔 탐지 시스템의 대부분이 명령어 기반으로 이루어져 있기 때문에 이률 활용하여 시스템 보안 관리를 수행하는데 많은 어려움이 있다. 따라서 본 논문에서는 새로운 필터 룰 집합의 적용에 의해 포트 스캐닝 기법 기반의 다양한 공격을 탐지 할 수 있고, 공격자의 행동 패턴으로부터 유도된 ABP-Rule의 적용에 의해 False Positive를 최소화할 수 있는 실시간 스캔 탐지 시스템(TkRTSD)을 제안한다. 또한 Tcl/Tk를 이용하여 GUI환경을 구축함으로써 사용자가 쉽게 보안관리를 할 수 있는 사용자 친화적인 탐지 시스템을 제안한다.

갑상선결절(甲狀腺結節)에서의 흡인세포학적(吸引細胞學的) 소견(所見)과 병리조직학적(病理組織學的) 진단(診斷)에 대한 비교연구(比較硏究) (Histopathologic Comparative Study of Aspiration Biopsy Cytology from 139 Thyroid Nodules)

  • 김광철;왕희정;서연림;장석효;이혁상
    • 대한두경부종양학회지
    • /
    • 제8권2호
    • /
    • pp.97-105
    • /
    • 1992
  • One hundred and thirty-nine thyroid nodules were evaluated by aspiration biopsy cytology (ABC) and were compared with the postoperative histologic diagnosis during the period from May 1, 1986 through Aug. 31, 1992. The correlation betwen the two diagnoses proved to be comparable with a low incidence of false-negative diagnoses, but with a relatively high incidence of false-positive ones. The sensitivity was 93.5%, specificity 89.6%, false-negative rate 6.5%, false-positive rate 10.4%, positive predictability 87.9%, negative predictability 94.5%, and overall diagnostic accuracy 91.4%.

  • PDF

타임 윈도우 기반의 T-N2SCD 탐지 모델 구현 (Design of T-N2SCD Detection Model based on Time Window)

  • 신미예;원일용;이상호
    • 한국정보통신학회논문지
    • /
    • 제13권11호
    • /
    • pp.2341-2348
    • /
    • 2009
  • 호스트 기반 침입탐지 기법에는 시스템 호출 순서를 고려하는 방법과 시스템 호출 파라미터를 고려하는 방법이 있다. 이 두 방법은 프로세스의 시스템 호출이 일어나는 전 구간에서 시스템 호출 순서에 이상이 있거나 시스템 호출 파라미터의 순서 및 길이 등에 이상이 있는 경우에 적합하지만 긍정적 결함율과 부정적 결함율이 높은 단점이 있다. 이 논문에서는 시스템 호출을 이용한 방법에서 발생하는 긍정적 결함율과 부정적 결함율을 줄이기 위해서 단위 시간을 도입한 타임 윈도우 기반의 T-N2SCD 탐지 모델을 제안한다. 제안 모델의 실험에 사용된 데이터는 DARPA에서 제공된 데이터이며, 실험 결과 제안 모델은 다른 시간 간격 보다 1000ms 시간 간격으로 실험하였을 경우가 긍정적 결합률과 부정적 결합률이 가장 낮았다.

대기행렬을 이용한 위음성률이 있는 코로나 취합검사 시스템의 분석 (The Analysis of COVID-19 Pooled-Testing Systems with False Negatives Using a Queueing Model)

  • 김길환
    • 산업경영시스템학회지
    • /
    • 제44권4호
    • /
    • pp.154-168
    • /
    • 2021
  • COVID-19 has been spreading all around the world, and threatening global health. In this situation, identifying and isolating infected individuals rapidly has been one of the most important measures to contain the epidemic. However, the standard diagnosis procedure with RT-PCR (Reverse Transcriptase Polymerase Chain Reaction) is costly and time-consuming. For this reason, pooled testing for COVID-19 has been proposed from the early stage of the COVID-19 pandemic to reduce the cost and time of identifying the COVID-19 infection. For pooled testing, how many samples are tested in group is the most significant factor to the performance of the test system. When the arrivals of test requirements and the test time are stochastic, batch-service queueing models have been utilized for the analysis of pooled-testing systems. However, most of them do not consider the false-negative test results of pooled testing in their performance analysis. For the COVID-19 RT-PCR test, there is a small but certain possibility of false-negative test results, and the group-test size affects not only the time and cost of pooled testing, but also the false-negative rate of pooled testing, which is a significant concern to public health authorities. In this study, we analyze the performance of COVID-19 pooled-testing systems with false-negative test results. To do this, we first formulate the COVID-19 pooled-testing systems with false negatives as a batch-service queuing model, and then obtain the performance measures such as the expected number of test requirements in the system, the expected number of RP-PCR tests for a test sample, the false-negative group-test rate, and the total cost per unit time, using the queueing analysis. We also present a numerical example to demonstrate the applicability of our analysis, and draw a couple of implications for COVID-19 pooled testing.

Bivariate ROC Curve and Optimal Classification Function

  • Hong, C.S.;Jeong, J.A.
    • Communications for Statistical Applications and Methods
    • /
    • 제19권4호
    • /
    • pp.629-638
    • /
    • 2012
  • We propose some methods to obtain optimal thresholds and classification functions by using various cutoff criterion based on the bivariate ROC curve that represents bivariate cumulative distribution functions. The false positive rate and false negative rate are calculated with these classification functions for bivariate normal distributions.

급성담낭염에서 담낭신티그라피의 임상적 이용 (Clinical Use of Cholescintigraphy in Aeute Cholecystitis: A Comparative Study with Ultrasonography)

  • 서광휘;정혜경;김명곤;정덕수;성낙관;김옥동
    • 대한핵의학회지
    • /
    • 제27권1호
    • /
    • pp.81-87
    • /
    • 1993
  • Retrospective analysis of cholescintigraphy and ultrasonography was done in 76 patients with clinically suspected acute cholecystitis to assess the relative value of the two modalities. Excluding the Patients with obstructive jaundice, the overall results of cholescintigraphy(sensitivity 100%, specificity 95%, false positive rate 5%, false negative rate 0%, accuracy 97%) are nearly identical with or rather superior to those of the ultrasonography(sensitivity 94%, specificity 100%, false positive rate 0%, false negative rate 5%, accuracy 97%). We recommend the cholescintigraphy as the initial modality in patients with clinically suspected acute cholecystitis, and ultrasonography can be used in jaundiced patients to exclude the possibility of the false positive of cholescintigraphy.

  • PDF