• 제목/요약/키워드: Probability Score

검색결과 295건 처리시간 0.029초

MLP ANN 가뭄 예측 모형에 대한 ROC 평가 (ROC evaluation for MLP ANN drought forecasting model)

  • 정민수;김종석;장호원;이주헌
    • 한국수자원학회논문집
    • /
    • 제49권10호
    • /
    • pp.877-885
    • /
    • 2016
  • 본 연구에서는 기상학적 가뭄지수인 표준강수지수(Standardized Precipitation Index, SPI)를 이용하여 우리나라 전역에 대한 가뭄예측의 시공간적인 평가를 수행하였다. 또한 다층 퍼셉트론 인공신경망(Multi Layer Perceptron-Artificial Neural Network, MLP-ANN) 예측 기법을 이용하여 SPI(3), (6)에 대한 선행예보시간별 가뭄 예측을 실시하였다. 입력 자료는 기상청 산하의 59개 관측소에서 관측된 기상자료를 활용하였고, 관측자료 기간은 1976~2015년이다. 예측 모델의 성능평가는 기준점(Threshold)에 따른 가뭄 발생유무와 같은 이진분류 혼동행렬을 구성하여 Receiver Operating Characteristics (ROC) score와 조건부 확률에 따른 F score를 산정하여 예측 성능평가를 수행하였다. 예측성능에 대한 ROC 분석결과 다층 퍼셉트론 인공신경망(MLP-ANN) 모형을 적용한 가뭄예측성능이 매우 우수한 것으로 나타났으며, SPI (3)은 2개월, SPI (6)는 5개월 정도의 선행예측이 충분히 가능한 것으로 나타났다.

MEASURING THE INFLUENCE OF TASK COMPLEXITY ON HUMAN ERROR PROBABILITY: AN EMPIRICAL EVALUATION

  • Podofillini, Luca;Park, Jinkyun;Dang, Vinh N.
    • Nuclear Engineering and Technology
    • /
    • 제45권2호
    • /
    • pp.151-164
    • /
    • 2013
  • A key input for the assessment of Human Error Probabilities (HEPs) with Human Reliability Analysis (HRA) methods is the evaluation of the factors influencing the human performance (often referred to as Performance Shaping Factors, PSFs). In general, the definition of these factors and the supporting guidance are such that their evaluation involves significant subjectivity. This affects the repeatability of HRA results as well as the collection of HRA data for model construction and verification. In this context, the present paper considers the TAsk COMplexity (TACOM) measure, developed by one of the authors to quantify the complexity of procedure-guided tasks (by the operating crew of nuclear power plants in emergency situations), and evaluates its use to represent (objectively and quantitatively) task complexity issues relevant to HRA methods. In particular, TACOM scores are calculated for five Human Failure Events (HFEs) for which empirical evidence on the HEPs (albeit with large uncertainty) and influencing factors are available - from the International HRA Empirical Study. The empirical evaluation has shown promising results. The TACOM score increases as the empirical HEP of the selected HFEs increases. Except for one case, TACOM scores are well distinguished if related to different difficulty categories (e.g., "easy" vs. "somewhat difficult"), while values corresponding to tasks within the same category are very close. Despite some important limitations related to the small number of HFEs investigated and the large uncertainty in their HEPs, this paper presents one of few attempts to empirically study the effect of a performance shaping factor on the human error probability. This type of study is important to enhance the empirical basis of HRA methods, to make sure that 1) the definitions of the PSFs cover the influences important for HRA (i.e., influencing the error probability), and 2) the quantitative relationships among PSFs and error probability are adequately represented.

혼합분포에서 최적분류점 (Optimal Thresholds from Mixture Distributions)

  • 홍종선;주재선;최진수
    • 응용통계연구
    • /
    • 제23권1호
    • /
    • pp.13-28
    • /
    • 2010
  • 혼합분포를 가정한 신용평가연구에서 부도차주를 정상으로 예측하거나 정상차주를 부도로 예측하는 오류를 최소화하는 분류점을 추정하는 방법을 토론한다. 확률변수 스코어와 정상과 부도상태의 모수공간으로 정의된 확률밀도함수들에 대하여 강력검정과 일반화가능도비검정을 이용하여 최적분류점의 추정방법을 제안하고, ROC와 CAP 곡선에서 분류정확도를 측정하는 정확도(accuarcy)와 진실율(true rate)을 이용하여 이 측도를 최대로 하는 최적분류점을 확률밀도함수의 관계식으로 추정하는 방법을 제안한다. 다양한 정규분포에서 가설검정, 정확도 그러고 진실율을 이용하는 세가지 방법의 최적분류점을 구하고 각최적분류점에 대응하는 제 I 종과 제 II 종 오류합의 크기를 비교하여 효율성을 토론한다.

기상청 고해상도 국지 앙상블 예측 시스템 구축 및 성능 검증 (Development and Evaluation of the High Resolution Limited Area Ensemble Prediction System in the Korea Meteorological Administration)

  • 김세현;김현미;계준경;이승우
    • 대기
    • /
    • 제25권1호
    • /
    • pp.67-83
    • /
    • 2015
  • Predicting the location and intensity of precipitation still remains a main issue in numerical weather prediction (NWP). Resolution is a very important component of precipitation forecasts in NWP. Compared with a lower resolution model, a higher resolution model can predict small scale (i.e., storm scale) precipitation and depict convection structures more precisely. In addition, an ensemble technique can be used to improve the precipitation forecast because it can estimate uncertainties associated with forecasts. Therefore, NWP using both a higher resolution model and ensemble technique is expected to represent inherent uncertainties of convective scale motion better and lead to improved forecasts. In this study, the limited area ensemble prediction system for the convective-scale (i.e., high resolution) operational Unified Model (UM) in Korea Meteorological Administration (KMA) was developed and evaluated for the ensemble forecasts during August 2012. The model domain covers the limited area over the Korean Peninsula. The high resolution limited area ensemble prediction system developed showed good skill in predicting precipitation, wind, and temperature at the surface as well as meteorological variables at 500 and 850 hPa. To investigate which combination of horizontal resolution and ensemble member is most skillful, the system was run with three different horizontal resolutions (1.5, 2, and 3 km) and ensemble members (8, 12, and 16), and the forecasts from the experiments were evaluated. To assess the quantitative precipitation forecast (QPF) skill of the system, the precipitation forecasts for two heavy rainfall cases during the study period were analyzed using the Fractions Skill Score (FSS) and Probability Matching (PM) method. The PM method was effective in representing the intensity of precipitation and the FSS was effective in verifying the precipitation forecast for the high resolution limited area ensemble prediction system in KMA.

가변 신뢰도 문턱치를 사용한 미등록어 거절 알고리즘에 대한 연구 (A Study on Out-of-Vocabulary Rejection Algorithms using Variable Confidence Thresholds)

  • 방기덕;강철호
    • 한국멀티미디어학회논문지
    • /
    • 제11권11호
    • /
    • pp.1471-1479
    • /
    • 2008
  • 본 논문에서는 음성인식 분야에서 많이 사용되고 있는 가변어휘 단어 인식 시스템에서 미등록어에 대한 거절 성능을 향상시키는 방법을 제안한다. 거절 기능을 구현하는 방식은 핵심어 검출(keyword spotting)방식과 발화검증(utterance verification)으로 구분이 된다. 발화 검증 방식은 각 음소마다 이와 유사한 반음소모델(anti-phoneme model)을 생성한 후 정상적인 음소 모델과 반음소 모델의 유사도를 비교하여 결정하는 방식이다. 본 논문에서는 화자가 발성할 때마다 구해지는 화자확인 확률값을 신뢰도 문턱치를 결정할 때 적용하는 방법에 대하여 제안하였다. 제안한 방법을 사용하였을 때, 사무실 환경에서 CA(Correctly Accepted for keyword)가 94.23%, CR(Correctly Rejected for out-of-vocabulary)이 95.11%로 나타났고, 잡음 환경에서는 CA가 91.14%, CR이 92.74%로 나타나서 성능이 향상됨을 확인할 수 있었다.

  • PDF

자발성 뇌내출혈 환자의 예후 예측도구 비교 (Comparison of Predict Mortality Scoring Systems for Spontaneous Intracerebral Hemorrhage Patients)

  • 연복희;김은경
    • 성인간호학회지
    • /
    • 제17권3호
    • /
    • pp.464-473
    • /
    • 2005
  • Purpose: The purpose of this study was to evaluate and compare the predictive ability of three mortality scoring systems; Acute Physiology and Chronic Health Evaluation(APACHE) III, Simplified Acute Physiology Score(SAPS) II, and Mortality Probability Model(MPM) II in discriminating in-hospital mortality for intensive care unit(ICU) patients with spontaneous intracerebral hemorrhage. Methods: Eighty-nine patients admitted to the ICU at a university hospital in Daejeon Korea were recruited for this study. Medical records of the subject were reviewed by a researcher from January 1, 2003 to March 31, 2004, retrospectively. Data were analyzed using SAS 8.1. General characteristic of the subjects were analyzed for frequency and percentage. Results: The results of this study were summarized as follows. The values of the Hosmer-Lemeshow's goodness-of-fit test for the APACHE III, the SAPS II and the MPM II were chi-square H=4.3849 p=0.7345, chi-square H=15.4491 p=0.0307, and chi-square H=0.3356 p=0.8455, respectively. Thus, The calibration of the MPM II found to be the best scoring system, followed by APACHE III. For ROC curve analysis, the areas under the curves of APACHE III, SAPS II, and MPM II were 0.934, 0.918 and 0.813, respectively. Thus, the discrimination of three scoring systems were satisfactory. For two-by-two decision matrices with a decision criterion of 0.5, the correct classification of three scoring systems were good. Conclusion: Both the APACHE III and the MPM II had an excellent power of mortality prediction and discrimination for spontaneous intracerebral hemorrhage patients in ICU.

  • PDF

중학교 과학에서 탐구자료 활용 수업의 효과 (The Effects of Inquiry Instruction Utilizing Materials in Middle School Science)

  • 김상달;김찬기;김희정;주국영
    • 대한지구과학교육학회지
    • /
    • 제1권1호
    • /
    • pp.63-71
    • /
    • 2008
  • The purpose for this study is to check if research activities can make positive effects on inquiry instruction utilizing materials when compared to traditional instruction utilizing the textbook. The effects of the class should be measured both in cognitive domain and in affective domain. The cognitive domain was measured by the change in achievements in learning science, and the affective domain was measured by the change in learning attitudes of science. The assumptions to be verified in this study were as follows. First, achievements in learning science are higher in the learner oriented inquiry instruction utilizing materials than in the learner oriented traditional instruction utilizing the textbook. Second, learning attitudes of science are higher in the learner oriented inquiry instruction utilizing materials than in the learner oriented traditional instruction utilizing the textbook.The results of the research are as follows. In the cognitive domain, achievements in learning science showed significant change(p=.045) measured by verifying the score for the difference among the averages for each sub-scale, in 5% of meaningful probability, and were higher in the inquiry instruction utilizing materials study. In the affective domain, learning attitudes of science showed significant change(p=.019) measured by verifying the score for the difference among the averages for each sub-scale, in 5% of meaningful probability, and were higher in the inquiry instruction utilizing materials study. In learning attitudes of science, 2 items(self-conception of science, attitudes of learning science) out of 3 items(self-conception of science, attitudes of learning science, learning habits of science) showed significant changes (p=.045, p=.001). But the difference(learning-habits of science) was not significant(p=.914).

  • PDF

EVALUATION OF SEA FOG DETECTION USING A REMOTE SENSED DATA COMBINED METHOD

  • Heo, Ki-Young;Ha, Kyung-Ja;Kim, Jae-Hwan;Shim, Jae-Seol;Suh, Ae-Sook
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2007년도 Proceedings of ISRS 2007
    • /
    • pp.294-297
    • /
    • 2007
  • Steam and advection fogs are frequently observed in the Yellow Sea located between Korea and China during the periods of March-April and June-July respectively. This study uses the remote sensing (RS) data for monitoring sea fog. Meteorological data obtained from the Ieodo Ocean Research Station provided an informative synopsis for the occurrence of steam and advection fogs through a ground truth. The RS data used in this study was GOES-9, MTSAT-1R images and QuikSCAT wind data. A dual channel difference (DCD) approach using IR and near-IR channel of GOES-9 and MTSAT-1R satellites was applied to estimate the extension of the sea fog. For the days examined, it was found that not only the DCD but also the texture-related measurement and the weak wind condition are required to separate the sea fog from the low cloud. The QuikSCAT wind is used to provide a weak wind area less than threshold under stable condition of the surface wind around a fog event. The Laplacian computation for a measurement of the homogeneity was designed. A new combined method of DCD, QuikSCAT wind speed and Laplacian was applied in the twelve cases with GOES-9 and MTSAT-1R. The threshold values for DCD, QuikSCAT wind speed and Laplacian are -2.0 K, 8 m $s^{-1}$ and 0.1, respectively. The validation methods such as Heidke skill score, probability of detection, probability of false detection, true skill score and odds ratio show that the new combined method improves the detection of sea fog rather than DCD method.

  • PDF

일배체형에 기초한 연쇄분석의 통계학적 알고리즘 연구 (Statistical Algorithm in Genetic Linkage Based on Haplotypes)

  • 김진흠;강대룡;이윤경;신선미;서일;남정모
    • Journal of Preventive Medicine and Public Health
    • /
    • 제37권4호
    • /
    • pp.366-372
    • /
    • 2004
  • Objectives : This study was conducted to propose a new transmission/disequilibrium test(TDT) to test the linkage between genetic markers and disease-susceptibility genes based on haplotypes. Simulation studies were performed to compare the proposed method with that of Zhao et al. in terms of type I error probability and powers. Methods : We estimated the haplotype frequencies using the expectation-maximization(EM) algorithm with parents genotypes taken from a trio dataset, and then constructed a two-way contingency table containing estimated frequencies to all possible pairs of parents haplotypes. We proposed a score test based on differences between column marginals and their corresponding row marginals. The test also involved a covariance structure of marginal differences and their variances. In simulation, we considered a coalescent model with three genetic markers of biallele to investigate the performance of the proposed test under six different configurations. Results : The haplotype-based TDT statistics, our test and Zhao et al.'s test satisfied a type I error probability, but the TDT test based on single locus showed a conservative trend. As expected, the tests based on haplotypes also had better powers than those based on single locus. Our test and that of Zhao et al. were comparable in powers. Conclusion : We proposed a TDT statistic based on haplotypes and showed through simulations that our test was more powerful than the single locus-based test. We will extend our method to multiplex data with affected and/or unaffected sibling(s) or simplex data having only one parent s genotype.

신호접근법을 이용한 건화물시장 해운조기경보모형에 관한 연구 (A Study on Early Warning Model in the Dry Bulk Shipping Industry by Signal Approach)

  • 윤정노;김가현;류동근
    • 한국항해항만학회지
    • /
    • 제42권1호
    • /
    • pp.57-66
    • /
    • 2018
  • 해운산업은 파생적 수요의 특성으로 대외적 요인에 영향을 크게 받는다. 하지만, 공급 측면은 이러한 수요의 변화에 즉각적으로 대응할 수 없는 특성 때문에 해운산업은 호황과 불황을 거듭하게 된다. 그러므로 정부는 이러한 상황에 대응하기 위해 조기경보모형을 구축해 시장을 모니터링하고 다가올 위험을 예측하는 것이 필요하다. 본 연구에서는 신호접근법을 사용해 조기경보모형을 구축하였으며, 위기지수는 BDI를 사용해 정의하였으며 금융, 경제, 선박 등 다양한 선행지수를 활용해 종합선행지수를 도출하였다. 그 결과, 종합선행지수가 해운분야의 실제 위기지수와 비교해 4개월의 시차를 두고 높은 상관관계를 보였고, QPS(Quadratic Probability Score)가 0.37로 정확도가 높은 것으로 나타났다.