• Title/Summary/Keyword: conditional probability model

Search Result 126, Processing Time 0.024 seconds

ROC evaluation for MLP ANN drought forecasting model (MLP ANN 가뭄 예측 모형에 대한 ROC 평가)

  • Jeong, Min-Su;Kim, Jong-Suk;Jang, Ho-Won;Lee, Joo-Heon
    • Journal of Korea Water Resources Association
    • /
    • v.49 no.10
    • /
    • pp.877-885
    • /
    • 2016
  • In this study, the Standard Precipitation Index(SPI), meteorological drought index, was used to evaluate the temporal and spatial assessment of drought forecasting results for all cross Korea. For the drought forecasting, the Multi Layer Perceptron-Artificial Neural Network (MLP-ANN) was selected and the drought forecasting was performed according to different forecasting lead time for SPI (3) and SPI (6). The precipitation data observed in 59 gaging stations of Korea Meteorological Adminstration (KMA) from 1976~2015. For the performance evaluation of the drought forecasting, the binary classification confusion matrix, such as evaluating the status of drought occurrence based on threshold, was constituted. Then Receiver Operating Characteristics (ROC) score and F score according to conditional probability are computed. As a result of ROC analysis on forecasting performance, drought forecasting performance, of applying the MLP-ANN model, shows satisfactory forecasting results. Consequently, two-month and five-month leading forecasts were possible for SPI (3) and SPI (6), respectively.

Mid-Term Energy Demand Forecasting Using Conditional Restricted Boltzmann Machine (조건적 제한된 볼츠만머신을 이용한 중기 전력 수요 예측)

  • Kim, Soo-Hyun;Sun, Young-Ghyu;Lee, Dong-gu;Sim, Is-sac;Hwang, Yu-Min;Kim, Hyun-Soo;Kim, Hyung-suk;Kim, Jin-Young
    • Journal of IKEEE
    • /
    • v.23 no.1
    • /
    • pp.127-133
    • /
    • 2019
  • Electric power demand forecasting is one of the important research areas for future smart grid introduction. However, It is difficult to predict because it is affected by many external factors. Traditional methods of forecasting power demand have been limited in making accurate prediction because they use raw power data. In this paper, a probability-based CRBM is proposed to solve the problem of electric power demand prediction using raw power data. The stochastic model is suitable to capture the probabilistic characteristics of electric power data. In order to compare the mid-term power demand forecasting performance of the proposed model, we compared the performance with Recurrent Neural Network(RNN). Performance comparison using electric power data provided by the University of Massachusetts showed that the proposed algorithm results in better performance in mid-term energy demand forecasting.

Additive hazards models for interval-censored semi-competing risks data with missing intermediate events (결측되었거나 구간중도절단된 중간사건을 가진 준경쟁적위험 자료에 대한 가산위험모형)

  • Kim, Jayoun;Kim, Jinheum
    • The Korean Journal of Applied Statistics
    • /
    • v.30 no.4
    • /
    • pp.539-553
    • /
    • 2017
  • We propose a multi-state model to analyze semi-competing risks data with interval-censored or missing intermediate events. This model is an extension of the three states of the illness-death model: healthy, disease, and dead. The 'diseased' state can be considered as the intermediate event. Two more states are added into the illness-death model to incorporate the missing events, which are caused by a loss of follow-up before the end of a study. One of them is a state of the lost-to-follow-up (LTF), and the other is an unobservable state that represents an intermediate event experienced after the occurrence of LTF. Given covariates, we employ the Lin and Ying additive hazards model with log-normal frailty and construct a conditional likelihood to estimate transition intensities between states in the multi-state model. A marginalization of the full likelihood is completed using adaptive importance sampling, and the optimal solution of the regression parameters is achieved through an iterative quasi-Newton algorithm. Simulation studies are performed to investigate the finite-sample performance of the proposed estimation method in terms of empirical coverage probability of true regression parameters. Our proposed method is also illustrated with a dataset adapted from Helmer et al. (2001).

An Analysis on Consumer Preference for Attributes of Agricultural Box Scheme (농산물 꾸러미 속성별 소비자선호 분석)

  • Park, Jae-Dong;Kim, Tae-Kyun;Jang, Woo-Whan;Lim, Cheong-Ryong
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.1
    • /
    • pp.329-338
    • /
    • 2019
  • In this study, we analyze consumer preferences based on the agricultural box scheme attributes, and make a suggestion for business revival. We estimate the marginal willingness to pay (MWTP) for box scheme attributes using a choice experiment. Attributes include the bundle method, the delivery method, and price. To select an efficient model for statistical analysis, we evaluate the conditional logit model, heteroscedastic extreme value model(HEV model), multinomial probit model, and mixed logit model under different assumptions. The results of these four models show that the bundle method, the delivery method, and price are statistically significant in explaining the probability of participation in a box scheme. The results of likelihood ratio tests show that the heteroscedastic extreme value model is the most appropriate for our survey data. The results also indicate that MWTP for a change from fixed type to selection type is KRW 7,096.6. MWTP for a change from parcel service to direct delivery and cold-chain delivery are KRW 3,497.5 and KRW 7,532.7, respectively. The results of this study may contribute to the government's local food policies.

A Selection of Threshold for the Generalized Hough Transform: A Probabilistic Approach (일반화된 허프변환의 임계값 선택을 위한 확률적 접근방식)

  • Chang, Ji Y.
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.1
    • /
    • pp.161-171
    • /
    • 2014
  • When the Hough transform is applied to identify an instance of a given model, the output is typically a histogram of votes cast by a set of image features into a parameter space. The next step is to threshold the histogram of counts to hypothesize a given match. The question is "What is a reasonable choice of the threshold?" In a standard implementation of the Hough transform, the threshold is selected heuristically, e.g., some fraction of the highest cell count. Setting the threshold too low can give rise to a false alarm of a given shape(Type I error). On the other hand, setting the threshold too high can result in mis-detection of a given shape(Type II error). In this paper, we derive two conditional probability functions of cell counts in the accumulator array of the generalized Hough transform(GHough), that can be used to select a scientific threshold at the peak detection stage of the Ghough.

The Effects of Time Domain Windowing and Detection Ordering on Successive Interference Cancellation in OFDM Systems over Doubly Selective Channels (이중 선택적 채널 OFDM 시스템에서 시간 영역 윈도우와 검출 순서가 순차적 간섭 제거에 미치는 영향)

  • Lim, Dong-Min
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.21 no.6
    • /
    • pp.635-641
    • /
    • 2010
  • Time-varying channel characteristics in OFDM systems over doubly selective channels cause inter-carrier interferences(ICI) in the frequency domain. Time domain windowing gives rise to restriction on the bandwidth of the frequency domain channel matrix and makes it possible to approximate the OFDM system as a simplified linear input-output model. When successive interference cancellation based on linear MMSE estimation is employed for channel equalization in OFDM systems, symbol detection ordering produces considerable effects on overall system performances. In this paper, we show the reduction of the residual ICI by time domain windowing and the resultant performance improvements, and investigate the effects of SINR- and CSEP-based symbol detection ordering on the performance of successive interference cancellation.

Empirical Analysis on the Stress Test Using Credit Migration Matrix (신용등급 전이행렬을 활용한 위기상황분석에 관한 실증분석)

  • Kim, Woo-Hwan
    • The Korean Journal of Applied Statistics
    • /
    • v.24 no.2
    • /
    • pp.253-268
    • /
    • 2011
  • In this paper, we estimate systematic risk from credit migration (or transition) matrices under "Asymptotic Single Risk Factor" model. We analyzed transition matrices issued by KR(Korea Ratings) and concluded that systematic risk implied on credit migration somewhat coincide with the real economic cycle. Especially, we found that systematic risk implied on credit migration is better than that implied on the default rate. We also emphasize how to conduct a stress test using systematic risk extracted from transition migration. We argue that the proposed method in this paper is better than the usual method that is only considered for the conditional probability of default(PD). We found that the expected loss critically increased when we explicitly consider the change of credit quality in a given portfolio, compared to the method considering only PD.

The working experience of internal control personnel and crash risk

  • RYU, Hae-Young;CHAE, Soo-Joon
    • The Journal of Industrial Distribution & Business
    • /
    • v.10 no.12
    • /
    • pp.35-42
    • /
    • 2019
  • Purpose : This study examines The impact of human resource investment in internal control on stock price crash risk. Effective internal control ensures that information provided is complete and accurate, financial statements are reliable. By overseeing management, internal control systems can reduce agency costs between management and outside parties. In Korea, firms have to disclose information about internal control systems. The working experience of human resources in internal control systems is also provided for interested parties. If a firm hires more experienced internal control personnel, it can better facilitate the disclosure of information. Prior studies reported that information asymmetry between managers and investors increases future stock price crash risk. Therefore, the longer working experience internal control personnel have, the lower probability stock crashes have. Research design, data and methodology : This study analyzed the association between the working experience of internal control personnel and crash risk using regression analysis on KOSPI listed companies for fiscal years 2016 through 2017. The sample consists of 1,034 firm-years of non-financial firms whose fiscal year end on December 31. Career spanning data of internal control personnel was collected from internal control reports. The professionalism(IC_EXP) was measured as the logarithm of the average working experience of internal control personnel in months. Negative conditional skewness(NSKEW) and down-to-up volatility (DUVOL) are used to measure firm-specific crash risk. Both measures are based on firm-specific weekly returns derived from the expanded market model. Results : We find that work experience in internal control environment is negatively related to stock price crashes. Specifically, skewness(NSKEW) and volatility (DUVOL) are reduced when firms have longer tenure of human resources in internal control division. The results imply that firms with experienced internal control personnel are less likely to experience stock price crashes. Conclusions : Stock price crashes occur when investors realize that stock prices have been inflated due to information asymmetry. There is a learning effect when internal control processes are done repetitively. Thus, firms with more experienced internal control personnel could manage their internal control more effectively. The results of this study suggest that firms could decrease information asymmetry by investing in human resources for their internal control system.

Probabilistic Modeling of Photovoltaic Power Systems with Big Learning Data Sets (대용량 학습 데이터를 갖는 태양광 발전 시스템의 확률론적 모델링)

  • Cho, Hyun Cheol;Jung, Young Jin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.23 no.5
    • /
    • pp.412-417
    • /
    • 2013
  • Analytical modeling of photovoltaic power systems has been receiving significant attentions in recent years in that it is easy to apply for prediction of its dynamics and fault detection and diagnosis in advanced engineering technologies. This paper presents a novel probabilistic modeling approach for such power systems with a big data sequence. Firstly, we express input/output function of photovoltaic power systems in which solar irradiation and ambient temperature are regarded as input variable and electric power is output variable respectively. Based on this functional relationship, conditional probability for these three random variables(such as irradiation, temperature, and electric power) is mathematically defined and its estimation is accomplished from ratio of numbers of all sample data to numbers of cases related to two input variables, which is efficient in particular for a big data sequence of photovoltaic powers systems. Lastly, we predict the output values from a probabilistic model of photovoltaic power systems by using the expectation theory. Two case studies are carried out for testing reliability of the proposed modeling methodology in this paper.

Application of Bayesian network for farmed eel safety inspection in the production stage (양식뱀장어 생산단계 안전성 조사를 위한 베이지안 네트워크 모델의 적용)

  • Seung Yong Cho
    • Food Science and Preservation
    • /
    • v.30 no.3
    • /
    • pp.459-471
    • /
    • 2023
  • The Bayesian network (BN) model was applied to analyze the characteristic variables that affect compliance with safety inspections of farmed eel during the production stage, using the data from 30,063 cases of eel aquafarm safety inspection in the Integrated Food Safety Information Network (IFSIN) from 2012 to 2021. The dataset for establishing the BN model included 77 non-conforming cases. Relevant HACCP data, geographic information about the aquafarms, and environmental data were collected and mapped to the IFSIN data to derive explanatory variables for nonconformity. Aquafarm HACCP certification, detection history of harmful substances during the last 5 y, history of nonconformity during the last 5 y, and the suitability of the aquatic environment as determined by the levels of total coliform bacteria and total organic carbon were selected as the explanatory variables. The highest achievable eel aquafarm noncompliance rate by manipulating the derived explanatory variables was 24.5%, which was 94 times higher than the overall farmed eel noncompliance rate reported in IFSIN between 2017 and 2021. The established BN model was validated using the IFSIN eel aquafarm inspection results conducted between January and August 2022. The noncompliance rate in the validation set was 0.22% (15 nonconformances out of 6,785 cases). The precision of BN model prediction was 0.1579, which was 71.4 times higher than the non-compliance rate of the validation set.