• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.4
• /
• pp.319-326
• /
• 2015

Recently in the fields o f stochastic optimal control ( SOC) and reinforcemnet l earning (RL), there have been a great deal of research efforts for the problem of finding data-based sub-optimal control policies. The conventional theory for finding optimal controllers via the value-function-based dynamic programming was established for solving the stochastic optimal control problems with solid theoretical background. However, they can be successfully applied only to extremely simple cases. Hence, the data-based modern approach, which tries to find sub-optimal solutions utilizing relevant data such as the state-transition and reward signals instead of rigorous mathematical analyses, is particularly attractive to practical applications. In this paper, we consider a couple of methods combining the modern SOC strategies and approximate inference together with machine-learning-based data treatment methods. Also, we apply the resultant methods to a variety of application domains including financial engineering, and observe their performance.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.22 no.3
• /
• pp.75-87
• /
• 1980

Most hydro]ogic phenomena are the complex and organic products of multiple causations like climatic and hydro-geological factors. A certain significant correlation on the run-off in river basin would be expected and foreseen in advance, and the effect of each these causual and associated factors (independant variables; present-month rainfall, previous-month run-off, evapotranspiration and relative humidity etc.) upon present-month run-off(dependent variable) may be determined by multiple regression analysis. Functions between independant and dependant variables should be treated repeatedly until satisfactory and optimal combination of independant variables can be obtained. Reliability of the estimated function should be tested according to the result of statistical criterion such as analysis of variance, coefficient of determination and significance-test of regression coefficients before first estimated multiple regression model in historical sequence is determined. But some error between observed and estimated run-off is still there. The error arises because the model used is an inadequate description of the system and because the data constituting the record represent only a sample from a population of monthly discharge observation, so that estimates of model parameter will be subject to sampling errors. Since this error which is a deviation from multiple regression plane cannot be explained by first estimated multiple regression equation, it can be considered as a random error governed by law of chance in nature. This unexplained variance by multiple regression equation can be solved by stochastic approach, that is, random error can be stochastically simulated by multiplying random normal variate to standard error of estimate. Finally hybrid model on estimation of monthly run-off in nonhistorical sequence can be determined by combining the determistic component of multiple regression equation and the stochastic component of random errors. Monthly run-off in Naju station in Yong-San river basin is estimated by multiple regression model and hybrid model. And some comparisons between observed and estimated run-off and between multiple regression model and already-existing estimation methods such as Gajiyama formula, tank model and Thomas-Fiering model are done. The results are as follows. (1) The optimal function to estimate monthly run-off in historical sequence is multiple linear regression equation in overall-month unit, that is; Qn=0.788Pn+0.130Qn-1-0.273En-0.1 About 85% of total variance of monthly runoff can be explained by multiple linear regression equation and its coefficient of determination (R2) is 0.843. This means we can estimate monthly runoff in historical sequence highly significantly with short data of observation by above mentioned equation. (2) The optimal function to estimate monthly runoff in nonhistorical sequence is hybrid model combined with multiple linear regression equation in overall-month unit and stochastic component, that is; Qn=0. 788Pn+0. l30Qn-1-0. 273En-0. 10+Sy.t The rest 15% of unexplained variance of monthly runoff can be explained by addition of stochastic process and a bit more reliable results of statistical characteristics of monthly runoff in non-historical sequence are derived. This estimated monthly runoff in non-historical sequence shows up the extraordinary value (maximum, minimum value) which is not appeared in the observed runoff as a random component. (3) "Frequency best fit coefficient" (R2f) of multiple linear regression equation is 0.847 which is the same value as Gaijyama's one. This implies that multiple linear regression equation and Gajiyama formula are theoretically rather reasonable functions.

• Smart Structures and Systems
• /
• v.20 no.2
• /
• pp.207-217
• /
• 2017

Because of the inevitable uncertainties such as structural parameters, external excitations and measurement noises, the effects of uncertainties should be taken into consideration in structural damage detection. In this paper, two probabilistic structural damage detection approaches are proposed to account for the underlying uncertainties in structural parameters and external excitation. The first approach adopts the statistical moment-based structural damage detection (SMBDD) algorithm together with the sensitivity analysis of the damage vector to the uncertain parameters. The approach takes the advantage of the strength SMBDD, so it is robust to measurement noise. However, it requests the number of measured responses is not less than that of unknown structural parameters. To reduce the number of measurements requested by the SMBDD algorithm, another probabilistic structural damage detection approach is proposed. It is based on the integration of structural damage detection using temporal moments in each time segment of measured response time history with the sensitivity analysis of the damage vector to the uncertain parameters. In both approaches, probability distribution of damage vector is estimated from those of uncertain parameters based on stochastic finite element model updating and probabilistic propagation. By comparing the two probability distribution characteristics for the undamaged and damaged models, probability of damage existence and damage extent at structural element level can be detected. Some numerical examples are used to demonstrate the performances of the two proposed approaches, respectively.

• Smart Structures and Systems
• /
• v.21 no.5
• /
• pp.601-609
• /
• 2018

The estimated probabilistic model of wind data based on the conventional approach may have high discrepancy compared with the true distribution because of the uncertainty caused by the instrument error and limited monitoring data. A sequential quadratic programming (SQP) algorithm-based finite mixture modeling method has been developed in the companion paper and is conducted to formulate the joint probability density function (PDF) of wind speed and direction using the wind monitoring data of the investigated bridge. The established bivariate model of wind speed and direction only represents the features of available wind monitoring data. To characterize the stochastic properties of the wind parameters with the subsequent wind monitoring data, in this study, Bayesian inference approach considering the uncertainty is proposed to update the wind parameters in the bivariate probabilistic model. The slice sampling algorithm of Markov chain Monte Carlo (MCMC) method is applied to establish the multi-dimensional and complex posterior distribution which is analytically intractable. The numerical simulation examples for univariate and bivariate models are carried out to verify the effectiveness of the proposed method. In addition, the proposed Bayesian inference approach is used to update and optimize the parameters in the bivariate model using the wind monitoring data from the investigated bridge. The results indicate that the proposed Bayesian inference approach is feasible and can be employed to predict the bivariate distribution of wind speed and direction with limited monitoring data.

• Journal of Korea Water Resources Association
• /
• v.57 no.5
• /
• pp.347-357
• /
• 2024

Numerous prior studies have delineated the size distribution of noncohesive sediment in suspension, focusing on mean size and standard deviation. However, suspensions comprise a heterogeneous mixture of sediment particles of varying sizes. The transport dynamics of suspended sediment in turbulent flow are intimately tied to settling velocities calculated based on size and density. Consequently, understanding the grain size distribution becomes paramount in comprehending sediment transport phenomena for noncohesive sediment. This study aims to introduce a straightforward modeling approach for simulating the grain size distribution of suspended sediment amidst turbulence. Leveraging insights into the contrast between cohesive and noncohesive sediment, we have meticulously revised a stochastic flocculation model originally designed for cohesive sediment to aptly simulate the grain size distribution of noncohesive sediment in suspension. The efficacy of our approach is corroborated through a meticulous comparison between experimental data and the grain size distribution simulated by our newly proposed model. Through numerical simulations, we unveil that the modulation of grain size distribution of suspended sediment is contingent upon the sediment transport capacity of the carrier fluid. Hence, we deduce that our simplified approach to simulating the grain size distribution of suspended sediment, integrated with a sediment transport model, serves as a robust framework for elucidating the pivotal bulk properties of sediment transport.

• Journal of the Korean Data and Information Science Society
• /
• v.28 no.5
• /
• pp.1125-1132
• /
• 2017

In a situation where the severity and frequency of drought events getting stronger and higher, many studies related to drought forecast have been conducted to improve the drought forecast accuracy. However it is difficult to predict drought events using a single model because of nonlinear and complicated characteristics of temporal behavior of drought events. In this study, in order to overcome the shortcomings of the single model approach, we first build various single models capable to explain the relationship between the meteorological drought index, Standardized Precipitation Index (SPI), and other independent variables such as world climate indices. Then, we developed a combined models using Stochastic Gradient Descent method among Ensemble Learnings.

• Journal of the Korean Society of Groundwater Environment
• /
• v.1 no.2
• /
• pp.90-99
• /
• 1994

Heterogeneous hydraulic conductivity in a flow domain is generated under the assumption that it is a random variable with a lognormal, spatially-correlated distribution. The hydraulic head and the conductivity in a groundwater flow system are represented as a stochastic process. The method of Monte Carlo Simulation (MCS) and the finite element method (FEM) are used to determine the statistics of the head and the logconductivity. The second moments of the head and the logconductivity indicate that the cross-covariance of the logconductivity with the head has characteristic distribution patterns depending on the properties of sources, boundary conditions, head gradients, and correlation scales. The negative cross-correlation outlines a weak-response zone where the flow system is weakly responding to a stress change in the flow domain. The stochastic approach has a potential to quantitatively delineate the zone of influence through computations of the cross-covariance distribution.

• Journal of Korea Multimedia Society
• /
• v.6 no.7
• /
• pp.1149-1158
• /
• 2003

Content adaptive watermark embedding algorithm using a stochastic image model in the multiwavelet transform is proposed in this paper. A watermark is embedded into the perceptually significant coefficients (PSCs) of each subband using multiwavelet transform. The PSCs in high frequency subband are selected by SSQ, that is, by setting the thresholds as the one half of the largest coefficient in each subband. The perceptual model is applied with a stochastic approach based on noise visibility function (NVF) that has local image properties for watermark embedding. This model uses stationary Generalized Gaussian model characteristic because watermark has noise properties. The watermark estimation use shape parameter and variance of subband region. it is derive content adaptive criteria according to edge and texture, and flat region. The experiment results of the proposed watermark embedding method based on multiwavelet transform techniques were found to be excellent invisibility and robustness.

• Communications of the Korean Mathematical Society
• /
• v.25 no.1
• /
• pp.119-128
• /
• 2010

Let ${X_n,\;n\geq1}$ be a sequence of independent identically distributed (i.i.d.) random variables (r.vs.), defined on a probability space ($\Omega$,A,P), and let ${N_n,\;n\geq1}$ be a sequence of positive integer-valued r.vs., defined on the same probability space ($\Omega$,A,P). Furthermore, we assume that the r.vs. $N_n$, $n\geq1$ are independent of all r.vs. $X_n$, $n\geq1$. In present paper we are interested in asymptotic behaviors of the random sum $S_{N_n}=X_1+X_2+\cdots+X_{N_n}$, $S_0=0$, where the r.vs. $N_n$, $n\geq1$ obey some defined probability laws. Since the appearance of the Robbins's results in 1948 ([8]), the random sums $S_{N_n}$ have been investigated in the theory probability and stochastic processes for quite some time (see [1], [4], [2], [3], [5]). Recently, the random sum approach is used in some applied problems of stochastic processes, stochastic modeling, random walk, queue theory, theory of network or theory of estimation (see [10], [12]). The main aim of this paper is to establish some results related to the asymptotic behaviors of the random sum $S_{N_n}$, in cases when the $N_n$, $n\geq1$ are assumed to follow concrete probability laws as Poisson, Bernoulli, binomial or geometry.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.24 no.4
• /
• pp.95-102
• /
• 2010

As the electric power industry is evolving into competitive market scheme, a new paradigm is required for the operation of market. Traditional dispatch algorithm was built based on the optimization model with an objective function and multiple constraints. Commercial market simulator followed the concept of the microeconomic model used in the dispatch algorithm, which is called as analytic method. On analytic method it is prerequisite to procure the exact data for the simulation. It is not easy anymore for each market participant to access to other participants' financial information while it used to be easy for monopoly decision maker to know all the information needed for the optimal operation. Considering the changing situation, it is required to introduce a new method for estimating the market price. This paper proposes an empirical method based on stochastic processes expected to build a capacity planning and long term contracts.