• Title/Summary/Keyword: Markov model

Search Result 1,626, Processing Time 0.03 seconds

Sensitivity of Conditions for Lumping Finite Markov Chains

  • Suh, Moon-Taek
    • Journal of the military operations research society of Korea
    • /
    • v.11 no.1
    • /
    • pp.111-129
    • /
    • 1985
  • Markov chains with large transition probability matrices occur in many applications such as manpowr models. Under certain conditions the state space of a stationary discrete parameter finite Markov chain may be partitioned into subsets, each of which may be treated as a single state of a smaller chain that retains the Markov property. Such a chain is said to be 'lumpable' and the resulting lumped chain is a special case of more general functions of Markov chains. There are several reasons why one might wish to lump. First, there may be analytical benefits, including relative simplicity of the reduced model and development of a new model which inherits known or assumed strong properties of the original model (the Markov property). Second, there may be statistical benefits, such as increased robustness of the smaller chain as well as improved estimates of transition probabilities. Finally, the identification of lumps may provide new insights about the process under investigation.

  • PDF

A study on Classification of Insider threat using Markov Chain Model

  • Kim, Dong-Wook;Hong, Sung-Sam;Han, Myung-Mook
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.4
    • /
    • pp.1887-1898
    • /
    • 2018
  • In this paper, a method to classify insider threat activity is introduced. The internal threats help detecting anomalous activity in the procedure performed by the user in an organization. When an anomalous value deviating from the overall behavior is displayed, we consider it as an inside threat for classification as an inside intimidator. To solve the situation, Markov Chain Model is employed. The Markov Chain Model shows the next state value through an arbitrary variable affected by the previous event. Similarly, the current activity can also be predicted based on the previous activity for the insider threat activity. A method was studied where the change items for such state are defined by a transition probability, and classified as detection of anomaly of the inside threat through values for a probability variable. We use the properties of the Markov chains to list the behavior of the user over time and to classify which state they belong to. Sequential data sets were generated according to the influence of n occurrences of Markov attribute and classified by machine learning algorithm. In the experiment, only 15% of the Cert: insider threat dataset was applied, and the result was 97% accuracy except for NaiveBayes. As a result of our research, it was confirmed that the Markov Chain Model can classify insider threats and can be fully utilized for user behavior classification.

Weighted Markov Model for Recommending Personalized Broadcasting Contents (개인화된 방송 컨텐츠 추천을 위한 가중치 적용 Markov 모델)

  • Park, Sung-Joon;Hong, Jong-Kyu;Kang, Sang-Gil;Kim, Young-Kuk
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.12 no.5
    • /
    • pp.326-338
    • /
    • 2006
  • In this paper, we propose the weighted Markov model for recommending the users' prefered contents in the environment with considering the users' transition of their content consumption mind according to the kind of contents providing in time. In general, TV viewers have an intention to consume again the preferred contents consumed in recent by them. In order to take into the consideration, we modify the preference transition matrix by providing weights to the consecutively consumed contents for recommending the users' preferred contents. We applied the proposed model to the recommendation of TV viewer's genre preference. The experimental result shows that our method is more efficient than the typical methods.

A Markov Chain Representation of Statistical Process Monitoring Procedure under an ARIMA(0,1,1) Model (ARIMA(0,1,1)모형에서 통계적 공정탐색절차의 MARKOV연쇄 표현)

  • 박창순
    • The Korean Journal of Applied Statistics
    • /
    • v.16 no.1
    • /
    • pp.71-85
    • /
    • 2003
  • In the economic design of the process control procedure, where quality is measured at certain time intervals, its properties are difficult to derive due to the discreteness of the measurement intervals. In this paper a Markov chain representation of the process monitoring procedure is developed and used to derive its properties when the process follows an ARIMA(0,1,1) model, which is designed to describe the effect of the noise and the special cause in the process cycle. The properties of the Markov chain depend on the transition matrix, which is determined by the control procedure and the process distribution. The derived representation of the Markov chain can be adapted to most different types of control procedures and different kinds of process distributions by obtaining the corresponding transition matrix.

A Probabilistic Tracking Mechanism for Luxury Purchase Implemented by Hidden Markov Model, Bayesian Inference, Customer Satisfaction and Net Promoter Score (고객만족, NPS, Bayesian Inference 및 Hidden Markov Model로 구현하는 명품구매에 관한 확률적 추적 메카니즘)

  • Hwang, Sun Ju;Rhee, Jung Soo
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.23 no.6
    • /
    • pp.79-94
    • /
    • 2018
  • The purpose of this study is to specify a probabilistic tracking mechanism for customer luxury purchase implemented by hidden Markov model, Bayesian inference, customer satisfaction and net promoter score. In this paper, we have designed a probabilistic model based on customer's actual data containing purchase or non-purchase states by tracking the SPC chain : customer satisfaction -> customer referral -> purchase/non-purchase. By applying hidden Markov model and Viterbi algorithm to marketing theory, we have developed the statistical model related to probability theories and have found the best purchase pattern scenario from customer's purchase records.

Derivation of Intensity-Duration-Frequency and Flood Frequency Curve by Simulation of Hourly Precipitation using Nonhomogeneous Markov Chain Model (비동질성 Markov 모형의 시간강수량 모의 발생을 이용한 IDF 곡선 및 홍수빈도곡선의 유도)

  • Choi, Byung-Kyu;Oh, Tae-Suk;Park, Rae-Gun;Moon, Young-Il
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.3
    • /
    • pp.251-264
    • /
    • 2008
  • In this study, a nonhomogeneous markov model which is able to simulate hourly rainfall series is developed for estimating reliable hydrologic variables. The proposed approach is applied to simulate hourly rainfall series in Korea. The simulated rainfall is used to estimate the design rainfall and flood in the watershed, and compared to observations in terms of reproducing underlying distributions of the data to assure model's validation. The model shows that the simulated rainfall series reproduce a similar statistical attribute with observations, and expecially maximum value is gradually increased as number of simulation increase. Therefore, with the proposed approach, the non-homogeneous markov model can be used to estimate variables for the purpose of design of hydraulic structures and analyze uncertainties associated with rainfall input in the hydrologic models.

Image analysis using a markov random field and TMS320C80(MVP) (TMS320C80(MVP)과 markov random field를 이용한 영상해석)

  • 백경석;정진현
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.1722-1725
    • /
    • 1997
  • This paper presents image analysis method using a Markov random field(MRF) model. Particulary, image esgmentation is to partition the given image into regions. This scheme is first segmented into regions, and the obtained domain knowledge is used to obtain the improved segmented image by a Markov random field model. The method is a maximum a posteriori(MAP) estimation with the MRF model and its associated Gibbs distribution. MAP estimation method is applied to capture the natural image by TMS320C80(MVP) and to realize the segmented image by a MRF model.

  • PDF

A Probabilistic Analysis for Fatigue Cumulative Damage and Fatigue Life in CFRP Composites Containing a Circular Hole (원공을 가진 CFRP 복합재료의 피로누적손상 및 피로수명에 대한 확률적 해석)

  • 김정규;김도식
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.19 no.8
    • /
    • pp.1915-1926
    • /
    • 1995
  • The Fatigue characteristics of 8-harness satin woven CFRP composites with a circular hole are experimentally investigated under constant amplitude tension-tension loading. It is found in this study that the fatigue damage accumulation behavior is very random and history-independent, and the fatigue cumulative damage is linearly related with the mean number of cycles to a specified damage state. From these results, it is known that the fatigue characteristics of CFRP composites satisfy the basic assumptions of Markov chain theory and the parameter of Markov chain model can be determined only by mean and variance of fatigue lives. The predicted distribution of the fatigue cumulative damage using Markov chain model shows a good agreement with the test results. For the fatigue life distribution, Markov chain model makes similar accuracy to 2-parameter Weibull distribution function.

A Study on the Fatigue Reliability of Structures by Markov Chain Model (Markov Chain Model을 이용한 구조물의 피로 신뢰성 해석에 관한 연구)

  • Y.S. Yang;J.H. Yoon
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.28 no.2
    • /
    • pp.228-240
    • /
    • 1991
  • Many experimental data of fatigue crack propagation show that the fatigue crack propagation process is stochastic. Therefore, the study on the crack propagation must be based on the probabilistic approach. In the present paper, fatigue crack propagation process is assumed to be a discrete Markov process and the method is developed, which can evaluate the reliability of the structural component by using Markov chain model(Unit step B-model) suggested by Bogdanoff. In this method, leak failure, plastic collapse and brittle fracture of the critical component are taken as failure modes, and the effects of initial crack distribution, periodic and non-periodic inspection on the probability of failure are considered. In this method, an equivalent load value for random loading such as wave load is used to facilitate the analysis. Finally some calculations are carried out in order to show the usefulness and the applicability of this method. And then some remarks on this method are mentioned.

  • PDF

Performance Analysis of Channel Error Probability using Markov Model for SCTP Protocol

  • Shinn, Byung-Cheol;Feng, Bai;Khongorzul, Dashdondov
    • Journal of information and communication convergence engineering
    • /
    • v.6 no.2
    • /
    • pp.134-139
    • /
    • 2008
  • In this paper, we propose an analysis model for the performance of channel error probability in Stream Control Transmission Protocol (SCTP) using Markov model. In this model it is assumed that the compressor and decompressor work in Unidirectional Mode. And the average throughput of SCTP protocol is obtained by finding the throughputs of when the initial channel state is good or bad.