• 제목/요약/키워드: Bayesian network structure learning

검색결과 29건 처리시간 0.024초

무선 센서 네트워크에 기반한 온라인 베이지안 학습 (On-line Bayesian Learning based on Wireless Sensor Network)

  • 이호석
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 2007년도 한국컴퓨터종합학술대회논문집 Vol.34 No.1 (D)
    • /
    • pp.105-108
    • /
    • 2007
  • Bayesian 학습 네트워크는 여러 가지의 다양한 응용 분야에 적용된다. 본 논문은 다양한 무선 센서 네트워크 환경에 적용될 수 있는 온라인 Bayesian 학습 네트워크의 추론 알고리즘 구조에 대하여 논의한다. 첫째, 논문은 Bayesian 파라메타 학습과 Bayesian DAG 구조 학습을 논의하고, 다음에 무선 센서 네트워크의 특징과 무선 환경에서의 데이터 수집에 대하여 논의한다. 둘째, 논문은 온라인 Bayesian 학습 네트워크에서의 중요한 고려 사항과 네트워크 학습 알고리즘의 개념적 구조에 대하여 논의한다.

  • PDF

A Matrix-Based Genetic Algorithm for Structure Learning of Bayesian Networks

  • Ko, Song;Kim, Dae-Won;Kang, Bo-Yeong
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제11권3호
    • /
    • pp.135-142
    • /
    • 2011
  • Unlike using the sequence-based representation for a chromosome in previous genetic algorithms for Bayesian structure learning, we proposed a matrix representation-based genetic algorithm. Since a good chromosome representation helps us to develop efficient genetic operators that maintain a functional link between parents and their offspring, we represent a chromosome as a matrix that is a general and intuitive data structure for a directed acyclic graph(DAG), Bayesian network structure. This matrix-based genetic algorithm enables us to develop genetic operators more efficient for structuring Bayesian network: a probability matrix and a transpose-based mutation operator to inherit a structure with the correct edge direction and enhance the diversity of the offspring. To show the outstanding performance of the proposed method, we analyzed the performance between two well-known genetic algorithms and the proposed method using two Bayesian network scoring measures.

시계열 자료의 예측을 위한 베이지안 순환 신경망에 관한 연구 (A Study on the Bayesian Recurrent Neural Network for Time Series Prediction)

  • 홍찬영;박정훈;윤태성;박진배
    • 제어로봇시스템학회논문지
    • /
    • 제10권12호
    • /
    • pp.1295-1304
    • /
    • 2004
  • In this paper, the Bayesian recurrent neural network is proposed to predict time series data. A neural network predictor requests proper learning strategy to adjust the network weights, and one needs to prepare for non-linear and non-stationary evolution of network weights. The Bayesian neural network in this paper estimates not the single set of weights but the probability distributions of weights. In other words, the weights vector is set as a state vector of state space method, and its probability distributions are estimated in accordance with the particle filtering process. This approach makes it possible to obtain more exact estimation of the weights. In the aspect of network architecture, it is known that the recurrent feedback structure is superior to the feedforward structure for the problem of time series prediction. Therefore, the recurrent neural network with Bayesian inference, what we call Bayesian recurrent neural network (BRNN), is expected to show higher performance than the normal neural network. To verify the proposed method, the time series data are numerically generated and various kinds of neural network predictor are applied on it in order to be compared. As a result, feedback structure and Bayesian learning are better than feedforward structure and backpropagation learning, respectively. Consequently, it is verified that the Bayesian reccurent neural network shows better a prediction result than the common Bayesian neural network.

Bayesian Neural Network with Recurrent Architecture for Time Series Prediction

  • Hong, Chan-Young;Park, Jung-Hun;Yoon, Tae-Sung;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.631-634
    • /
    • 2004
  • In this paper, the Bayesian recurrent neural network (BRNN) is proposed to predict time series data. Among the various traditional prediction methodologies, a neural network method is considered to be more effective in case of non-linear and non-stationary time series data. A neural network predictor requests proper learning strategy to adjust the network weights, and one need to prepare for non-linear and non-stationary evolution of network weights. The Bayesian neural network in this paper estimates not the single set of weights but the probability distributions of weights. In other words, we sets the weight vector as a state vector of state space method, and estimates its probability distributions in accordance with the Bayesian inference. This approach makes it possible to obtain more exact estimation of the weights. Moreover, in the aspect of network architecture, it is known that the recurrent feedback structure is superior to the feedforward structure for the problem of time series prediction. Therefore, the recurrent network with Bayesian inference, what we call BRNN, is expected to show higher performance than the normal neural network. To verify the performance of the proposed method, the time series data are numerically generated and a neural network predictor is applied on it. As a result, BRNN is proved to show better prediction result than common feedforward Bayesian neural network.

  • PDF

R-CORE를 통한 베이지안 망 구조 학습의 탐색 공간 분석 (Search Space Analysis of R-CORE Method for Bayesian Network Structure Learning and Its Effectiveness on Structural Quality)

  • 정성원;이도헌;이광형
    • 한국지능시스템학회논문지
    • /
    • 제18권4호
    • /
    • pp.572-578
    • /
    • 2008
  • 본 논문에서는 대규모 베이지안 망 구조 학습을 위해 제안되었던 R-CORE 방법의 탐색 공간의 크기에 대한 개략적인 분석과 실제 문제에 적용하였을 경우의 효과에 대한 실험적 결과를 제시한다. R-CORE 방법은 베이지안 망 구조 학습의 탐색 공간을 축소하기 위해 제안된 확률변수들의 재귀적 군집화와 오더 제한 방법이다. 알려진 벤치마크 베이지안 망을 이용한 분석을 통해, 제안되었던 R-CORE 방법이 worst case에는 기존의 방법과 유사한 탐색 공간을 가지나 평균적으로 기존방법보다 훨씬 적은 탐색 공간만을 고려한다는 것을 보인다. 또한 평균적으로 훨씬 적은 탐색 공간만을 고려하는 결과, 구조 탐색에서 기존 방법에 비해 상대적으로 적은 overfitting이 일어남을 실험적으로 보인다.

베이지안 네트워크에 기반한 스마트 홈에서의 상황인식 기법개발 (Context-aware application for smart home based on Bayesian network)

  • 정우용;김은태
    • 한국지능시스템학회논문지
    • /
    • 제17권2호
    • /
    • pp.179-184
    • /
    • 2007
  • 본 논문은 스마트 홈에서 베이지안 네트워크에 기반을 둔 보편성을 가지는 상황인식 시스템의 구현방법을 제안한다. 베이지안 네트워크는 각 센서정보를 바탕으로 거주자의 활동 및 스마트 홈의 상황에 대한 추론을 확률적으로 접근하는데 매우 유용한 수단이다. 하지만 센서 정보와 활동정보가 다양해짐에 따라 기존의 방법으로는 베이지만 네트워크를 구성하기가 힘들다. 따라서 본 논문에서는 상호정보를 통하여 보다 효율적으로 베이지안 네트워크를 구성하도록 하며, 시뮬레이션을 통하여 자료 취득하고 그에 따른 거주자의 활동인식의 결과를 보인다.

Context Aware System based on Bayesian Network driven Context Reasoning and Ontology Context Modeling

  • Ko, Kwang-Eun;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제8권4호
    • /
    • pp.254-259
    • /
    • 2008
  • Uncertainty of result of context awareness always exists in any context-awareness computing. This falling-off in accuracy of context awareness result is mostly caused by the imperfectness and incompleteness of sensed data, because of this reasons, we must improve the accuracy of context awareness. In this article, we propose a novel approach to model the uncertain context by using ontology and context reasoning method based on Bayesian Network. Our context aware processing is divided into two parts; context modeling and context reasoning. The context modeling is based on ontology for facilitating knowledge reuse and sharing. The ontology facilitates the share and reuse of information over similar domains of not only the logical knowledge but also the uncertain knowledge. Also the ontology can be used to structure learning for Bayesian network. The context reasoning is based on Bayesian Networks for probabilistic inference to solve the uncertain reasoning in context-aware processing problem in a flexible and adaptive situation.

Protein Secondary Structure Prediction using Multiple Neural Network Likelihood Models

  • Kim, Seong-Gon;Kim, Yong-Gi
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제10권4호
    • /
    • pp.314-318
    • /
    • 2010
  • Predicting Alpha-helicies, Beta-sheets and Turns of a proteins secondary structure is a complex non-linear task that has been approached by several techniques such as Neural Networks, Genetic Algorithms, Decision Trees and other statistical or heuristic methods. This project introduces a new machine learning method by combining Bayesian Inference with offline trained Multilayered Perceptron (MLP) models as the likelihood for secondary structure prediction of proteins. With varying window sizes of neighboring amino acid information, the information is extracted and passed back and forth between the Neural Net and the Bayesian Inference process until the posterior probability of the secondary structure converges.

이산형 자료 예측을 위한 베이지안 네트워크 분류분석기의 성능 비교 (The performance of Bayesian network classifiers for predicting discrete data)

  • 박현재;황범석
    • 응용통계연구
    • /
    • 제33권3호
    • /
    • pp.309-320
    • /
    • 2020
  • 방향성 비순환 그래프(directed acyclic graph; DAG)라고도 하는 베이지안 네트워크(Bayesian network)는 변수 사이의 관계를 확률과 그래프를 통해 모형화할 수 있다는 점에서 최근 의학, 기상학, 유전학 등 여러 분야에서 다양하게 활용되고 있다. 특히 이산형 자료의 예측에 사용되는 베이지안 네트워크 분류분석기(Bayesian network classifier)가 최근 새로운 데이터 마이닝 기법으로 주목받고 있다. 베이지안 네트워크는 그 구조와 학습 방법에 따라 여러 가지 다양한 모형으로 분류할 수 있다. 본 논문에서는 서로 다른 성질을 가진 이산형 자료를 바탕으로 구조 학습 방법에 차이를 두어 베이지안 네트워크 모형을 학습시킨 후, 가장 간단한 방법인 나이브 베이즈 (naïve Bayes) 모형과 비교해 본다. 학습된 모형들을 여러 가지 실제 데이터에 적용하여 그 예측 정확도를 비교함으로써 최적의 분류 분석 결과를 얻을 수 있는지 살펴본다. 또한 각각의 모형에서 나타나는 그래프를 통해 데이터의 변수 사이의 관계를 비교한다.

Multi-Sensor Signal based Situation Recognition with Bayesian Networks

  • Kim, Jin-Pyung;Jang, Gyu-Jin;Jung, Jae-Young;Kim, Moon-Hyun
    • Journal of Electrical Engineering and Technology
    • /
    • 제9권3호
    • /
    • pp.1051-1059
    • /
    • 2014
  • In this paper, we propose an intelligent situation recognition model by collecting and analyzing multiple sensor signals. Multiple sensor signals are collected for fixed time window. A training set of collected sensor data for each situation is provided to K2-learning algorithm to generate Bayesian networks representing causal relationship between sensors for the situation. Statistical characteristics of sensor values and topological characteristics of generated graphs are learned for each situation. A neural network is designed to classify the current situation based on the extracted features from collected multiple sensor values. The proposed method is implemented and tested with UCI machine learning repository data.