• Title/Summary/Keyword: Bayesian Optimization

Search Result 99, Processing Time 0.026 seconds

Development of benthic macroinvertebrate species distribution models using the Bayesian optimization (베이지안 최적화를 통한 저서성 대형무척추동물 종분포모델 개발)

  • Go, ByeongGeon;Shin, Jihoon;Cha, Yoonkyung
    • Journal of Korean Society of Water and Wastewater
    • /
    • v.35 no.4
    • /
    • pp.259-275
    • /
    • 2021
  • This study explored the usefulness and implications of the Bayesian hyperparameter optimization in developing species distribution models (SDMs). A variety of machine learning (ML) algorithms, namely, support vector machine (SVM), random forest (RF), boosted regression tree (BRT), XGBoost (XGB), and Multilayer perceptron (MLP) were used for predicting the occurrence of four benthic macroinvertebrate species. The Bayesian optimization method successfully tuned model hyperparameters, with all ML models resulting an area under the curve (AUC) > 0.7. Also, hyperparameter search ranges that generally clustered around the optimal values suggest the efficiency of the Bayesian optimization in finding optimal sets of hyperparameters. Tree based ensemble algorithms (BRT, RF, and XGB) tended to show higher performances than SVM and MLP. Important hyperparameters and optimal values differed by species and ML model, indicating the necessity of hyperparameter tuning for improving individual model performances. The optimization results demonstrate that for all macroinvertebrate species SVM and RF required fewer numbers of trials until obtaining optimal hyperparameter sets, leading to reduced computational cost compared to other ML algorithms. The results of this study suggest that the Bayesian optimization is an efficient method for hyperparameter optimization of machine learning algorithms.

Bayesian Optimization Analysis of Containment-Venting Operation in a Boiling Water Reactor Severe Accident

  • Zheng, Xiaoyu;Ishikawa, Jun;Sugiyama, Tomoyuki;Maruyama, Yu
    • Nuclear Engineering and Technology
    • /
    • v.49 no.2
    • /
    • pp.434-441
    • /
    • 2017
  • Containment venting is one of several essential measures to protect the integrity of the final barrier of a nuclear reactor during severe accidents, by which the uncontrollable release of fission products can be avoided. The authors seek to develop an optimization approach to venting operations, from a simulation-based perspective, using an integrated severe accident code, THALES2/KICHE. The effectiveness of the containment-venting strategies needs to be verified via numerical simulations based on various settings of the venting conditions. The number of iterations, however, needs to be controlled to avoid cumbersome computational burden of integrated codes. Bayesian optimization is an efficient global optimization approach. By using a Gaussian process regression, a surrogate model of the "black-box" code is constructed. It can be updated simultaneously whenever new simulation results are acquired. With predictions via the surrogate model, upcoming locations of the most probable optimum can be revealed. The sampling procedure is adaptive. Compared with the case of pure random searches, the number of code queries is largely reduced for the optimum finding. One typical severe accident scenario of a boiling water reactor is chosen as an example. The research demonstrates the applicability of the Bayesian optimization approach to the design and establishment of containment-venting strategies during severe accidents.

FEM-based Bayesian Optimization of Electromagnet Configuration for Enhancing Microrobot Actuation (마이크로 로봇 작동 성능 향상을 위한 FEM 기반의 전자석 배치 베이지안 최적화)

  • Hyeokjin Kweon;Donghoon Son
    • The Journal of Korea Robotics Society
    • /
    • v.19 no.1
    • /
    • pp.45-52
    • /
    • 2024
  • This paper introduces an approach to enhance the performance of magnetic manipulation systems for microrobot actuation. A variety of eight-electromagnet configurations have been proposed to date. The previous study revealed that achieving 5 degrees of freedom (5-DOF) control necessitates at least eight electromagnets without encountering workspace singularities. But so far, the research considering the influence of iron cores embedded in electromagnets has not been conducted. This paper offers a novel approach to optimizing electromagnet configurations that effectively consider the influence of iron cores. The proposed methodology integrates probabilistic optimization with finite element methods (FEM), using Bayesian Optimization (BO). The Bayesian optimization aims to optimize the worst-case magnetic force generation for enhancing the performance of magnetic manipulation system. The proposed simulation-based model achieves approximately 20% improvement compared to previous systems in terms of actuation performance. This study has the potential for enhancing magnetic manipulation systems for microrobot control, particularly in medical and microscale technology applications.

A numerical application of Bayesian optimization to the condition assessment of bridge hangers

  • X.W. Ye;Y. Ding;P.H. Ni
    • Smart Structures and Systems
    • /
    • v.31 no.1
    • /
    • pp.57-68
    • /
    • 2023
  • Bridge hangers, such as those in suspension and cable-stayed bridges, suffer from cumulative fatigue damage caused by dynamic loads (e.g., cyclic traffic and wind loads) in their service condition. Thus, the identification of damage to hangers is important in preserving the service life of the bridge structure. This study develops a new method for condition assessment of bridge hangers. The tension force of the bridge and the damages in the element level can be identified using the Bayesian optimization method. To improve the number of observed data, the additional mass method is combined the Bayesian optimization method. Numerical studies are presented to verify the accuracy and efficiency of the proposed method. The influence of different acquisition functions, which include expected improvement (EI), probability-of-improvement (PI), lower confidence bound (LCB), and expected improvement per second (EIPC), on the identification of damage to the bridge hanger is studied. Results show that the errors identified by the EI acquisition function are smaller than those identified by the other acquisition functions. The identification of the damage to the bridge hanger with various types of boundary conditions and different levels of measurement noise are also studied. Results show that both the severity of the damage and the tension force can be identified via the proposed method, thereby verifying the robustness of the proposed method. Compared to the genetic algorithm (GA), particle swarm optimization (PSO), and nonlinear least-square method (NLS), the Bayesian optimization (BO) performs best in identifying the structural damage and tension force.

Time Reduction for Package Warpage Optimization based on Deep Neural Network and Bayesian Optimization (심층신경망 및 베이지안 최적화 기반 패키지 휨 최적화 시간 단축)

  • Jungeon Lee;Daeil Kwon
    • Journal of the Microelectronics and Packaging Society
    • /
    • v.31 no.3
    • /
    • pp.50-57
    • /
    • 2024
  • Recently, applying a machine learning to surrogate modeling for rapid optimization of complex designs have been widely researched. Once trained, the machine learning surrogate model can predict similar outputs to Finite Element Analysis (FEA) simulations but require significantly less computing resources. In addition, combined with optimization methodologies, it can identify optimal design variable with less time requirement compared to iterative simulation. This study proposes a Deep Neural Network (DNN) model with Bayesian Optimization (BO) approach for efficiently searching the optimal design variables to minimize the warpage of electronic package. The DNN model was trained by using design variable-warpage dataset from FEA simulation, and the Bayesian optimization was applied to find the optimal design variables which minimizing the warpage. The suggested DNN + BO model shows over 99% consistency compared to actual simulation results, while only require 15 second to identify optimal design variable, which reducing the optimization time by more than 57% compared to FEA simulation.

A hierarchical Bayesian model for spatial scaling method: Application to streamflow in the Great Lakes basin

  • Ahn, Kuk-Hyun
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2018.05a
    • /
    • pp.176-176
    • /
    • 2018
  • This study presents a regional, probabilistic framework for estimating streamflow via spatial scaling in the Great Lakes basin, which is the largest lake system in the world. The framework follows a two-fold strategy including (1) a quadratic-programming based optimization model a priori to explore the model structure, and (2) a time-varying hierarchical Bayesian model based on insights found in the optimization model. The proposed model is developed to explore three innovations in hierarchical modeling for reconstructing historical streamflow at ungaged sites: (1) information of physical characteristics is utilized in spatial scaling, (2) a time-varying approach is introduced based on climate information, and (3) heteroscedasticity in residual errors is considered to improve streamflow predictive distributions. The proposed model is developed and calibrated in a hierarchical Bayesian framework to pool regional information across sites and enhance regionalization skill. The model is validated in a cross-validation framework along with four simpler nested formulations and the optimization model to confirm specific hypotheses embedded in the full model structure. The nested models assume a similar hierarchical Bayesian structure to our proposed model with their own set of simplifications and omissions. Results suggest that each of three innovations improve historical out-of-sample streamflow reconstructions although these improvements vary corrsponding to each innovation. Finally, we conclude with a discussion of possible model improvements considered by additional model structure and covariates.

  • PDF

Real-time ECG Data Bayesian Optimization Analysis for Rehabilitation Robots (재활 로봇을 위한 심전도(ECG) 실시간 데이터 베이지안 최적화 분석 기술)

  • Choi, Jin-Tak;Kang, Kyung-Tae
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.07a
    • /
    • pp.53-56
    • /
    • 2022
  • 본 논문에서는 심전도(ECG) 센서와 에지 컴퓨팅(Edge computing)을 활용하여 실시간 데이터와 Bayesian optimization을 통한 기계학습 알고리즘으로 재활 로봇에서 발목을 제어할 수 있는 Parameter(외골격 관련) 최적값을 출력한다. 심전도 센서 적용을 기반으로 하는 바이오 데이터 기술, 기계 학습(Bayesian optimization) 모델 접근 방식과 하드웨어 결합으로 재활 로봇 모터를 제어할 수 있는 Parameter 제공과 실시간 모터 제어 운영할 수 있도록 분석 플랫폼을 구축한다. 이 플랫폼을 이용해보다 효과적인 이동형 로봇설계 및 처리 방법을 연결할 수 있는 발판을 마련하였고, 로봇제어에 많이 사용하고 있는 매트랩 시뮬링크(Matlab simulink)를 연결할 수 있는 범용 통신 지원한다. 센서-전처리-인공지능 알고리즘-모터 제어 Parameter로 연계되는 데이터 가공과 처리 방법으로 최근 분석 기법을 적용하여 바이오 데이터 연구 활동과 이동형 재활 로봇 관련 데이터 분석 분야를 쉽게 접근할 수 있도록 한다.

  • PDF

Uncertainty Assessment of Single Event Rainfall-Runoff Model Using Bayesian Model (Bayesian 모형을 이용한 단일사상 강우-유출 모형의 불확실성 분석)

  • Kwon, Hyun-Han;Kim, Jang-Gyeong;Lee, Jong-Seok;Na, Bong-Kil
    • Journal of Korea Water Resources Association
    • /
    • v.45 no.5
    • /
    • pp.505-516
    • /
    • 2012
  • The study applies a hydrologic simulation model, HEC-1 developed by Hydrologic Engineering Center to Daecheong dam watershed for modeling hourly inflows of Daecheong dam. Although the HEC-1 model provides an automatic optimization technique for some of the parameters, the built-in optimization model is not sufficient in estimating reliable parameters. In particular, the optimization model often fails to estimate the parameters when a large number of parameters exist. In this regard, a main objective of this study is to develop Bayesian Markov Chain Monte Carlo simulation based HEC-1 model (BHEC-1). The Clark IUH method for transformation of precipitation excess to runoff and the soil conservation service runoff curve method for abstractions were used in Bayesian Monte Carlo simulation. Simulations of runoff at the Daecheong station in the HEC-1 model under Bayesian optimization scheme allow the posterior probability distributions of the hydrograph thus providing uncertainties in rainfall-runoff process. The proposed model showed a powerful performance in terms of estimating model parameters and deriving full uncertainties so that the model can be applied to various hydrologic problems such as frequency curve derivation, dam risk analysis and climate change study.

Structure Learning in Bayesian Networks Using Asexual Reproduction Optimization

  • Khanteymoori, Ali Reza;Menhaj, Mohammad Bagher;Homayounpour, Mohammad Mehdi
    • ETRI Journal
    • /
    • v.33 no.1
    • /
    • pp.39-49
    • /
    • 2011
  • A new structure learning approach for Bayesian networks based on asexual reproduction optimization (ARO) is proposed in this paper. ARO can be considered an evolutionary-based algorithm that mathematically models the budding mechanism of asexual reproduction. In ARO, a parent produces a bud through a reproduction operator; thereafter, the parent and its bud compete to survive according to a performance index obtained from the underlying objective function of the optimization problem: This leads to the fitter individual. The convergence measure of ARO is analyzed. The proposed method is applied to real-world and benchmark applications, while its effectiveness is demonstrated through computer simulations. Results of simulations show that ARO outperforms genetic algorithm (GA) because ARO results in a good structure and fast convergence rate in comparison with GA.

Online Sonobuoy Deployment Method with Bayesian Optimization for Estimating Location of Submarines (잠수함 위치 추정을 위한 베이지안 최적화 기반의 온라인 소노부이 배치 기법)

  • Kim, Dooyoung
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.25 no.1
    • /
    • pp.72-81
    • /
    • 2022
  • Maritime patrol aircraft is an efficient solution for detecting submarines at sea. The aircraft can only detect submarines by sonobuoy, but the number of buoy is limited. In this paper, we present the online sonobuoy deployment method for estimating the location of submarines. We use Gaussian process regression to estimate the submarine existence probability map, and Bayesian optimization to decide the next best position of sonobuoy. Further, we show the performance of the proposed method by simulation.