• 제목/요약/키워드: Improved optimizer

검색결과 41건 처리시간 0.023초

대청댐 유입량 예측을 위한 Adaptive Moments와 Improved Harmony Search의 결합을 이용한 다층퍼셉트론 성능향상 (Improvement of multi layer perceptron performance using combination of adaptive moments and improved harmony search for prediction of Daecheong Dam inflow)

  • 이원진;이의훈
    • 한국수자원학회논문집
    • /
    • 제56권1호
    • /
    • pp.63-74
    • /
    • 2023
  • 높은 신뢰도의 댐 유입량 예측은 효율적인 댐 운영을 위해 필요하다. 최근 다층퍼셉트론(Multi Layer Perceptron, MLP)을 활용하여 댐의 유입량을 예측하는 연구들이 진행되었다. 기존 연구들은 MLP의 연산자 중 자료 간의 최적 상관관계를 찾는 optimizer로 경사하강법(Gradient Descent, GD) 기반의 optimizer를 사용하였다. 하지만, GD 기반의 optimizer들은 지역 최적값으로의 수렴 가능성과 저장공간 부재로 인해 예측성능이 저하된다는 단점이 있다. 본 연구는 GD 기반 optimizer 중 Adaptive moments와 Improved Harmony Search (IHS)를 결합한 Adaptive moments combined with Improved Harmony Search (AdamIHS)를 개발하여 GD 기반 optimizer의 단점을 개선하였다. AdamIHS를 사용한 MLP의 학습 및 예측성능을 평가하기 위해 대청댐 유입량을 학습 및 예측하였으며, GD 기반 optimizer를 사용한 MLP의 학습 및 예측성능과 비교하였다. 학습결과를 비교하면, AdamIHS를 사용한 은닉층 5개인 MLP의 Mean Squared Error (MSE) 평균값이 11,577로 가장 낮았다. 예측결과를 비교하면, AdamIHS를 사용한 은닉층 1개인 MLP의 MSE 평균값이 413,262로 가장 낮았다. 본 연구에서 개발된 AdamIHS를 활용하면 다양한 분야에서 향상된 예측성능을 보여줄 수 있을 것이다.

An integrated particle swarm optimizer for optimization of truss structures with discrete variables

  • Mortazavi, Ali;Togan, Vedat;Nuhoglu, Ayhan
    • Structural Engineering and Mechanics
    • /
    • 제61권3호
    • /
    • pp.359-370
    • /
    • 2017
  • This study presents a particle swarm optimization algorithm integrated with weighted particle concept and improved fly-back technique. The rationale behind this integration is to utilize the affirmative properties of these new terms to improve the search capability of the standard particle swarm optimizer. Improved fly-back technique introduced in this study can be a proper alternative for widely used penalty functions to handle existing constraints. This technique emphasizes the role of the weighted particle on escaping from trapping into local optimum(s) by utilizing a recursive procedure. On the other hand, it guaranties the feasibility of the final solution by rejecting infeasible solutions throughout the optimization process. Additionally, in contrast with penalty method, the improved fly-back technique does not contain any adjustable terms, thus it does not inflict any extra ad hoc parameters to the main optimizer algorithm. The improved fly-back approach, as independent unit, can easily be integrated with other optimizers to handle the constraints. Consequently, to evaluate the performance of the proposed method on solving the truss weight minimization problems with discrete variables, several benchmark examples taken from the technical literature are examined using the presented method. The results obtained are comparatively reported through proper graphs and tables. Based on the results acquired in this study, it can be stated that the proposed method (integrated particle swarm optimizer, iPSO) is competitive with other metaheuristic algorithms in solving this class of truss optimization problems.

Illumination correction via improved grey wolf optimizer for regularized random vector functional link network

  • Xiaochun Zhang;Zhiyu Zhou
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제17권3호
    • /
    • pp.816-839
    • /
    • 2023
  • In a random vector functional link (RVFL) network, shortcomings such as local optimal stagnation and decreased convergence performance cause a reduction in the accuracy of illumination correction by only inputting the weights and biases of hidden neurons. In this study, we proposed an improved regularized random vector functional link (RRVFL) network algorithm with an optimized grey wolf optimizer (GWO). Herein, we first proposed the moth-flame optimization (MFO) algorithm to provide a set of excellent initial populations to improve the convergence rate of GWO. Thereafter, the MFO-GWO algorithm simultaneously optimized the input feature, input weight, hidden node and bias of RRVFL, thereby avoiding local optimal stagnation. Finally, the MFO-GWO-RRVFL algorithm was applied to ameliorate the performance of illumination correction of various test images. The experimental results revealed that the MFO-GWO-RRVFL algorithm was stable, compatible, and exhibited a fast convergence rate.

태양광 패널 최적기의 유선 및 무선 통신 시스템 설계에 관한 연구 (A Study on the Design of Wired and Wireless Communication System for Solar Panel Optimizer)

  • 양오
    • 반도체디스플레이기술학회지
    • /
    • 제18권2호
    • /
    • pp.32-37
    • /
    • 2019
  • In this paper, we have designed a solar photovoltaic system to attach solar photovoltaic modules to each module and develop the best efficiency in each module. The efficiency of the designed solar panel optimizer was more than 99.27% and MPPT efficiency of 99.66%. In addition, the monitoring of power generation and abnormal operation phenomenon in each optimum period and tracking for failure location of specific photovoltaic module have improved the utilization rate of photovoltaic power generation. Wired and wireless communication methods has been proposed to monitor the power generation and operation status of the solar panel optimizer. For this purpose, the RS485 communication was used for wire communication and Zigbee communication was used for wireless communication to monitor the status of each module in real time. It is shown that communication redundancy can be achieved through the proposed method, and the possibility of commercialization is suggested.

Novel Optimizer AdamW+ implementation in LSTM Model for DGA Detection

  • Awais Javed;Adnan Rashdi;Imran Rashid;Faisal Amir
    • International Journal of Computer Science & Network Security
    • /
    • 제23권11호
    • /
    • pp.133-141
    • /
    • 2023
  • This work take deeper analysis of Adaptive Moment Estimation (Adam) and Adam with Weight Decay (AdamW) implementation in real world text classification problem (DGA Malware Detection). AdamW is introduced by decoupling weight decay from L2 regularization and implemented as improved optimizer. This work introduces a novel implementation of AdamW variant as AdamW+ by further simplifying weight decay implementation in AdamW. DGA malware detection LSTM models results for Adam, AdamW and AdamW+ are evaluated on various DGA families/ groups as multiclass text classification. Proposed AdamW+ optimizer results has shown improvement in all standard performance metrics over Adam and AdamW. Analysis of outcome has shown that novel optimizer has outperformed both Adam and AdamW text classification based problems.

Energy-Efficient Routing Protocol for Wireless Sensor Networks Based on Improved Grey Wolf Optimizer

  • Zhao, Xiaoqiang;Zhu, Hui;Aleksic, Slavisa;Gao, Qiang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권6호
    • /
    • pp.2644-2657
    • /
    • 2018
  • To utilize the energy of sensor nodes efficiently and extend the network lifetime maximally is one of the primary goals in wireless sensor networks (WSNs). Thus, designing an energy-efficient protocol to optimize the determination of cluster heads (CHs) in WSNs has become increasingly important. In this paper, we propose a novel energy-efficient protocol based on an improved Grey Wolf Optimizer (GWO), which we refer to as Fitness value based Improved GWO (FIGWO). It considers a fitness value to improve the finding of the optimal solution in GWO, which ensures a better distribution of CHs and a more balanced cluster structure. According to the distance to the CHs and the BS, sensor nodes' transmission distance are recalculated to reduce the energy consumption. Simulation results demonstrate that the proposed approach can prolong the stability period of the network in comparison to other algorithms, namely by 31.5% in comparison to SEP, and even by 57.8% when compared with LEACH protocol. The results also show that the proposed protocol performs well over the above comparative protocols in terms of energy consumption and network throughput.

Model-based Predictive Control Approach to Continuous Process based on Iterative Learning Concept

  • Chin, In-Sik;Cho, Moon-Ki;Lee, Jay-H;Lee, Kwang-Soon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2001년도 ICCAS
    • /
    • pp.41.1-41
    • /
    • 2001
  • Since the advanced control technique such as model predictive control has been introduced to industrial plant, there have been many progresses in the process control. As a way to improve the control performance, the on-line process optimizer was integrated with the advance controller. In this study, a control technique which improves the control. As the number of changes by the optimizer is increased, the control performance of the proposed algorithm is improved. Its control performance is shown via an numerical example.

  • PDF

수질 지수 예측성능 향상을 위한 새로운 인공신경망 옵티마이저의 개발 (Development of new artificial neural network optimizer to improve water quality index prediction performance)

  • 류용민;김영남;이대원;이의훈
    • 한국수자원학회논문집
    • /
    • 제57권2호
    • /
    • pp.73-85
    • /
    • 2024
  • 하천과 저수지의 수질을 예측하는 것은 수자원관리를 위해 필요하다. 높은 정확도의 수질 예측을 위해 많은 연구들에서 인공신경망이 활용되었다. 기존 연구들은 매개변수를 탐색하는 인공신경망의 연산자인 옵티마이저로 경사하강법 기반 옵티마이저를 사용하였다. 그러나 경사하강법 기반 옵티마이저는 지역 최적값으로의 수렴 가능성과 해의 저장 및 비교구조가 없다는 단점이 있다. 본 연구에서는 인공신경망을 이용한 수질 예측성능을 향상시키기 위해 개량형 옵티마이저를 개발하여 경사하강법 기반 옵티마이저의 단점을 개선하였다. 본 연구에서 제안한 옵티마이저는 경사하강법 기반 옵티마이저 중 학습오차가 낮은 Adaptive moments (Adam)과 Nesterov-accelerated adaptive moments (Nadam)를 Harmony Search(HS) 또는 Novel Self-adaptive Harmony Search (NSHS)와 결합한 옵티마이저이다. 개량형 옵티마이저의 학습 및 예측성능 평가를 위해 개량형 옵티마이저를 Long Short-Term Memory (LSTM)에 적용하여 국내의 다산 수질관측소의 수질인자인 수온, 용존산소량, 수소이온농도 및 엽록소-a를 학습 및 예측하였다. 학습결과를 비교하면, Nadam combined with NSHS (NadamNSHS)를 사용한 LSTM의 Mean Squared Error (MSE)가 0.002921로 가장 낮았다. 또한, 각 옵티마이저별 4개 수질인자에 대한 MSE 및 R2에 따른 예측순위를 비교하였다. 각 옵티마이저의 평균 순위를 비교하면, NadamNSHS를 사용한 LSTM이 2.25로 가장 높은 것을 확인하였다.

Triangular units based method for simultaneous optimizations of planar trusses

  • Mortazavi, Ali;Togan, Vedat
    • Advances in Computational Design
    • /
    • 제2권3호
    • /
    • pp.195-210
    • /
    • 2017
  • Simultaneous optimization of trusses which concurrently takes into account design variables related to the size, shape and topology of the structure is recognized as highly complex optimization problems. In this class of optimization problems, it is possible to encounter several unstable mechanisms throughout the solution process. However, to obtain a feasible solution, these unstable mechanisms somehow should be rejected from the set of candidate solutions. This study proposes triangular unit based method (TUBM) instead of ground structure method, which is conventionally used in the topology optimization, to decrease the complexity of search space of simultaneous optimization of the planar truss structures. TUBM considers stability of the triangular units for 2 dimensional truss systems. In addition, integrated particle swarm optimizer (iPSO) strengthened with robust technique so called improved fly-back mechanism is employed as the optimizer tool to obtain the solution for these class of problems. The results obtained in this study show the applicability and efficiency of the TUBM combined with iPSO for the simultaneous optimization of planar truss structures.

음영지역 발생으로 인한 태양광 발전손실 최소화를 위한 모듈부착형 전력보상기술에 관한 연구 (A Study on Module-based Power Compensation Technology for Minimizing Solar Power Loss due to Shaded Area)

  • 김영백;송법성
    • 한국전자통신학회논문지
    • /
    • 제13권3호
    • /
    • pp.539-546
    • /
    • 2018
  • 최근 태양광발전시장이 급격히 증가하면서 태양전지 모듈 출력 최소화를 위한 연구에 관심이 집중되고 있다. 태양광 발전에서 부정합이 발생하면 옵티마이저의 역할이 중요하다. 기존의 시스템에서는 중앙 집중형 인버터 방식과 직렬형 마이크로인버터방식을 주로 사용되고 있다. 본 논문에서는 기존의 시스템 구성방식과 부정합으로 인한 발전효율 손실 문제를 분석하였다. 또한 음영으로 인한 부정합이 발생하게 되면 이를 개선할 수 있는 모듈 부착형 전력보상방식을 제안하였다. 제안한 모듈 부착형 옵티마이저를 구현하여 기존의 운영방식과 비교, 분석한 결과 제안한 운영방식의 효율이 크게 향상됨을 확인하였다.