• Title/Summary/Keyword: Gradient Descent Learning

Search Result 153, Processing Time 0.025 seconds

A ESLF-LEATNING FUZZY CONTROLLER WITH A FUZZY APPROXIMATION OF INVERSE MODELING

  • Seo, Y.R.;Chung, C.H.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1994.10a
    • /
    • pp.243-246
    • /
    • 1994
  • In this paper, a self-learning fuzzy controller is designed with a fuzzy approximation of an inverse model. The aim of an identification is to find an input command which is control of a system output. It is intuitional and easy to use a classical adaptive inverse modeling method for the identification, but it is difficult and complex to implement it. This problem can be solved with a fuzzy approximation of an inverse modeling. The fuzzy logic effectively represents the complex phenomena of the real world. Also fuzzy system could be represented by the neural network that is useful for a learning structure. The rule of a fuzzy inverse model is modified by the gradient descent method. The goal is to be obtained that makes the design of fuzzy controller less complex, and then this self-learning fuzz controller can be used for nonlinear dynamic system. We have applied this scheme to a nonlinear Ball and Beam system.

  • PDF

Goal Regulation Mechanism through Reinforcement Learning in a Fractal Manufacturing System (FrMS) (프랙탈 생산시스템에서의 강화학습을 통한 골 보정 방법)

  • Sin Mun-Su;Jeong Mu-Yeong
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2006.05a
    • /
    • pp.1235-1239
    • /
    • 2006
  • Fractal manufacturing system (FrMS) distinguishes itself from other manufacturing systems by the fact that there is a fractal repeated at every scale. A fractal is a volatile organization which consists of goal-oriented agents referred to as AIR-units (autonomous and intelligent resource units). AIR-units unrestrictedly reconfigure fractals in accordance with their own goals. Their goals can be dynamically changed along with the environmental status. Since goals of AIR-units are represented as fuzzy models, an AIR-unit itself is a fuzzy logic controller. This paper presents a goal regulation mechanism in the FrMS. In particular, a reinforcement learning method is adopted as a regulating mechanism of the fuzzy goal model, which uses only weak reinforcement signal. Goal regulation is achieved by building a feedforward neural network to estimate compatibility level of current goals, which can then adaptively improve compatibility by using the gradient descent method. Goal-oriented features of AIR-units are also presented.

  • PDF

Fuzzy Gain Scheduling of Velocity PI Controller with Intelligent Learning Algorithm for Reactor Control

  • Kim, Dong-Yun;Seong, Poong-Hyun
    • Proceedings of the Korean Nuclear Society Conference
    • /
    • 1996.11a
    • /
    • pp.73-78
    • /
    • 1996
  • In this study, we proposed a fuzzy gain scheduler with intelligent learning algorithm for a reactor control. In the proposed algorithm, we used the gradient descent method to learn the rule bases of a fuzzy algorithm. These rule bases are learned toward minimizing an objective function, which is called a performance cost function. The objective of fuzzy gain scheduler with intelligent learning algorithm is the generation of adequate gains, which minimize the error of system. The condition of every plant is generally changed as time gose. That is, the initial gains obtained through the analysis of system are no longer suitable for the changed plant. And we need to set new gains, which minimize the error stemmed from changing the condition of a plant. In this paper, we applied this strategy for reactor control of nuclear power plant (NPP), and the results were compared with those of a simple PI controller, which has fixed gains. As a result, it was shown that the proposed algorithm was superior to the simple PI controller.

  • PDF

Wavelet Neural Network Controller for AQM in a TCP Network: Adaptive Learning Rates Approach

  • Kim, Jae-Man;Park, Jin-Bae;Choi, Yoon-Ho
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.4
    • /
    • pp.526-533
    • /
    • 2008
  • We propose a wavelet neural network (WNN) control method for active queue management (AQM) in an end-to-end TCP network, which is trained by adaptive learning rates (ALRs). In the TCP network, AQM is important to regulate the queue length by passing or dropping the packets at the intermediate routers. RED, PI, and PID algorithms have been used for AQM. But these algorithms show weaknesses in the detection and control of congestion under dynamically changing network situations. In our method, the WNN controller using ALRs is designed to overcome these problems. It adaptively controls the dropping probability of the packets and is trained by gradient-descent algorithm. We apply Lyapunov theorem to verify the stability of the WNN controller using ALRs. Simulations are carried out to demonstrate the effectiveness of the proposed method.

Fraud Detection in E-Commerce

  • Alqethami, Sara;Almutanni, Badriah;AlGhamdi, Manal
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.200-206
    • /
    • 2021
  • Fraud in e-commerce transaction increased in the last decade especially with the increasing number of online stores and the lockdown that forced more people to pay for services and groceries online using their credit card. Several machine learning methods were proposed to detect fraudulent transaction. Neural networks showed promising results, but it has some few drawbacks that can be overcome using optimization methods. There are two categories of learning optimization methods, first-order methods which utilizes gradient information to construct the next training iteration whereas, and second-order methods which derivatives use Hessian to calculate the iteration based on the optimization trajectory. There also some training refinements procedures that aims to potentially enhance the original accuracy while possibly reduce the model size. This paper investigate the performance of several NN models in detecting fraud in e-commerce transaction. The backpropagation model which is classified as first learning algorithm achieved the best accuracy 96% among all the models.

Prarmeter Tuning of Fuzzy Cotroller using Neural Networks System Identifier (신경회로망 시스템 식별기를 이용한 퍼지제어기의 변수동조)

  • 이우영;최흥문
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.6 no.3
    • /
    • pp.40-50
    • /
    • 1996
  • By using the neural networks(NN) as system identifier, the on-line self tuning method for fuzzy controller(FC) is proposed. In theis method, the learning of NN is carried out during control operation of FC and the cinsequent parameters of FC is tuned on-line automatically by means of system output errors backpropagated through NN. The Sugeno fuzzy model with constants as consequent parameters is selected for simplifying computation. In procedures of parameter tuning, the gradient descent method is used and the gradient vectors for adjusting the weight of NN are transferred as controller output errors. To evaluate the performance, the proposed method is applied to the inverted pendulum system.

  • PDF

A Hybrid Multi-Level Feature Selection Framework for prediction of Chronic Disease

  • G.S. Raghavendra;Shanthi Mahesh;M.V.P. Chandrasekhara Rao
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.12
    • /
    • pp.101-106
    • /
    • 2023
  • Chronic illnesses are among the most common serious problems affecting human health. Early diagnosis of chronic diseases can assist to avoid or mitigate their consequences, potentially decreasing mortality rates. Using machine learning algorithms to identify risk factors is an exciting strategy. The issue with existing feature selection approaches is that each method provides a distinct set of properties that affect model correctness, and present methods cannot perform well on huge multidimensional datasets. We would like to introduce a novel model that contains a feature selection approach that selects optimal characteristics from big multidimensional data sets to provide reliable predictions of chronic illnesses without sacrificing data uniqueness.[1] To ensure the success of our proposed model, we employed balanced classes by employing hybrid balanced class sampling methods on the original dataset, as well as methods for data pre-processing and data transformation, to provide credible data for the training model. We ran and assessed our model on datasets with binary and multivalued classifications. We have used multiple datasets (Parkinson, arrythmia, breast cancer, kidney, diabetes). Suitable features are selected by using the Hybrid feature model consists of Lassocv, decision tree, random forest, gradient boosting,Adaboost, stochastic gradient descent and done voting of attributes which are common output from these methods.Accuracy of original dataset before applying framework is recorded and evaluated against reduced data set of attributes accuracy. The results are shown separately to provide comparisons. Based on the result analysis, we can conclude that our proposed model produced the highest accuracy on multi valued class datasets than on binary class attributes.[1]

Reconfigurable Intelligent Surface assisted massive MIMO systems based on phase shift optimization

  • Xuemei Bai;Congcong Hou;Chenjie Zhang;Hanping Hu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.18 no.7
    • /
    • pp.2027-2046
    • /
    • 2024
  • Reconfigurable Intelligent Surface (RIS) is an innovative technique to precisely control the phase of incident signals with the help of low-cost passive reflective elements. It shows excellent potential in the sixth generation of mobile communication systems, which not only extends wireless coverage but also boosts channel capacity. Considering that multipath propagation and a high number of antennas are involved in RIS in assisted mega multiple-input multiple-output (MIMO) systems, it suffers from severe channel fading and multipath effects, which in turn lead to signal instability and degradation of transmission performance. To overcome this obstacle, this essay suggests an improved gradient optimization algorithm to dynamically and optimally adjust the phase of the reflective elements to counteract channel fading and multipath effects as a strategy. In order to overcome the optimization problem of falling into local minima, this paper proposes an adaptive learning rate algorithm based on Adagrad improvement, which searches for the global optimal solution more efficiently and improves the robustness of the optimization algorithm. The suggested technique helps to enhance the estimate of channel efficiency of RIS-assisted large MIMO systems, according to simulation results.

PID Learning Controller for Multivariable System with Dynamic Friction (동적 마찰이 있는 다변수 시스템에서의 PID 학습 제어)

  • Chung, Byeong-Mook
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.24 no.12
    • /
    • pp.57-64
    • /
    • 2007
  • There have been many researches for optimal controllers in multivariable systems, and they generally use accurate linear models of the plant dynamics. Real systems, however, contain nonlinearities and high-order dynamics that may be difficult to model using conventional techniques. Therefore, it is necessary a PID gain tuning method without explicit modeling for the multivariable plant dynamics. The PID tuning method utilizes the sign of Jacobian and gradient descent techniques to iteratively reduce the error-related objective function. This paper, especially, focuses on the role of I-controller when there is a steady state error. However, it is not easy to tune I-gain unlike P- and D-gain because I-controller is mainly operated in the steady state. Simulations for an overhead crane system with dynamic friction show that the proposed PID-LC algorithm improves controller performance, even in the steady state error.

Design of an Adaptive Neuro-Fuzzy Inference Precompensator for Load Frequency Control of Two-Area Power Systems (2지역 전력계통의 부하주파수 제어를 위한 적응 뉴로 퍼지추론 보상기 설계)

  • 정형환;정문규;한길만
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.24 no.2
    • /
    • pp.72-81
    • /
    • 2000
  • In this paper, we design an adaptive neuro-fuzzy inference system(ANFIS) precompensator for load frequency control of 2-area power systems. While proportional integral derivative (PID) controllers are used in power systems, they may have some problems because of high nonlinearities of the power systems. So, a neuro-fuzzy-based precompensation scheme is incorporated with a convectional PID controller to obtain robustness to the nonlinearities. The proposed precompensation technique can be easily implemented by adding a precompensator to an existing PID controller. The applied neruo-fuzzy inference system precompensator uses a hybrid learning algorithm. This algorithm is to use both a gradient descent method to optimize the premise parameters and a least squares method to solve for the consequent parameters. Simulation results show that the proposed control technique is superior to a conventional Ziegler-Nichols PID controller in dynamic responses about load disturbances.

  • PDF