• Title/Summary/Keyword: Gradient descent

Search Result 339, Processing Time 0.021 seconds

Real-time Active Vibration Control of Smart Structure Using Adaptive PPF Controller (적응형 PPF 제어기를 이용한 지능구조물의 실시간 능동진동제어)

  • Heo, Seok;Lee, Seung-Bum;Kwak, Moon-Kyu;Baek, Kwang-Hyun
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.14 no.4
    • /
    • pp.267-275
    • /
    • 2004
  • This research is concerned with the development of a real-time adaptive PPF controller for the active vibration suppression of smart structure. In general, the tuning of the PPF controller is carried out off-line. In this research, the real-time learning algorithm is developed to find the optimal filter frequency of the PPF controller in real time and the efficacy of the algorithm is proved by implementing it in real time. To this end, the adaptive algorithm is developed by applying the gradient descent method to the predefined performance index, which is similar to the method used popularly in the optimization and neural network controller design. The experiment was carried out to verify the validity of the adaptive PPF controller developed in this research. The experimental results showed that adaptive PPF controller is effective for active vibration control of the structure which is excited by either impact or harmonic disturbance. The filter frequency of the PPF controller is tuned in a very short period of time thus proving the efficiency of the adaptive PPF controller.

Genetic Algorithm with the Local Fine-Tuning Mechanism (유전자 알고리즘을 위한 지역적 미세 조정 메카니즘)

  • 임영희
    • Korean Journal of Cognitive Science
    • /
    • v.4 no.2
    • /
    • pp.181-200
    • /
    • 1994
  • In the learning phase of multilyer feedforword neural network,there are problems such that local minimum,learning praralysis and slow learning speed when backpropagation algorithm used.To overcome these problems, the genetic algorithm has been used as learing method in the multilayer feedforword neural network instead of backpropagation algorithm.However,because the genetic algorith, does not have any mechanism for fine-tuned local search used in backpropagation method,it takes more time that the genetic algorithm converges to a global optimal solution.In this paper,we suggest a new GA-BP method which provides a fine-tunes local search to the genetic algorithm.GA-BP method uses gradient descent method as one of genetic algorithm's operators such as mutation or crossover.To show the effciency of the developed method,we applied it to the 3-parity bit problem with analysis.

Modeling and assessment of VWNN for signal processing of structural systems

  • Lin, Jeng-Wen;Wu, Tzung-Han
    • Structural Engineering and Mechanics
    • /
    • v.45 no.1
    • /
    • pp.53-67
    • /
    • 2013
  • This study aimed to develop a model to accurately predict the acceleration of structural systems during an earthquake. The acceleration and applied force of a structure were measured at current time step and the velocity and displacement were estimated through linear integration. These data were used as input to predict the structural acceleration at next time step. The computation tool used was the Volterra/Wiener neural network (VWNN) which contained the mathematical model to predict the acceleration. For alleviating problems of relatively large-dimensional and nonlinear systems, the VWNN model was utilized as the signal processing tool, including the Taylor series components in the input nodes of the neural network. The number of the intermediate layer nodes in the neural network model, containing the training and simulation stage, was evaluated and optimized. Discussions on the influences of the gradient descent with adaptive learning rate algorithm and the Levenberg-Marquardt algorithm, both for determining the network weights, on prediction errors were provided. During the simulation stage, different earthquake excitations were tested with the optimized settings acquired from the training stage to find out which of the algorithms would result in the smallest error, to determine a proper simulation model.

Two-Way MIMO AF Relaying Methods Having a Legacy Device without Self-Interference Cancellation (자기간섭 제거 기능이 없는 기존 단말을 가지는 양방향 다중입출력 중계 증폭 전송 기법)

  • Lee, Kyoung-Jae
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.42 no.2
    • /
    • pp.338-344
    • /
    • 2017
  • In this paper, two-way amplify-and-forward relay methods are investigated where two terminals and one relay node are equipped with multiple antennas. In two-way relay channels, it is assumed that one terminal can eliminate its own self-interference but the other cannot. For this channel, we first maximize the sum-rate performance by employing an iterative gradient descent (GD) algorithm. Then, a simple singular value decomposition (SVD) based block triangularization is developed to null the self-interference. Simulation results show the proposed methods outperform the conventional schemes for various environments.

Design of Generalized Predictive Controller Using Wavelet Neural Networks for Chaotic Systems (웨이블릿 신경 회로망을 이용한 혼돈 시스템의 일반형 예측 제어기 설계)

  • Park, Sang-Woo;Choi, Jong-Tae;Choi, Yoon-Ho;Park, Jin-Bae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.1
    • /
    • pp.24-30
    • /
    • 2003
  • In this paper, we propose a novel predictive control method, which uses a wavelet neural network as a predictor, for the control of chaotic systems. In our method, we use the gradient descent method for training the parameter of a wavelet neural network. The control signals are directly obtained by minimizing the difference between a reference signal and the output of a wavelet neural network. To verify the efficiency of our method, we apply it to the Doffing and the Henon system, which are a representative continuous and discrete time chaotic system respectively, and compare with the results of generalized predictive control using multi-layer perceptron.

Comparison of Different CNN Models in Tuberculosis Detecting

  • Liu, Jian;Huang, Yidi
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.8
    • /
    • pp.3519-3533
    • /
    • 2020
  • Tuberculosis is a chronic and delayed infection which is easily experienced by young people. According to the statistics of the World Health Organization (WHO), there are nearly ten million fell ill with tuberculosis and a total of 1.5 million people died from tuberculosis in 2018 (including 251000 people with HIV). Tuberculosis is the largest single infectious pathogen that leads to death. In order to help doctors with tuberculosis diagnosis, we compare the tuberculosis classification abilities of six popular convolutional neural network (CNN) models in the same data set to find the best model. Before training, we optimize three parts of CNN to achieve better results. We employ sigmoid function to replace the step function as the activation function. What's more, we use binary cross entropy function as the cost function to replace traditional quadratic cost function. Finally, we choose stochastic gradient descent (SGD) as gradient descent algorithm. From the results of our experiments, we find that Densenet121 is most suitable for tuberculosis diagnosis and achieve a highest accuracy of 0.835. The optimization and expansion depend on the increase of data set and the improvements of Densenet121.

Fuzzy Model Identification using a mGA Hybrid Schemes (mGA의 혼합된 구조를 사용한 퍼지 모델 동정)

  • Ju, Yeong-Hun;Lee, Yeon-U;Park, Jin-Bae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.49 no.8
    • /
    • pp.423-431
    • /
    • 2000
  • This paper presents a systematic approach to the input-output data-based fuzzy modeling for the complex and uncertain nonlinear systems, in which the conventional mathematical models may fail to give the satisfying results. To do this, we propose a new method that can yield a successful fuzzy model using a mGA hybrid schemes with a fine-tuning method. We also propose a new coding method fo chromosome for applying the mGA to the structure and parameter identifications of fuzzy model simultaneously. During mGA search, multi-purpose fitness function with a penalty process is proposed and adapted to guarantee the accurate and valid fuzzy modes. This coding scheme can effectively represent the zero-order Takagi-Sugeno fuzzy model. The proposed mGA hybrid schemes can coarsely optimize the structure and the parameters of the fuzzy inference system, and then fine tune the identified fuzzy model by using the gradient descent method. In order to demonstrate the superiority and efficiency of the proposed scheme, we finally show its applications to two nonlinear systems.

  • PDF

A Moving Terminal's Coordinates Prediction Algorithm and an IoT Application

  • Kim, Daewon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.7
    • /
    • pp.63-74
    • /
    • 2017
  • Recently in the area of ICT, the M2M and IoT are in the spotlight as a cutting edge technology with the help of advancement of internet. Among those fields, the smart home is the closest area to our daily lives. Smart home has the purpose to lead a user more convenient living in the house with WLAN (Wireless Local Area Network) or other short-range communication environments using automated appliances. With an arrival of the age of IoT, this can be described as one axis of a variety of applications as for the M2H (Machine to Home) field in M2M. In this paper, we propose a novel technique for estimating the location of a terminal that freely move within a specified area using the RSSI (Received Signal Strength Indication) in the WLAN environment. In order to perform the location estimation, the Fingerprint and KNN methods are utilized and the LMS with the gradient descent method and the proposed algorithm are also used through the error correction functions for locating the real-time position of a moving user who is keeping a smart terminal. From the estimated location, the nearest fixed devices which are general electric appliances were supposed to work appropriately for self-operating of virtual smart home. Through the experiments, connection and operation success rate, and the performance results are analyzed, presenting the verification results.

An Improved Multiplicative Updating Algorithm for Nonnegative Independent Component Analysis

  • Li, Hui;Shen, Yue-Hong;Wang, Jian-Gong
    • ETRI Journal
    • /
    • v.35 no.2
    • /
    • pp.193-199
    • /
    • 2013
  • This paper addresses nonnegative independent component analysis (NICA), with the aim to realize the blind separation of nonnegative well-grounded independent source signals, which arises in many practical applications but is hardly ever explored. Recently, Bertrand and Moonen presented a multiplicative NICA (M-NICA) algorithm using multiplicative update and subspace projection. Based on the principle of the mutual correlation minimization, we propose another novel cost function to evaluate the diagonalization level of the correlation matrix, and apply the multiplicative exponentiated gradient (EG) descent update to it to maintain nonnegativity. An efficient approach referred to as the EG-NICA algorithm is derived and its validity is confirmed by numerous simulations conducted on different types of source signals. Results show that the separation performance of the proposed EG-NICA algorithm is superior to that of the previous M-NICA algorithm, with a better unmixing accuracy. In addition, its convergence speed is adjustable by an appropriate user-defined learning rate.

Efficient Learning Algorithm using Structural Hybrid of Multilayer Neural Networks and Gaussian Potential Function Networks (다층 신경회로망과 가우시안 포텐샬 함수 네트워크의 구조적 결합을 이용한 효율적인 학습 방법)

  • 박상봉;박래정;박철훈
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.19 no.12
    • /
    • pp.2418-2425
    • /
    • 1994
  • Although the error backpropagation(EBP) algorithm based on the gradient descent method is a widely-used learning algorithm of neural networks, learning sometimes takes a long time to acquire accuracy. This paper develops a novel learning method to alleviate the problems of EBP algorithm such as local minima, slow speed, and size of structure and thus to improve performance by adopting other new networks. Gaussian Potential Function networks(GPFN), in parallel with multilayer neural networks. Empirical simulations show the efficacy of the proposed algorithm in function approximation, which enables us to train networks faster with the better generalization capabilities.

  • PDF