• Title/Summary/Keyword: Levenberg-Marquardt algorithm

Search Result 96, Processing Time 0.035 seconds

Application of Self-Organizing Map for the Analysis of Rainfall-Runoff Characteristics (강우-유출특성 분석을 위한 자기조직화방법의 적용)

  • Kim, Yong Gu;Jin, Young Hoon;Park, Sung Chun
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.1B
    • /
    • pp.61-67
    • /
    • 2006
  • Various methods have been applied for the research to model the relationship between rainfall-runoff, which shows a strong nonlinearity. In particular, most researches to model the relationship between rainfall-runoff using artificial neural networks have used back propagation algorithm (BPA), Levenberg Marquardt (LV) and radial basis function (RBF). and They have been proved to be superior in representing the relationship between input and output showing strong nonlinearity and to be highly adaptable to rapid or significant changes in data. The theory of artificial neural networks is utilized not only for prediction but also for classifying the patterns of data and analyzing the characteristics of the patterns. Thus, the present study applied self?organizing map (SOM) based on Kohonen's network theory in order to classify the patterns of rainfall-runoff process and analyze the patterns. The results from the method proposed in the present study revealed that the method could classify the patterns of rainfall in consideration of irregular changes of temporal and spatial distribution of rainfall. In addition, according to the results from the analysis the patterns between rainfall-runoff, seven patterns of rainfall-runoff relationship with strong nonlinearity were identified by SOM.

System Identification of Internet transmission rate control factors

  • Yoo, Sung-Goo;Kim, Young-Seok;Chong, Kil-To
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.652-657
    • /
    • 2004
  • As the real-time multimedia applications through Internet increase, the bandwidth available to TCP connections is oppressed by the UDP traffic, result in the performance of overall system is extremely deteriorated. Therefore, developing a new transmission protocol is necessary. The TCP-friendly algorithm is an example meeting this necessity. The TCP-friendly (TFRC) is an UDP-based protocol that controls the transmission rate based on the available round transmission time (RTT) and the packet loss rate (PLR). In the data transmission processing, transmission rate is determined based on the conditions of the previous transmission period. If the one-step ahead predicted values of the control factors are available, the performance will be improved significantly. This paper proposes a prediction model of transmission rate control factors that will be used for the transmission rate control, which improves the performance of the networks. The model developed through this research is predicting one-step ahead variables of RTT and PLR. A multiplayer perceptron neural network is used as the prediction model and Levenberg-Marquardt algorithm is used for the training. The values of RTT and PLR were collected using TFRC protocol in the real system. The obtained prediction model is validated using new data set and the results show that the obtained model predicts the factors accurately.

  • PDF

Extraction of Passive Device Model Parameters Using Genetic Algorithms

  • Yun, Il-Gu;Carastro, Lawrence A.;Poddar, Ravi;Brooke, Martin A.;May, Gary S.;Hyun, Kyung-Sook;Pyun, Kwang-Eui
    • ETRI Journal
    • /
    • v.22 no.1
    • /
    • pp.38-46
    • /
    • 2000
  • The extraction of model parameters for embedded passive components is crucial for designing and characterizing the performance of multichip module (MCM) substrates. In this paper, a method for optimizing the extraction of these parameters using genetic algorithms is presented. The results of this method are compared with optimization using the Levenberg-Marquardt (LM) algorithm used in the HSPICE circuit modeling tool. A set of integrated resistor structures are fabricated, and their scattering parameters are measured for a range of frequencies from 45 MHz to 5 GHz. Optimal equivalent circuit models for these structures are derived from the s-parameter measurements using each algorithm. Predicted s-parameters for the optimized equivalent circuit are then obtained from HSPICE. The difference between the measured and predicted s-parameters in the frequency range of interest is used as a measure of the accuracy of the two optimization algorithms. It is determined that the LM method is extremely dependent upon the initial starting point of the parameter search and is thus prone to become trapped in local minima. This drawback is alleviated and the accuracy of the parameter values obtained is improved using genetic algorithms.

  • PDF

Identification of Optimal Control Parameters for a Pneumatic Active Engine Mount System (공압식 능동형 엔진마운트시스템의 최적 제어매개변수 식별)

  • Kim, Il-Jo;Lee, Jae-Cheon;Choi, Jae-Yong;Kim, Jeong-Hoon
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.20 no.2
    • /
    • pp.30-37
    • /
    • 2012
  • Pneumatic Active Engine Mount(PAEM) with open-loop control system has been developed to reduce the transmission of the idle-shake vibration induced by engine effectively and economically. A solenoid valve installed between PAEM and vacuum tank is on-off switched by the Pulse Width Modulate(PWM) control signal to decrease the dynamic stiffness of the engine mount. This paper presents the methodology to identify the optimal values of control parameters of a PAEM, i.e, turn-on timing and duty ratio of PWM signal for 6 different idle driving conditions. A scanning algorithm was first applied to the vehicle test to obtain the approximate optimal control parameters minimizing the vibration at front seat rail and at steering wheel. Then the PAEM system identification was fulfilled to find accurate optimal control parameters by using multi-layer neural networks of Levenberg-Marquardt algorithm with vehicle test data.

Modeling of Multimedia Internet Transmission Rate Control Factors Using Neural Networks (멀티미디어 인터넷 전송을 위한 전송률 제어 요소의 신경회로망 모델링)

  • Chong Kil-to;Yoo Sung-Goo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.4
    • /
    • pp.385-391
    • /
    • 2005
  • As the Internet real-time multimedia applications increases, the bandwidth available to TCP connections is oppressed by the UDP traffic, result in the performance of overall system is extremely deteriorated. Therefore, developing a new transmission protocol is necessary. The TCP-friendly algorithm is an example satisfying this necessity. The TCP-Friendly Rate Control (TFRC) is an UDP-based protocol that controls the transmission rate that is based on the available round trip time (RTT) and the packet loss rate (PLR). In the data transmission processing, transmission rate is determined based on the conditions of the previous transmission period. If the one-step ahead predicted values of the control factors are available, the performance will be improved significantly. This paper proposes a prediction model of transmission rate control factors that will be used in the transmission rate control, which improves the performance of the networks. The model developed through this research is predicting one-step ahead variables of RTT and PLR. A multiplayer perceptron neural network is used as the prediction model and Levenberg-Marquardt algorithm is used for the training. The values of RTT and PLR were collected using TFRC protocol in the real system. The obtained prediction model is validated using new data set and the results show that the obtained model predicts the factors accurately.

Optimization of band-stop filter in coaxial line (동축선로내 대역억제필터의 최적화)

  • 정봉식
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.4 no.1
    • /
    • pp.97-103
    • /
    • 2000
  • In this paper band-stop filters that reject the undesired 3th and/or 5th harmonics generated from high frequency generator are analyzed using equivalent circuit concept, and optimized using iterative optimization algorithm. The length of the band-stop filter is setup initially a quarter of a wavelength of the harmonic, but initial filter structure is exactly unable to cutoff the harmonics because of the fringing effect at the discontinuous boundary. To reduce the mismatch between the cutoff frequency and the harmonics, iterative LMA(Levenberg-Marquardt Algorithm) is introduced and band-stop filters in coaxial line are optimized.

  • PDF

Predicting compressive strength of bended cement concrete with ANNs

  • Gazder, Uneb;Al-Amoudi, Omar Saeed Baghabara;Khan, Saad Muhammad Saad;Maslehuddin, Mohammad
    • Computers and Concrete
    • /
    • v.20 no.6
    • /
    • pp.627-634
    • /
    • 2017
  • Predicting the compressive strength of concrete is important to assess the load-carrying capacity of a structure. However, the use of blended cements to accrue the technical, economic and environmental benefits has increased the complexity of prediction models. Artificial Neural Networks (ANNs) have been used for predicting the compressive strength of ordinary Portland cement concrete, i.e., concrete produced without the addition of supplementary cementing materials. In this study, models to predict the compressive strength of blended cement concrete prepared with a natural pozzolan were developed using regression models and single- and 2-phase learning ANNs. Back-propagation (BP), Levenberg-Marquardt (LM) and Conjugate Gradient Descent (CGD) methods were used for training the ANNs. A 2-phase learning algorithm is proposed for the first time in this study for predictive modeling of the compressive strength of blended cement concrete. The output of these predictive models indicates that the use of a 2-phase learning algorithm will provide better results than the linear regression model or the traditional single-phase ANN models.

Predicting the rock fragmentation in surface mines using optimized radial basis function and cascaded forward neural network models

  • Xiaohua Ding;Moein Bahadori;Mahdi Hasanipanah;Rini Asnida Abdullah
    • Geomechanics and Engineering
    • /
    • v.33 no.6
    • /
    • pp.567-581
    • /
    • 2023
  • The prediction and achievement of a proper rock fragmentation size is the main challenge of blasting operations in surface mines. This is because an optimum size distribution can optimize the overall mine/plant economics. To this end, this study attempts to develop four improved artificial intelligence models to predict rock fragmentation through cascaded forward neural network (CFNN) and radial basis function neural network (RBFNN) models. In this regards, the CFNN was trained by the Levenberg-Marquardt algorithm (LMA) and Conjugate gradient backpropagation (CGP). Further, the RBFNN was optimized by the Dragonfly Algorithm (DA) and teaching-learning-based optimization (TLBO). For developing the models, the database required was collected from the Midouk copper mine, Iran. After modeling, the statistical functions were computed to check the accuracy of the models, and the root mean square errors (RMSEs) of CFNN-LMA, CFNN-CGP, RBFNN-DA, and RBFNN-TLBO were obtained as 1.0656, 1.9698, 2.2235, and 1.6216, respectively. Accordingly, CFNN-LMA, with the lowest RMSE, was determined as the model with the best prediction results among the four examined in this study.

Teaching-learning-based strategy to retrofit neural computing toward pan evaporation analysis

  • Rana Muhammad Adnan Ikram;Imran Khan;Hossein Moayedi;Loke Kok Foong;Binh Nguyen Le
    • Smart Structures and Systems
    • /
    • v.32 no.1
    • /
    • pp.37-47
    • /
    • 2023
  • Indirect determination of pan evaporation (PE) has been highly regarded, due to the advantages of intelligent models employed for this objective. This work pursues improving the reliability of a popular intelligent model, namely multi-layer perceptron (MLP) through surmounting its computational knots. Available climatic data of Fresno weather station (California, USA) is used for this study. In the first step, testing several most common trainers of the MLP revealed the superiority of the Levenberg-Marquardt (LM) algorithm. It, therefore, is considered as the classical training approach. Next, the optimum configurations of two metaheuristic algorithms, namely cuttlefish optimization algorithm (CFOA) and teaching-learning-based optimization (TLBO) are incorporated to optimally train the MLP. In these two models, the LM is replaced with metaheuristic strategies. Overall, the results demonstrated the high competency of the MLP (correlations above 0.997) in the presence of all three strategies. It was also observed that the TLBO enhances the learning and prediction accuracy of the classical MLP (by nearly 7.7% and 9.2%, respectively), while the CFOA performed weaker than LM. Moreover, a comparison between the efficiency of the used metaheuristic optimizers showed that the TLBO is a more time-effective technique for predicting the PE. Hence, it can serve as a promising approach for indirect PE analysis.

Development of the Dynamic Model for the Metabolic Network of Clostridium acetobutylicum (Clostridium acetobutylicum의 대사망의 동적모델 개발)

  • Kim, Woohyun;Eom, Moon-Ho;Lee, Sang-Hyun;Choi, Jin-Dal-Rae;Park, Sunwon
    • Korean Chemical Engineering Research
    • /
    • v.51 no.2
    • /
    • pp.226-232
    • /
    • 2013
  • To produce biobutanol, fermentation processes using clostridia that mainly produce acetone, butanol and ethanol are used. In this work, a dynamic model describing the metabolic reactions in an acetone-butanol-ethanol (ABE)-producing clostridium, Clostridium acetobutylicum ATCC824, was proposed. To estimate the 58 kinetic parameters of the metabolic network model with experimental data obtained from a batch fermentor, we used an efficient optimization method combining a genetic algorithm and the Levenberg-Marquardt method because of the complexity of the metabolism of the clostridium. For the verification of the determined parameters, the developed metabolic model was evaluated by experiments where genetically modified clostridium was used and the initial concentration of glucose was changed. Consequently, we found that the developed kinetic model for the metabolic network was considered to describe the dynamic metabolic state of the clostridium sufficiently. Thus, this dynamic model for the metabolic reactions will contribute to designing the clostridium as well as the fermentor for higher productivity.