• Title/Summary/Keyword: Back-propagation network

Search Result 1,107, Processing Time 0.023 seconds

Process Modeling and Optimization for Characteristics of ZnO Thin Films using Neural Networks and Genetic Algorithms (신경망과 유전 알고리즘을 이용한 광소자용 ZnO 박막 특성 공정 모델링 및 최적화)

  • Ko, Young-Don;Kang, Hong-Seong;Jeong, Min-Chang;Lee, Sang-Yeol;Myoung, Jae-Min;Yun, Il-Gu
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2004.07a
    • /
    • pp.33-36
    • /
    • 2004
  • The process modeling for the growth rate in pulsed laser deposition(PLD)-grown ZnO thin films is investigated using neural networks(NNets) and the process recipes is optimized via genetic algorithms(GAs). D-optimal design is carried out and the growth rate is characterized by NNets based on the back-propagation(BP) algorithm. GAs is then used to search the desired recipes for the desired growth rate. The statistical analysis is used to verify the fitness of the nonlinear process model. This process modeling and optimization algorithms can explain the characteristics of the desired responses varying with process conditions.

  • PDF

Machine-printed Numeral Recognition using Weighted Template Matching (가중 원형 정합을 이용한 인쇄체 숫자 인식)

  • Jung, Min-Chul
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.3
    • /
    • pp.554-559
    • /
    • 2009
  • This paper proposes a new method of weighted template matching fur machine-printed numeral recognition. The proposed weighted template matching, which emphasizes the feature of a pattern using adaptive Hamming distance on local feature areas, improves the recognition rate while template matching processes an input image as one global feature. The experiment compares confusion matrices of the template matching, error back propagation neural network classifier, and the proposed weighted template matching respectively. The result shows that the proposed method improves fairly the recognition rate of the machine-printed numerals.

Parameter Estimation of Recurrent Neural Networks Using A Unscented Kalman Filter Training Algorithm and Its Applications to Nonlinear Channel Equalization (언센티드 칼만필터 훈련 알고리즘에 의한 순환신경망의 파라미터 추정 및 비선형 채널 등화에의 응용)

  • Kwon Oh-Shin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.5
    • /
    • pp.552-559
    • /
    • 2005
  • Recurrent neural networks(RNNs) trained with gradient based such as real time recurrent learning(RTRL) has a drawback of slor convergence rate. This algorithm also needs the derivative calculation which is not trivialized in error back propagation process. In this paper a derivative free Kalman filter, so called the unscented Kalman filter(UKF), for training a fully connected RNN is presented in a state space formulation of the system. A derivative free Kalman filler learning algorithm makes the RNN have fast convergence speed and good tracking performance without the derivative computation. Through experiments of nonlinear channel equalization, performance of the RNNs with a derivative free Kalman filter teaming algorithm is evaluated.

A Study on improving the performance of License Plate Recognition (자동차 번호판 인식 성능 향상에 관한 연구)

  • Eom, Gi-Yeol
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2006.11a
    • /
    • pp.203-207
    • /
    • 2006
  • Nowadays, Cars are continuing to grow at an alarming rate but they also cause many problems such as traffic accident, pollutions and so on. One of the most effective methods that prevent traffic accidents is the use of traffic monitoring systems, which are already widely used in many countries. The monitoring system is beginning to be used in domestic recently. An intelligent monitoring system generates photo images of cars as well as identifies cars by recognizing their plates. That is, the system automatically recognizes characters of vehicle plates. An automatic vehicle plate recognition consists of two main module: a vehicle plate locating module and a vehicle plate number identification module. We study for a vehicle plate number identification module in this paper. We use image preprocessing, feature extraction, multi-layer neural networks for recognizing characters of vehicle plates and we present a feature-comparison method for improving the performance of vehicle plate number identification module. In the experiment on identifying vehicle plate number, 300 images taken from various scenes were used. Of which, 8 images have been failed to identify vehicle plate number and the overall rate of success for our vehicle plate recognition algorithm is 98%.

  • PDF

Neuro-fuzzy based approach for estimation of concrete compressive strength

  • Xue, Xinhua;Zhou, Hongwei
    • Computers and Concrete
    • /
    • v.21 no.6
    • /
    • pp.697-703
    • /
    • 2018
  • Compressive strength is one of the most important engineering properties of concrete, and testing of the compressive strength of concrete specimens is often costly and time consuming. In order to provide the time for concrete form removal, re-shoring to slab, project scheduling and quality control, it is necessary to predict the concrete strength based upon the early strength data. However, concrete compressive strength is affected by many factors, such as quality of raw materials, water cement ratio, ratio of fine aggregate to coarse aggregate, age of concrete, compaction of concrete, temperature, relative humidity and curing of concrete. The concrete compressive strength is a quite nonlinear function that changes depend on the materials used in the concrete and the time. This paper presents an adaptive neuro-fuzzy inference system (ANFIS) for the prediction of concrete compressive strength. The training of fuzzy system was performed by a hybrid method of gradient descent method and least squares algorithm, and the subtractive clustering algorithm (SCA) was utilized for optimizing the number of fuzzy rules. Experimental data on concrete compressive strength in the literature were used to validate and evaluate the performance of the proposed ANFIS model. Further, predictions from three models (the back propagation neural network model, the statistics model, and the ANFIS model) were compared with the experimental data. The results show that the proposed ANFIS model is a feasible, efficient, and accurate tool for predicting the concrete compressive strength.

Application of a support vector machine for prediction of piping and internal stability of soils

  • Xue, Xinhua
    • Geomechanics and Engineering
    • /
    • v.18 no.5
    • /
    • pp.493-502
    • /
    • 2019
  • Internal stability is an important safety issue for levees, embankments, and other earthen structures. Since a large part of the world's population lives near oceans, lakes and rivers, floods resulting from breaching of dams can lead to devastating disasters with tremendous loss of life and property, especially in densely populated areas. There are some main factors that affect the internal stability of dams, levees and other earthen structures, such as the erodibility of the soil, the water velocity inside the soil mass and the geometry of the earthen structure, etc. Thus, the mechanism of internal erosion and stability of soils is very complicated and it is vital to investigate the assessment methods of internal stability of soils in embankment dams and their foundations. This paper presents an improved support vector machine (SVM) model to predict the internal stability of soils. The grid search algorithm (GSA) is employed to find the optimal parameters of SVM firstly, and then the cross - validation (CV) method is employed to estimate the classification accuracy of the GSA-SVM model. Two examples of internal stability of soils are presented to validate the predictive capability of the proposed GSA-SVM model. In addition to verify the effectiveness of the proposed GSA-SVM model, the predictions from the proposed GSA-SVM model were compared with those from the traditional back propagation neural network (BPNN) model. The results showed that the proposed GSA-SVM model is a feasible and efficient tool for assessing the internal stability of soils with high accuracy.

Meta-model Effects on Approximate Multi-objective Design Optimization of Vehicle Suspension Components (차량 현가 부품의 근사 다목적 설계 최적화에 대한 메타모델 영향도)

  • Song, Chang Yong;Choi, Ha-Young;Byon, Sung-Kwang
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.3
    • /
    • pp.74-81
    • /
    • 2019
  • Herein, we performed a comparative study on approximate multi-objective design optimization, to realize a structural design to improve the weight and vibration performances of the knuckle - a car suspension component - considering various load conditions and vibration characteristics. In the approximate multi-objective optimization process, a regression meta-model was generated using the response surfaces method (RSM), while Kriging and back-propagation neural network (BPN) methods were applied for interpolation meta-modeling. The Pareto solutions, multi-objective optimal solutions, were derived using the non-dominated sorting genetic algorithm (NSGA-II). In terms of the knuckle design considered in this study, the characteristics and influence of the meta-model on multi-objective optimization were reviewed through a comparison of the approximate optimization results with the meta-models and the actual optimization.

Experimental and numerical study of autopilot using Extended Kalman Filter trained neural networks for surface vessels

  • Wang, Yuanyuan;Chai, Shuhong;Nguyen, Hung Duc
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.12 no.1
    • /
    • pp.314-324
    • /
    • 2020
  • Due to the nonlinearity and environmental uncertainties, the design of the ship's steering controller is a long-term challenge. The purpose of this study is to design an intelligent autopilot based on Extended Kalman Filter (EKF) trained Radial Basis Function Neural Network (RBFNN) control algorithm. The newly developed free running model scaled surface vessel was employed to execute the motion control experiments. After describing the design of the EKF trained RBFNN autopilot, the performances of the proposed control system were investigated by conducting experiments using the physical model on lake and simulations using the corresponding mathematical model. The results demonstrate that the developed control system is feasible to be used for the ship's motion control in the presences of environmental disturbances. Moreover, in comparison with the Back-Propagation (BP) neural networks and Proportional-Derivative (PD) based control methods, the EKF RBFNN based control method shows better performance regarding course keeping and trajectory tracking.

ConvXGB: A new deep learning model for classification problems based on CNN and XGBoost

  • Thongsuwan, Setthanun;Jaiyen, Saichon;Padcharoen, Anantachai;Agarwal, Praveen
    • Nuclear Engineering and Technology
    • /
    • v.53 no.2
    • /
    • pp.522-531
    • /
    • 2021
  • We describe a new deep learning model - Convolutional eXtreme Gradient Boosting (ConvXGB) for classification problems based on convolutional neural nets and Chen et al.'s XGBoost. As well as image data, ConvXGB also supports the general classification problems, with a data preprocessing module. ConvXGB consists of several stacked convolutional layers to learn the features of the input and is able to learn features automatically, followed by XGBoost in the last layer for predicting the class labels. The ConvXGB model is simplified by reducing the number of parameters under appropriate conditions, since it is not necessary re-adjust the weight values in a back propagation cycle. Experiments on several data sets from UCL Repository, including images and general data sets, showed that our model handled the classification problems, for all the tested data sets, slightly better than CNN and XGBoost alone and was sometimes significantly better.

Comparison of artificial intelligence models reconstructing missing wind signals in deep-cutting gorges

  • Zhen Wang;Jinsong Zhu;Ziyue Lu;Zhitian Zhang
    • Wind and Structures
    • /
    • v.38 no.1
    • /
    • pp.75-91
    • /
    • 2024
  • Reliable wind signal reconstruction can be beneficial to the operational safety of long-span bridges. Non-Gaussian characteristics of wind signals make the reconstruction process challenging. In this paper, non-Gaussian wind signals are converted into a combined prediction of two kinds of features, actual wind speeds and wind angles of attack. First, two decomposition techniques, empirical mode decomposition (EMD) and variational mode decomposition (VMD), are introduced to decompose wind signals into intrinsic mode functions (IMFs) to reduce the randomness of wind signals. Their principles and applicability are also discussed. Then, four artificial intelligence (AI) algorithms are utilized for wind signal reconstruction by combining the particle swarm optimization (PSO) algorithm with back propagation neural network (BPNN), support vector regression (SVR), long short-term memory (LSTM) and bidirectional long short-term memory (Bi-LSTM), respectively. Measured wind signals from a bridge site in a deep-cutting gorge are taken as experimental subjects. The results showed that the reconstruction error of high-frequency components of EMD is too large. On the contrary, VMD fully extracts the multiscale rules of the signal, reduces the component complexity. The combination of VMD-PSO-Bi-LSTM is demonstrated to be the most effective among all hybrid models.