• Title/Summary/Keyword: Back-Propagation

Search Result 1,472, Processing Time 0.023 seconds

Structure of the Mixed Neural Networks Based On Orthogonal Basis Functions (직교 기저함수 기반의 혼합 신경회로망 구조)

  • Kim, Seong-Joo;Seo, Jae-Yong;Cho, Hyun-Chan;Kim, Seong-Hyun;Kim, Hong-Tae
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.39 no.6
    • /
    • pp.47-52
    • /
    • 2002
  • The wavelet functions are originated from scaling functions and can be used as activation function in the hidden node of the network by deciding two parameters such as scale and center. In this paper, we would like to propose the mixed structure. When we compose the WNN using wavelet functions, we propose to set a single scale function as a node function together. The properties of the proposed structure is that while one scale function approximates the target function roughly, the other wavelet functions approximate it finely. During the determination of the parameters, the wavelet functions can be determined by the global search algorithm such as genetic algorithm to be suitable for the suggested problem. Finally, we use the back-propagation algorithm in the learning of the weights.

Genetic Algorithm for Node P겨ning of Neural Networks (신경망의 노드 가지치기를 위한 유전 알고리즘)

  • Heo, Gi-Su;Oh, Il-Seok
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.46 no.2
    • /
    • pp.65-74
    • /
    • 2009
  • In optimizing the neural network structure, there are two methods of the pruning scheme and the constructive scheme. In this paper we use the pruning scheme to optimize neural network structure, and the genetic algorithm to find out its optimum node pruning. In the conventional researches, the input and hidden layers were optimized separately. On the contrary we attempted to optimize the two layers simultaneously by encoding two layers in a chromosome. The offspring networks inherit the weights from the parent. For teaming, we used the existing error back-propagation algorithm. In our experiment with various databases from UCI Machine Learning Repository, we could get the optimal performance when the network size was reduced by about $8{\sim}25%$. As a result of t-test the proposed method was shown better performance, compared with other pruning and construction methods through the cross-validation.

Neural Relighting using Specular Highlight Map (반사 하이라이트 맵을 이용한 뉴럴 재조명)

  • Lee, Yeonkyeong;Go, Hyunsung;Lee, Jinwoo;Kim, Junho
    • Journal of the Korea Computer Graphics Society
    • /
    • v.26 no.3
    • /
    • pp.87-97
    • /
    • 2020
  • In this paper, we propose a novel neural relighting that infers a relighted rendering image based on the user-guided specular highlight map. The proposed network utilizes a pre-trained neural renderer as a backbone network learned from the rendered image of a 3D scene with various lighting conditions. We jointly optimize a 3D light position and its associated relighted image by back-propagation, so that the difference between the base image and the relighted image is similar to the user-guided specular highlight map. The proposed method has the advantage of being able to explicitly infer the 3D lighting position, while providing the artists' preferred 2D screen-space interface. The performance of the proposed network was measured under the conditions that can establish ground truths, and the average error rate of light position estimations is 0.11, with the normalized 3D scene size.

The Lateral Guidance System of an Autonomous Vehicle Using a Neural Network Model of Magneto-Resistive Sensor and Magnetic Fields (자기 저항 센서와 자기장의 신경회로망 모델을 이용한 자율 주행 차량 측 방향 안내 시스템)

  • 손석준;류영재;김의선;임영철;김태곤;이주상
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.05a
    • /
    • pp.211-214
    • /
    • 2000
  • This paper describes a lateral guidance system of an autonomous vehicle, using a neural network model of magneto-resistive sensor and magnetic fields. The model equation was compared with experimental sensing data. We found that the experimental result has a negligible difference from the modeling equation result. We verified that the modeling equation can be used in simulations. As the neural network controller acquires magnetic field values(B$\sub$x/, B$\sub$y/, B$\sub$z/) from the three-axis, the controller outputs a steering angle. The controller uses the back-propagation algorithms of neural network. The learning pattern acquisition was obtained using computer simulation, which is more exact than human driving. The simulation program was developed in order to verify the acquisition of the teaming pattern, learning itself, and the adequacy of the design controller. Also, the performance of the controller can be verified through simulation.

  • PDF

Design of Nonlinear Model Using Type-2 Fuzzy Logic System by Means of C-Means Clustering (C-Means 클러스터링 기반의 Type-2 퍼지 논리 시스템을 이용한 비선형 모델 설계)

  • Baek, Jin-Yeol;Lee, Young-Il;Oh, Sung-Kwun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.6
    • /
    • pp.842-848
    • /
    • 2008
  • This paper deal with uncertainty problem by using Type-2 fuzzy logic set for nonlinear system modeling. We design Type-2 fuzzy logic system in which the antecedent and the consequent part of rules are given as Type-2 fuzzy set and also analyze the performance of the ensuing nonlinear model with uncertainty. Here, the apexes of the antecedent membership functions of rules are decided by C-means clustering algorithm and the apexes of the consequent membership functions of rules are learned by using back-propagation based on gradient decent method. Also, the parameters related to the fuzzy model are optimized by means of particle swarm optimization. The proposed model is demonstrated with the aid of two representative numerical examples, such as mathematical synthetic data set and Mackey-Glass time series data set and also we discuss the approximation as well as generalization abilities for the model.

Development of Artificial Neural Network Techniques for Landslide Susceptibility Analysis (산사태 취약성 분석 연구를 위한 인공신경망 기법 개발)

  • Chang, Buhm-Soo;Park, Hyuck-Jin;Lee, Saro;Juhyung Ryu;Park, Jaewon;Lee, Moung-Jin
    • Proceedings of the Korean Geotechical Society Conference
    • /
    • 2002.10a
    • /
    • pp.499-506
    • /
    • 2002
  • The purpose of this study is to develop landslide susceptibility analysis techniques using artificial neural networks and to apply the newly developed techniques for assessment of landslide susceptibility to the study area of Yongin in Korea. Landslide locations were identified in the study area from interpretation of aerial Photographs and field survey data, and a spatial database of the topography, soil type and timber cover were constructed. The landslide-related factors such as topographic slope, topographic curvature, soil texture, soil drainage, soil effective thickness, timber age, and timber diameter were extracted from the spatial database. Using those factors, landslide susceptibility and weights of each factor were analyzed by two artificial neural network methods. In the first method, the landslide susceptibility index was calculated by the back propagation method, which is a type of artificial neural network method. Then, the susceptibility map was made with a GIS program. The results of the landslide susceptibility analysis were verified using landslide location data. The verification results show satisfactory agreement between the susceptibility index and existing landslide location data. In the second method, weights of each factor were determinated. The weights, relative importance of each factor, were calculated using importance-free characteristics method of artificial neural networks.

  • PDF

Development of an Artificial Neural Network Expert System for Preliminary Design of Tunnel in Rock Masses (암반터널 예비설계를 위한 인공신경회로망 전문가 시스템의 개발)

  • 이철욱;문현구
    • Geotechnical Engineering
    • /
    • v.10 no.3
    • /
    • pp.79-96
    • /
    • 1994
  • A tunnel design expert system entitled NESTED is developed using the artificial neural network. The expert system includes three neural network computer models designed for the stability assessment of underground openings and the estimation of correlation between the RMR and Q systems. The expert system consists of the three models and the computerized rock mass classification programs that could be driven under the same user interface. As the structure of the neural network, a multi -layer neural network which adopts an or ror back-propagation learning algorithm is used. To set up its knowledge base from the prior case histories, an engineering database which can control the incomplete and erroneous information by learning process is developed. A series of experiments comparing the results of the neural network with the actual field observations have demonstrated the inferring capabilities of the neural network to identify the possible failure modes and the support timing. The neural network expert system thus complements the incomplete geological data and provides suitable support recommendations for preliminary design of tunnels in rock masses.

  • PDF

Adaptive Fuzzy-Neuro Controller for High Performance of Induction Motor (유도전동기의 고성능 제어를 위한 적응 퍼지-뉴로 제어기)

  • Chung, Dong-Hwa;Choi, Jung-Sik;Ko, Jae-Sub
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.20 no.3
    • /
    • pp.53-61
    • /
    • 2006
  • This paper is proposed adaptive fuzzy-neuro controller for high performance of induction motor drive. The design of this algorithm based on fuzzy-neural network controller that is implemented using fuzzy control and neural network. This controller uses fuzzy nile as training patterns of a neural network. Also, this controller uses the back-propagation method to adjust the weights between the neurons of neural network in order to minimize the error between the command output and actual output. A model reference adaptive scheme is proposed in which the adaptation mechanism is executed by fuzzy logic based on the error and change of error measured between the motor speed and output of a reference model. The control performance of the adaptive fuzzy-neuro controller is evaluated by analysis for various operating conditions. The results of experiment prove that the proposed control system has strong high performance and robustness to parameter variation, and steady-state accuracy and transient response.

Localization Estimation Using Artificial Intelligence Technique in Wireless Sensor Networks (WSN기반의 인공지능기술을 이용한 위치 추정기술)

  • Kumar, Shiu;Jeon, Seong Min;Lee, Seong Ro
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.39C no.9
    • /
    • pp.820-827
    • /
    • 2014
  • One of the basic problems in Wireless Sensor Networks (WSNs) is the localization of the sensor nodes based on the known location of numerous anchor nodes. WSNs generally consist of a large number of sensor nodes and recording the location of each sensor nodes becomes a difficult task. On the other hand, based on the application environment, the nodes may be subject to mobility and their location changes with time. Therefore, a scheme that will autonomously estimate or calculate the position of the sensor nodes is desirable. This paper presents an intelligent localization scheme, which is an artificial neural network (ANN) based localization scheme used to estimate the position of the unknown nodes. In the proposed method, three anchors nodes are used. The mobile or deployed sensor nodes request a beacon from the anchor nodes and utilizes the received signal strength indicator (RSSI) of the beacons received. The RSSI values vary depending on the distance between the mobile and the anchor nodes. The three RSSI values are used as the input to the ANN in order to estimate the location of the sensor nodes. A feed-forward artificial neural network with back propagation method for training has been employed. An average Euclidian distance error of 0.70 m has been achieved using a ANN having 3 inputs, two hidden layers, and two outputs (x and y coordinates of the position).

Bond strength prediction of steel bars in low strength concrete by using ANN

  • Ahmad, Sohaib;Pilakoutas, Kypros;Rafi, Muhammad M.;Zaman, Qaiser U.
    • Computers and Concrete
    • /
    • v.22 no.2
    • /
    • pp.249-259
    • /
    • 2018
  • This paper presents Artificial Neural Network (ANN) models for evaluating bond strength of deformed, plain and cold formed bars in low strength concrete. The ANN models were implemented using the experimental database developed by conducting experiments in three different universities on total of 138 pullout and 108 splitting specimens under monotonic loading. The key parameters examined in the experiments are low strength concrete, bar development length, concrete cover, rebar type (deformed, cold-formed, plain) and diameter. These deficient parameters are typically found in non-engineered reinforced concrete structures of developing countries. To develop ANN bond model for each bar type, four inputs (the low strength concrete, development length, concrete cover and bar diameter) are used for training the neurons in the network. Multi-Layer-Perceptron was trained according to a back-propagation algorithm. The ANN bond model for deformed bar consists of a single hidden layer and the 9 neurons. For Tor bar and plain bars the ANN models consist of 5 and 6 neurons and a single hidden layer, respectively. The developed ANN models are capable of predicting bond strength for both pull and splitting bond failure modes. The developed ANN models have higher coefficient of determination in training, validation and testing with good prediction and generalization capacity. The comparison of experimental bond strength values with the outcomes of ANN models showed good agreement. Moreover, the ANN model predictions by varying different parameters are also presented for all bar types.