• Title/Summary/Keyword: Back Propagation Training Algorithm

Search Result 185, Processing Time 0.029 seconds

A Recognition of Handwritten English Characters Using Back Propagation Algorithm and Dictionary (역전파 알고리듬과 사전을 이용한 필기체 영문자 인식)

  • 김응성;조성환;이근영
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.18 no.2
    • /
    • pp.157-168
    • /
    • 1993
  • In this paper, it is shown that neural networks trained with back propagation algorithm and dictionary can be applied to recognize handwritten English characters. To eliminate the useless data part and to minimize the variety of characters from the scanned image file, various preprocessings : that is, segmentation, centering, noise filtering, sealing and thinning are performed. After these, characteristic features are derived from thinned character pattern. The neural network is trained by using the extracted features for sample data, and all test data are classified into English alphabets according to their features through the neural network. Finally, the ways of reducing learning time and improving recognition rate, and the relationship between learning time and hidden layer nodes are considered. As a result of this study, after successful training, a high recognition rate has been obtained with this system for the trained patterns and about 93% for test patterns. Using dictionary, the recognition rate was about 97% for test pattern.

  • PDF

Non-Parametric Texture Extraction using Neural Network (신경 회로망을 사용한 비 파라메테 텍스춰 추출)

  • Jeon, Dong-Keun;Hong, Sun-Pyo;Song, Ja-Yoon;Kim, Sang-Jin;Kim, Ki-Jun;Kim, Song-Chol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.2E
    • /
    • pp.5-11
    • /
    • 1995
  • In this paper, a method using a neural network was applied for the purpose of urilizing spatial features. The adopted model of neural network the three-layered architecture, and the training algorithm is the back-propagation algorithm. Co-occurrence matrix which is generated from original imge was used for imput pattern to the neural network in order to tolerate variations of patterns like rotation of displacement. Co-occurrence matrix is explained in appendix. To evaluate this method, classification was executed with this method and texture features method over the city area and sand area, which cannot be separated with the conventional method mentioned aboved. In the results of this method and texture features proposed by Haralick the method using texture features was separation rate of 67%~89%. On the contrary, the method using neural network proposed in this research was stable and high separation rate of 80%~98%.

  • PDF

A new model approach to predict the unloading rock slope displacement behavior based on monitoring data

  • Jiang, Ting;Shen, Zhenzhong;Yang, Meng;Xu, Liqun;Gan, Lei;Cui, Xinbo
    • Structural Engineering and Mechanics
    • /
    • v.67 no.2
    • /
    • pp.105-113
    • /
    • 2018
  • To improve the prediction accuracy of the strong-unloading rock slope performance and obtain the range of variation in the slope displacement, a new displacement time-series prediction model is proposed, called the fuzzy information granulation (FIG)-genetic algorithm (GA)-back propagation neural network (BPNN) model. Initially, a displacement time series is selected as the training samples of the prediction model on the basis of an analysis of the causes of the change in the slope behavior. Then, FIG is executed to partition the series and obtain the characteristic parameters of every partition. Furthermore, the later characteristic parameters are predicted by inputting the earlier characteristic parameters into the GA-BPNN model, where a GA is used to optimize the initial weights and thresholds of the BPNN; in the process, the numbers of input layer nodes, hidden layer nodes, and output layer nodes are determined by a trial method. Finally, the prediction model is evaluated by comparing the measured and predicted values. The model is applied to predict the displacement time series of a strong-unloading rock slope in a hydropower station. The engineering case shows that the FIG-GA-BPNN model can obtain more accurate predicted results and has high engineering application value.

The Possibility of Neural Network Approach to Solve Singular Perturbed Problems

  • Kim, Jee-Hyun;Cho, Young-Im
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.1
    • /
    • pp.69-76
    • /
    • 2021
  • Recentlly neural network approach for solving a singular perturbed integro-differential boundary value problem have been researched. Especially the model of the feed-forward neural network to be trained by the back propagation algorithm with various learning algorithms were theoretically substantiated, and neural network models such as deep learning, transfer learning, federated learning are very rapidly evolving. The purpose of this paper is to study the approaching method for developing a neural network model with high accuracy and speed for solving singular perturbed problem along with asymptotic methods. In this paper, we propose a method that the simulation for the difference between result value of singular perturbed problem and unperturbed problem by using neural network approach equation. Also, we showed the efficiency of the neural network approach. As a result, the contribution of this paper is to show the possibility of simple neural network approach for singular perturbed problem solution efficiently.

Compressive strength prediction of limestone filler concrete using artificial neural networks

  • Ayat, Hocine;Kellouche, Yasmina;Ghrici, Mohamed;Boukhatem, Bakhta
    • Advances in Computational Design
    • /
    • v.3 no.3
    • /
    • pp.289-302
    • /
    • 2018
  • The use of optimum content of supplementary cementing materials (SCMs) such as limestone filler (LF) to blend with Portland cement has been resulted in many environmental and technical advantages, such as increase in physical properties, enhancement of sustainability in concrete industry and reducing $CO_2$ emission are well known. Artificial neural networks (ANNs) have been already applied in civil engineering to solve a wide variety of problems such as the prediction of concrete compressive strength. The feed forward back propagation (FFBP) algorithm and Tan-sigmoid transfer function were used for the ANNs training in this study. The training, testing and validation of data during the backpropagation training process yielded good correlations exceeding 97%. A parametric study was conducted to study the sensitivity of the developed model to certain essential parameters affecting the compressive strength of concrete. The effects and benefits of limestone filler on hardened properties of the concrete such as compressive strength were well established endorsing previous results in the literature. The results of this study revealed that the proposed ANNs model showed a high performance as a feasible and highly efficient tool for simulating the LF concrete compressive strength prediction.

Optimization of the Processing Conditions and Prediction of the Quality for Dyeing Nylon and Lycra Blended Fabrics

  • Kuo Chung-Feng Jeffrey;Fang Chien-Chou
    • Fibers and Polymers
    • /
    • v.7 no.4
    • /
    • pp.344-351
    • /
    • 2006
  • This paper is intended to determine the optimal processing parameters applied to the dyeing procedure so that the desired color strength of a raw fabric can be achieved. Moreover, the processing parameters are also used for constructing a system to predict the fabric quality. The fabric selected is the nylon and Lycra blend. The dyestuff used for dyeing is acid dyestuff and the dyeing method is one-bath-two-section. The Taguchi quality method is applied for parameter design. The analysis of variance (ANOVA) is applied to arrange the optimal condition, significant factors and the percentage contributions. In the experiment, according to the target value, a confirmation experiment is conducted to evaluate the reliability. Furthermore, the genetic algorithm (GA) is combined with the back propagation neural network (BPNN) in order to establish the forecasting system for searching the best connecting weights of BPNN. It can be shown that this combination not only enhances the efficiency of the learning algorithm, but also decreases the dependency of the initial condition during the network training. Most of all, the robustness of the learning algorithm will be increased and the quality characteristic of fabric will be precisely predicted.

Variation of activation functions for accelerating the learning speed of the multilayer neural network (다층 구조 신경회로망의 학습 속도 향상을 위한 활성화 함수의 변화)

  • Lee, Byung-Do;Lee, Min-Ho
    • Journal of Sensor Science and Technology
    • /
    • v.8 no.1
    • /
    • pp.45-52
    • /
    • 1999
  • In this raper, an enhanced learning method is proposed for improving the learning speed of the error back propagation learning algorithm. In order to cope with the premature saturation phenomenon at the initial learning stage, a variation scheme of active functions is introduced by using higher order functions, which does not need much increase of computation load. It naturally changes the learning rate of inter-connection weights to a large value as the derivative of sigmoid function abnormally decrease to a small value during the learning epoch. Also, we suggest the hybrid learning method incorporated the proposed method with the momentum training algorithm. Computer simulation results show that the proposed learning algorithm outperforms the conventional methods such as momentum and delta-bar-delta algorithms.

  • PDF

Determination of Optimum Heating Regions for Thermal Prestressing Method Using Artificial Neural Network (인공신경망을 이용한 온도프리스트레싱 공법의 적정 가열구간 설정에 관한 연구)

  • 김상효;김준환;김강미
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2003.04a
    • /
    • pp.327-334
    • /
    • 2003
  • Thermal Prestressing Method for continuous composite girder bridges is a new design and construction method developed to induce initial composite stresses in the concrete slab at negative bending regions. Due to the induced initial stresses, prevention of tensile cracks at concrete slab, reduction of steel girder section, and reduction of reinforcing bars are possible. Thus, economical and construction efficiency can be improved. Method for determining optimum heating region of Thermal Prestressing Method, has not been established although such method is essential for increasing efficiency of the designing process. Trial-and-error method used in previous studies is far from efficient and more rational method for computing optimal heating region is required. In this study, efficient method for determining optimum heating region in the use of Thermal Prestressing Method is developed based on artificial neural network algorithm, which is widely adopted to pattern recognition, optimization, diagnosis, and estimation problems in various fields. Back-propagation algorithm, which is commonly used as a learning algorithm in neural network problems, is used for training of the neural network. Through case studies of 2-span continuous and 3-span continuous composite girder bridges using the developed process, the optimal heating regions are obtained.

  • PDF

Research for enhanced counting algorithm of optical pill counting machine (광학센서를 이용한 알약계수기의 계수알고리즘 향상에 관한 연구)

  • 홍인기;원민규;이순걸
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.10a
    • /
    • pp.683-686
    • /
    • 2002
  • It is fundamental to count and pack the pills in the medicine manufacture field but those tasks are time and labor consuming. Thus, the need fur automation of those tasks is necessarily getting increased in order to get effective mass production. It Is significant to perceive pills quickly and precisely. There were many trials for this processing but the performance of the existing counting machines varies about size, shape and dispersion tendency of pills. In this paper, the authors try to improve the counting performance of a pill counting machine that has optical sensors with the neural network. The passing signal of pill is acquired with optical sensor and the passage signal of the pill is extracted as input patterns. The gradient and integration of signal during passing time and the time keeping the pill interrupt the light from the LED are used as characteristic feature. The back propagation and perception algorithm are used for training. Experimental results with several pills show that the designed algorithm is a little bit effective to reduce the noise effect which is generated from interference among the machine components and unreliable environment.

  • PDF

Modeling the Properties of the PECVD Silicon Dioxide Films Using Polynomial Neural Networks

  • Han, Seung-Soo;Song, Kyung-Bin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.195-200
    • /
    • 1998
  • Since the neural network was introduced, significant progress has been made on data handling and learning algorithms. Currently, the most popular learning algorithm in neural network training is feed forward error back-propagation (FFEBP) algorithm. Aside from the success of the FFEBP algorithm, polynomial neural networks (PNN) learning has been proposed as a new learning method. The PNN learning is a self-organizing process designed to determine an appropriate set of Ivakhnenko polynomials that allow the activation of many neurons to achieve a desired state of activation that mimics a given set of sampled patterns. These neurons are interconnected in such a way that the knowledge is stored in Ivakhnenko coefficients. In this paper, the PNN model has been developed using the plasma enhanced chemical vapor deposition (PECVD) experimental data. To characterize the PECVD process using PNN, SiO$_2$films deposited under varying conditions were analyzed using fractional factorial experimental design with three center points. Parameters varied in these experiments included substrate temperature, pressure, RF power, silane flow rate and nitrous oxide flow rate. Approximately five microns of SiO$_2$were deposited on (100) silicon wafers in a Plasma-Therm 700 series PECVD system at 13.56 MHz.

  • PDF