• Title/Summary/Keyword: Neural Network-based

Search Result 5,581, Processing Time 0.039 seconds

A Study on Handwritten Digit Categorization of RAM-based Neural Network (RAM 기반 신경망을 이용한 필기체 숫자 분류 연구)

  • Park, Sang-Moo;Kang, Man-Mo;Eom, Seong-Hoon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.12 no.3
    • /
    • pp.201-207
    • /
    • 2012
  • A RAM-based neural network is a weightless neural network based on binary neural network(BNN) which is efficient neural network with a one-shot learning. RAM-based neural network has multiful information bits and store counts of training in BNN. Supervised learning based on the RAM-based neural network has the excellent performance in pattern recognition but in pattern categorization with unsupervised learning as unsuitable. In this paper, we propose a unsupervised learning algorithm in the RAM-based neural network to perform pattern categorization. By the proposed unsupervised learning algorithm, RAM-based neural network create categories depending on the input pattern by itself. Therefore, RAM-based neural network for supervised learning and unsupervised learning should proof of all possible complex models. The training data for experiments provided by the MNIST offline handwritten digits which is consist of 0 to 9 multi-pattern.

Using Structural Changes to support the Neural Networks based on Data Mining Classifiers: Application to the U.S. Treasury bill rates

  • Oh, Kyong-Joo
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.57-72
    • /
    • 2003
  • This article provides integrated neural network models for the interest rate forecasting using change-point detection. The model is composed of three phases. The first phase is to detect successive structural changes in interest rate dataset. The second phase is to forecast change-point group with data mining classifiers. The final phase is to forecast the interest rate with BPN. Based on this structure, we propose three integrated neural network models in terms of data mining classifier: (1) multivariate discriminant analysis (MDA)-supported neural network model, (2) case based reasoning (CBR)-supported neural network model and (3) backpropagation neural networks (BPN)-supported neural network model. Subsequently, we compare these models with a neural network model alone and, in addition, determine which of three classifiers (MDA, CBR and BPN) can perform better. For interest rate forecasting, this study then examines the predictability of integrated neural network models to represent the structural change.

  • PDF

Optimal Control of Induction Motor Using Immune Algorithm Based Fuzzy Neural Network

  • Kim, Dong-Hwa;Cho, Jae-Hoon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1296-1301
    • /
    • 2004
  • Fuzzy logic, neural network, fuzzy-neural network play an important as the key technology of linguistic modeling for intelligent control and decision making in complex systems. The fuzzy -neural network (FNN) learning represents one of the most effective algorithms to build such linguistic models. This paper proposes learning approach of fuzzy-neural network by immune algorithm. The proposed learning model is presented in an immune based fuzzy-neural network (FNN) form which can handle linguistic knowledge by immune algorithm. The learning algorithm of an immune based FNN is composed of two phases. The first phase used to find the initial membership functions of the fuzzy neural network model. In the second phase, a new immune algorithm based optimization is proposed for tuning of membership functions and structure of the proposed model.

  • PDF

Displacement prediction in geotechnical engineering based on evolutionary neural network

  • Gao, Wei;He, T.Y.
    • Geomechanics and Engineering
    • /
    • v.13 no.5
    • /
    • pp.845-860
    • /
    • 2017
  • It is very important to study displacement prediction in geotechnical engineering. Nowadays, the grey system method, time series analysis method and artificial neural network method are three main methods. Based on the brief introduction, the three methods are analyzed comprehensively. Their merits and demerits, applied ranges are revealed. To solve the shortcomings of the artificial neural network method, a new prediction method based on new evolutionary neural network is proposed. Finally, through two real engineering applications, the analysis of three main methods and the new evolutionary neural network method all have been verified. The results show that, the grey system method is a kind of exponential approximation to displacement sequence, and time series analysis is linear autoregression approximation, while artificial neural network is nonlinear autoregression approximation. Thus, the grey system method can suitably analyze the sequence, which has the exponential law, the time series method can suitably analyze the random sequence and the neural network method almostly can be applied in any sequences. Moreover, the prediction results of new evolutionary neural network method is the best, and its approximation sequence and the generalization prediction sequence are all coincided with the real displacement sequence well. Thus, the new evolutionary neural network method is an acceptable method to predict the measurement displacements of geotechnical engineering.

An Immune-Fuzzy Neural Network For Dynamic System

  • Kim, Dong-Hwa;Cho, Jae-Hoon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2004.10a
    • /
    • pp.303-308
    • /
    • 2004
  • Fuzzy logic, neural network, fuzzy-neural network play an important as the key technology of linguistic modeling for intelligent control and decision making in complex systems. The fuzzy-neural network (FNN) learning represents one of the most effective algorithms to build such linguistic models. This paper proposes learning approach of fuzzy-neural network by immune algorithm. The proposed learning model is presented in an immune based fuzzy-neural network (FNN) form which can handle linguistic knowledge by immune algorithm. The learning algorithm of an immune based FNN is composed of two phases. The first phase used to find the initial membership functions of the fuzzy neural network model. In the second phase, a new immune algorithm based optimization is proposed for tuning of membership functions and structure of the proposed model.

  • PDF

Neural Network Based Dissolved Gas Analysis Using Gas Composition Patterns Against Fault Causes

  • J. H. Sun;Kim, K. H.;P. B. Ha
    • KIEE International Transactions on Electrophysics and Applications
    • /
    • v.3C no.4
    • /
    • pp.130-135
    • /
    • 2003
  • This study describes neural network based dissolved gas analysis using composition patterns of gas concentrations for transformer fault diagnosis. DGA samples were gathered from related literatures and classified into six types of faults and then a neural network was trained using the DGA samples. Diagnosis tests were performed by the trained neural network with DGA samples of serviced transformers, fault causes of which were identified by actual inspection. Diagnosis results by the neural network were in good agreement with actual faults.

Twowheeled Motor Vehicle License Plate Recognition Algorithm using CPU based Deep Learning Convolutional Neural Network (CPU 기반의 딥러닝 컨볼루션 신경망을 이용한 이륜 차량 번호판 인식 알고리즘)

  • Kim Jinho
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.19 no.4
    • /
    • pp.127-136
    • /
    • 2023
  • Many research results on the traffic enforcement of illegal driving of twowheeled motor vehicles using license plate recognition are introduced. Deep learning convolutional neural networks can be used for character and word recognition of license plates because of better generalization capability compared to traditional Backpropagation neural networks. In the plates of twowheeled motor vehicles, the interdependent government and city words are included. If we implement the mutually independent word recognizers using error correction rules for two word recognition results, efficient license plate recognition results can be derived. The CPU based convolutional neural network without library under real time processing has an advantage of low cost real application compared to GPU based convolutional neural network with library. In this paper twowheeled motor vehicle license plate recognition algorithm is introduced using CPU based deep-learning convolutional neural network. The experimental results show that the proposed plate recognizer has 96.2% success rate for outdoor twowheeled motor vehicle images in real time.

Recognition of Virtual Written Characters Based on Convolutional Neural Network

  • Leem, Seungmin;Kim, Sungyoung
    • Journal of Platform Technology
    • /
    • v.6 no.1
    • /
    • pp.3-8
    • /
    • 2018
  • This paper proposes a technique for recognizing online handwritten cursive data obtained by tracing a motion trajectory while a user is in the 3D space based on a convolution neural network (CNN) algorithm. There is a difficulty in recognizing the virtual character input by the user in the 3D space because it includes both the character stroke and the movement stroke. In this paper, we divide syllable into consonant and vowel units by using labeling technique in addition to the result of localizing letter stroke and movement stroke in the previous study. The coordinate information of the separated consonants and vowels are converted into image data, and Korean handwriting recognition was performed using a convolutional neural network. After learning the neural network using 1,680 syllables written by five hand writers, the accuracy is calculated by using the new hand writers who did not participate in the writing of training data. The accuracy of phoneme-based recognition is 98.9% based on convolutional neural network. The proposed method has the advantage of drastically reducing learning data compared to syllable-based learning.

Path Tracking Control Using a Wavelet Based Fuzzy Neural Network for Mobile Robots

  • Oh, Joon-Seop;Park, Yoon-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.4 no.1
    • /
    • pp.111-118
    • /
    • 2004
  • In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the solution of the tracking problem for mobile robots. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the tracking performance for mobile robot and compare it with those of the FNN and the WFM.

A Novel Stabilizing Control for Neural Nonlinear Systems with Time Delays by State and Dynamic Output Feedback

  • Liu, Mei-Qin;Wang, Hui-Fang
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.1
    • /
    • pp.24-34
    • /
    • 2008
  • A novel neural network model, termed the standard neural network model (SNNM), similar to the nominal model in linear robust control theory, is suggested to facilitate the synthesis of controllers for delayed (or non-delayed) nonlinear systems composed of neural networks. The model is composed of a linear dynamic system and a bounded static delayed (or non-delayed) nonlinear operator. Based on the global asymptotic stability analysis of SNNMs, Static state-feedback controller and dynamic output feedback controller are designed for the SNNMs to stabilize the closed-loop systems, respectively. The control design equations are shown to be a set of linear matrix inequalities (LMIs) which can be easily solved by various convex optimization algorithms to determine the control signals. Most neural-network-based nonlinear systems with time delays or without time delays can be transformed into the SNNMs for controller synthesis in a unified way. Two application examples are given where the SNNMs are employed to synthesize the feedback stabilizing controllers for an SISO nonlinear system modeled by the neural network, and for a chaotic neural network, respectively. Through these examples, it is demonstrated that the SNNM not only makes controller synthesis of neural-network-based systems much easier, but also provides a new approach to the synthesis of the controllers for the other type of nonlinear systems.