• 제목/요약/키워드: neural network training

검색결과 1,742건 처리시간 0.031초

RAM 기반 신경망을 이용한 필기체 숫자 분류 연구 (A Study on Handwritten Digit Categorization of RAM-based Neural Network)

  • 박상무;강만모;엄성훈
    • 한국인터넷방송통신학회논문지
    • /
    • 제12권3호
    • /
    • pp.201-207
    • /
    • 2012
  • RAM 기반 신경망은 2진 신경망(Binary Neural Network, BNN)에 복수개의 정보 저장 비트를 두어 교육의 반복 횟수를 누적하도록 구성된 가중치를 가지지 않는(weightless) 신경회로망으로서 한 번의 교육만으로 학습이 이루어지는 효율성이 뛰어난 신경회로망이다. 지도 학습에 기반을 둔 RAM 기반 신경망은 패턴 인식 분야에는 우수한 성능을 보이는 반면, 비지도 학습에 의해 패턴을 구분해야 하는 범주화 연구에는 적합하지 않은 모델로 분류된다. 본 논문에서는 비지도 학습 알고리즘을 제안하여 RAM 기반 신경망으로 패턴 범주화를 수행한다. 제안된 비지도 학습 알고리즘에 의해 RAM 기반 신경망은 입력 패턴에 따라 자율 학습하여 스스로 범주를 생성할 수 있으며, 이를 통해 RAM 기반 신경망이 지도 학습과 비지도 학습이 모두 가능한 복합 모델임을 증명한다. 실험에 사용한 학습 패턴으로는 0에서 9까지의 오프라인 필기체 숫자로 구성된 MNIST 데이터베이스를 사용하였다.

EFFECTS OF RANDOMIZING PATTERNS AND TRAINING UNEQUALLY REPRESENTED CLASSES FOR ARTIFICIAL NEURAL NETWORKS

  • Kim, Young-Sup;Coleman Tommy L.
    • 한국공간정보시스템학회:학술대회논문집
    • /
    • 한국공간정보시스템학회 2002년도 춘계학술대회 논문집
    • /
    • pp.45-52
    • /
    • 2002
  • Artificial neural networks (ANN) have been successfully used for classifying remotely sensed imagery. However, ANN still is not the preferable choice for classification over the conventional classification methodology such as the maximum likelihood classifier commonly used in the industry production environment. This can be attributed to the ANN characteristic built-in stochastic process that creates difficulties in dealing with unequally represented training classes, and its training performance speed. In this paper we examined some practical aspects of training classes when using a back propagation neural network model for remotely sensed imagery. During the classification process of remotely sensed imagery, representative training patterns for each class are collected by polygons or by using a region-growing methodology over the imagery. The number of collected training patterns for each class may vary from several pixels to thousands. This unequally populated training data may cause the significant problems some neural network empirical models such as back-propagation have experienced. We investigate the effects of training over- or under- represented training patterns in classes and propose the pattern repopulation algorithm, and an adaptive alpha adjustment (AAA) algorithm to handle unequally represented classes. We also show the performance improvement when input patterns are presented in random fashion during the back-propagation training.

  • PDF

An Experimental Investigation of the Application of Artificial Neural Network Techniques to Predict the Cyclic Polarization Curves of AL-6XN Alloy with Sensitization

  • Jung, Kwang-Hu;Kim, Seong-Jong
    • Corrosion Science and Technology
    • /
    • 제20권2호
    • /
    • pp.62-68
    • /
    • 2021
  • Artificial neural network techniques show an excellent ability to predict the data (output) for various complex characteristics (input). It is primarily specialized to solve nonlinear relationship problems. This study is an experimental investigation that applies artificial neural network techniques and an experimental design to predict the cyclic polarization curves of the super-austenitic stainless steel AL-6XN alloy with sensitization. A cyclic polarization test was conducted in a 3.5% NaCl solution based on an experimental design matrix with various factors (degree of sensitization, temperature, pH) and their levels, and a total of 36 cyclic polarization data were acquired. The 36 cyclic polarization patterns were used as training data for the artificial neural network model. As a result, the supervised learning algorithms with back-propagation showed high learning and prediction performances. The model showed an excellent training performance (R2=0.998) and a considerable prediction performance (R2=0.812) for the conditions that were not included in the training data.

신경회로망을 이용한 비선형 시스팀 제어의 실험적 연구 (Experimental Studies of Neural Network Control Technique for Nonlinear Systern)

  • 임선빈;정슬
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2000년도 제15차 학술회의논문집
    • /
    • pp.195-195
    • /
    • 2000
  • In this paper, intelligent control method using neural network as a nonlinear controller is presented, Neural network controller is implemented on DSP board in PC to make real time computing possible, On-line training algorithm for neural network control is proposed, As a test-bed, a large a-x table was build and interface with PC has been implemented, Experimental results under different PD controller gains show excellent position tracking for circular trajectory compared with those for PD controller only.

  • PDF

On-line Training of Neural Network for Monitoring Plant Transients

  • Varde, P.V.;Moon, B.S.;Han, J.B.
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2003년도 춘계 학술대회 학술발표 논문집
    • /
    • pp.129-133
    • /
    • 2003
  • The work described in this paper deals with the proposed application of an Artificial Neural Network Model for the Advanced Pressurized Water Reactor APR-1400 transient identification. The approach adopted for testing the network take note of the expectation which should be fulfilled by a network for real-time application, like testing with data in on-line mode and use of actual or real-life patterns for training. The recall test performed demonstrates that use of neural network for transient identification is indeed an attractive preposition.

  • PDF

Fault Diagnostics Algorithm of Rotating Machinery Using ART-Kohonen Neural Network

  • 안경룡;한천;양보석;전재진;김원철
    • 한국소음진동공학회논문집
    • /
    • 제12권10호
    • /
    • pp.799-807
    • /
    • 2002
  • The vibration signal can give an indication of the condition of rotating machinery, highlighting potential faults such as unbalance, misalignment and bearing defects. The features in the vibration signal provide an important source of information for the faults diagnosis of rotating machinery. When additional training data become available after the initial training is completed, the conventional neural networks (NNs) must be retrained by applying total data including additional training data. This paper proposes the fault diagnostics algorithm using the ART-Kohonen network which does not destroy the initial training and can adapt additional training data that is suitable for the classification of machine condition. The results of the experiments confirm that the proposed algorithm performs better than other NNs as the self-organizing feature maps (SOFM) , learning vector quantization (LYQ) and radial basis function (RBF) NNs with respect to classification quality. The classification success rate for the ART-Kohonen network was 94 o/o and for the SOFM, LYQ and RBF network were 93 %, 93 % and 89 % respectively.

신경회로망을 이용한 RF 스퍼터링 ZnO 박막 증착 프로세스 모델링 (Modeling of RF Sputtering Process for ZnO Thin film Deposition using Neural Network)

  • 임근영;이상극;박춘배
    • 한국전기전자재료학회논문지
    • /
    • 제19권7호
    • /
    • pp.624-630
    • /
    • 2006
  • ZnO deposition parameters are not independent and have a nonlinear and complex property. To propose a method that could verify and predict the relations of process variables, neural network was used. At first, ZnO thin films were deposited by using RF magnetron sputtering process with various conditions. Si, GaAs, and Glass were used as substrates. The temperature, work pressure, and RF power of the substrate were $50\sim500^{\circ}C$, 15 mTorr, and $180\sim210W$, respectively : the purity of the target was ZnO 4 N. Structural properties of ZnO thin films were estimated by using XRD (0002) peak intensity. The structure of neural network was a form of 4-7-1 that have one hidden layer. In training a network, learning rate and momentum were selected as 0.2, 0.6 respectively. A backpropagation neural network were performed with XRD (0002) peak data. After training a network, the temperature of substrate was evaluated as the most important parameter by sensitivity analysis and response surface. As a result, neural network could capture nonlinear and complex relationships between process parameters and predict structural properties of ZnO thin films with a limited set of experiments.

Prediction of plasma etching using genetic-algorithm controlled backpropagation neural network

  • Kim, Sung-Mo;Kim, Byung-Whan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.1305-1308
    • /
    • 2003
  • A new technique is presented to construct a predictive model of plasma etch process. This was accomplished by combining a backpropagation neural network (BPNN) and a genetic algorithm (GA). The predictive model constructed in this way is referred to as a GA-BPNN. The GA played a role of controlling training factors simultaneously. The training factors to be optimized are the hidden neuron, training tolerance, initial weight magnitude, and two gradients of bipolar sigmoid and linear functions. Each etch response was optimized separately. The proposed scheme was evaluated with a set of experimental plasma etch data. The etch process was characterized by a $2^3$ full factorial experiment. The etch responses modeled are aluminum (A1) etch rate, silica profile angle, A1 selectivity, and dc bias. Additional test data were prepared to evaluate model appropriateness. The GA-BPNN was compared to a conventional BPNN. Compared to the BPNN, the GA-BPNN demonstrated an improvement of more than 20% for all etch responses. The improvement was significant in the case of A1 etch rate.

  • PDF

비반복적 훈련 신경망을 이용한 숫자인식 (Digits Recognition Using a Non-Iterative Neural Network)

  • 이재승;안도랑;이동욱
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2000년도 추계학술대회 논문집 학회본부 D
    • /
    • pp.797-799
    • /
    • 2000
  • Most neural network learning schemes are derived from learning systems which are generally iterative in nature. But, when the given input-output training vector pairs satisfy a PLI condition, the training and the application of a hard-limited neural network can be achieved non-iteratively with very short training time and very robust recognition when it is applied to recognize any untrained patterns. In this paper, a method of expanding the dimension of training pattern data is suggested. The proposed method demonstrates better performance and robustness.

  • PDF

센서퓨젼 기반의 인공신경망을 이용한 드릴 마모 모니터링 (Sensor Fusion and Neural Network Analysis for Drill-Wear Monitoring)

  • ;권오양
    • 한국공작기계학회논문집
    • /
    • 제17권1호
    • /
    • pp.77-85
    • /
    • 2008
  • The objective of the study is to construct a sensor fusion system for tool-condition monitoring (TCM) that will lead to a more efficient and economical drill usage. Drill-wear monitoring has an important attribute in the automatic machining processes as it can help preventing the damage of tools and workpieces, and optimizing the drill usage. In this study, we present the architectures of a multi-layer feed-forward neural network with Levenberg-Marquardt training algorithm based on sensor fusion for the monitoring of drill-wear condition. The input features to the neural networks were extracted from AE, vibration and current signals using the wavelet packet transform (WPT) analysis. Training and testing were performed at a moderate range of cutting conditions in the dry drilling of steel plates. The results show good performance in drill- wear monitoring by the proposed method of sensor fusion and neural network analysis.