• Title/Summary/Keyword: a neural network with two-hidden layer

Search Result 59, Processing Time 0.031 seconds

Partially Connected Multi-Layer Perceptrons and their Combination for Off-line Handwritten Hangul Recognition (오프라인 필기체 전표용 한글 인식을 위한 부분 연결 다층 신경망과 결합)

  • 백영목;임길택;진성일
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.36C no.4
    • /
    • pp.87-94
    • /
    • 1999
  • This paper presents a study on the off-line handwritten Hangul (Korean) character recognition using the partially connected neural network (PCNN), which is based on partial connections between the input receptive fields and the hidden nodes. The hidden nodes of three PCNNs have ten receptive fields and different input feature sets. And we introduce modular partially connected neural network (MPCNN), The MPCNN combines three PCNNs with a merging network. The learning scheme of the proposed networks is composed of two steps: PCNN learning step and the merging step of combining three PCNN s. In the merging step, another merging PCNN network is introduced and trained by regarding the hidden output of each PCNN as a new input feature vector. The performance of the proposed classifier is verified on the recognition of 18 off-line handwritten Hangul characters widely used in business cards in Korea.

  • PDF

A Study on the Prediction of Welding Flaw Using Neural Network (인공 신경망을 이용한 실시간 용접품질 예측에 관한 연구)

  • Cho, Jae Hyung;Ko, Sang Hyun
    • Journal of Digital Convergence
    • /
    • v.17 no.5
    • /
    • pp.217-223
    • /
    • 2019
  • A study in predicting defects of spot welding in real time in automotive field is essential for cost reduction and high quality production. Welding quality is determined by shear strength and the size of the nugget, and results depend on different independent variables. In order to develop the real-time prediction system, multiple regression analyses were conducted and the two dependent variables were obtained with sufficient statistical results with three independent variables, however, the quality prediction by the regression formula could not ensure accuracy. In this study, a multi-layer neural network circuit was constructed. The neural network by 10 dynamic resistance variables was constructed with three hidden layers to obtain execution functions and weighting matrix. In this case, the neural network was established with three independent variables based on regression analysis, as there could be difficulties in real-time control due to too many input variables. As a result, all test data were divided into poor, partial, and modalities. Therefore, a real-time welding quality determination system by three independent variables obtained by multiple regression analysis was completed.

A Study on the Experimental Application of the Artificial Neural Network for the Process Improvement (공정개선을 위한 인공신경망의 실험적 적용에 관한 연구)

  • 한우철
    • Journal of the Korea Society of Computer and Information
    • /
    • v.7 no.1
    • /
    • pp.174-183
    • /
    • 2002
  • In this paper a control chart pattern recognition methodology based on the back propagation algorithm and Multi layer perceptron, a neural computing theory, is presented. This pattern recognition algorithm, suitable for real time statistical process control. evaluates observations routinely collected for control charting to determine whether a Pattern, such as a cycle. trend or shift, which is exists in the data. This approach is promising because of its flexible training and high speed computation with low-end workstation. The artificial neural network methodology is developed utilizing the delta learning rule, sigmoid activation function with two hidden layers. In a computer integrated manufacturing environment, the operator need not routinely monitor the control chart but, rather, can be alerted to patterns by a computer signal generated by the proposed system.

  • PDF

Design of Two-Dimensional Robust Face Recognition System Realized with the Aid of Facial Symmetry with Illumination Variation (얼굴의 대칭성을 이용하여 조명 변화에 강인한 2차원 얼굴 인식 시스템 설계)

  • Kim, Jong-Bum;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.64 no.7
    • /
    • pp.1104-1113
    • /
    • 2015
  • In this paper, we propose Two-Dimensional Robust Face Recognition System Realized with the Aid of Facial Symmetry with Illumination Variation. Preprocessing process is carried out to obtain mirror image which means new image rearranged by using difference between light and shade of right and left face based on a vertical axis of original face image. After image preprocessing, high dimensional image data is transformed to low-dimensional feature data through 2-directional and 2-dimensional Principal Component Analysis (2D)2PCA, which is one of dimensional reduction techniques. Polynomial-based Radial Basis Function Neural Network pattern classifier is used for face recognition. While FCM clustering is applied in the hidden layer, connection weights are defined as a linear polynomial function. In addition, the coefficients of linear function are learned through Weighted Least Square Estimation(WLSE). The Structural as well as parametric factors of the proposed classifier are optimized by using Particle Swarm Optimization(PSO). In the experiment, Yale B data is employed in order to confirm the advantage of the proposed methodology designed in the diverse illumination variation

Comparison of the neural networks with spline interpolation in modelling superheated water (물의 과열증기 모델링에 대한 신경회로망과 스플라인 보간법 비교)

  • Lee, Tae-Hwan;Park, Jin-Hyun;Kim, Bong-Hwan
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.4
    • /
    • pp.685-690
    • /
    • 2008
  • In numerically evaluating the thermal performance of the heat exchanger, numerical values of thermodynamic properties such as temperature, pressure, specific volume, enthalpy and entropy are required. But the steam table or diagram itself cannot be directly used without modelling. In this study the applicability of neural networks in modelling superheated water vapor was examined. The multi-layer neural networks consist of an input layer with 2 nodes, two hidden layers with 15 and 25 nodes respectively and an output layer with 3 nodes. Quadratic spline interpolation was also applied for comparison. Neural networks model revealed smaller percentage error compared with spline interpolation. From this result, it is confirmed that the neural networks could be a powerful method in modelling the superheated water vapor.

Prediction of Defect Size of Steam Generator Tube in Nuclear Power Plant Using Neural Network (신경회로망을 이용한 원전SG 세관 결함크기 예측)

  • Han, Ki-Won;Jo, Nam-Hoon;Lee, Hyang-Beom
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.27 no.5
    • /
    • pp.383-392
    • /
    • 2007
  • In this paper, we study the prediction of depth and width of a defect in steam generator tube in nuclear power plant using neural network. To this end, we first generate eddy current testing (ECT) signals for 4 defect patterns of SG tube: I-In type, I-Out type, V-In type, and V-Out type. In particular, we generate 400 ECT signals for various widths and depths for each defect type by the numerical analysis program based on finite element modeling. From those generated ECT signals, we extract new feature vectors for the prediction of defect size, which include the angle between the two points where the maximum impedance and half the maximum impedance are achieved. Using the extracted feature vector, multi-layer perceptron with one hidden layer is used to predict the size of defects. Through the computer simulation study, it is shown that the proposed method achieves decent prediction performance in terms of maximum error and mean absolute percentage error (MAPE).

Spatial Estimation of soil roughness and moisture from Sentinel-1 backscatter over Yanco sites: Artificial Neural Network, and Fractal

  • Lee, Ju Hyoung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.125-125
    • /
    • 2020
  • European Space Agency's Sentinel-1 has an improved spatial and temporal resolution, as compared to previous satellite data such as Envisat Advanced SAR (ASAR) or Advanced Scatterometer (ASCAT). Thus, the assumption used for low-resolution retrieval algorithms used by ENVISAT ASAR or ASCAT is not applicable to Sentinel-1, because a higher degree of land surface heterogeneity should be considered for retrieval. The assumption of homogeneity over land surface is not valid any more. In this study, considering that soil roughness is one of the key parameters sensitive to soil moisture retrievals, various approaches are discussed. First, soil roughness is spatially inverted from Sentinel-1 backscattering over Yanco sites in Australia. Based upon this, Artificial Neural Networks data (feedforward multiplayer perception, MLP, Levenberg-Marquadt algorithm) are compared with Fractal approach (brownian fractal, Hurst exponent of 0.5). When using ANNs, training data are achieved from theoretical forward scattering models, Integral Equation Model (IEM). and Sentinel-1 measurements. The network is trained by 20 neurons and one hidden layer, and one input layer. On the other hand, fractal surface roughness is generated by fitting 1D power spectrum model with roughness spectra. Fractal roughness profile is produced by a stochastic process describing probability between two points, and Hurst exponent, as well as rms heights (a standard deviation of surface height). Main interest of this study is to estimate a spatial variability of roughness without the need of local measurements. This non-local approach is significant, because we operationally have to be independent from local stations, due to its few spatial coverage at the global level. More fundamentally, SAR roughness is much different from local measurements, Remote sensing data are influenced by incidence angle, large scale topography, or a mixing regime of sensors, although probe deployed in the field indicate point data. Finally, demerit and merit of these approaches will be discussed.

  • PDF

Filtering Random Noise from Deterministic Underwater Signals via Application on an Artificial neural Network

  • Na, Young-Nam;Park, Joung-Soo;Choi, Jae-Young;Kim, Chun-Duck
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.3E
    • /
    • pp.4-12
    • /
    • 1996
  • In this study, we examine the applicability of an artificial neural network(ANN) for filtering underwater random noise and for identifying underlying signals taken from noisy environment. The approach is to find a way of compressing the input data and then decompressing it using an ANN as in image compressing process. It is well known that random signal is hard to compress while ordered information is not. The use of a limited number of processing elements(PEs) in the hidden layer of an Ann ensures that some of the noise would be removed in the reconstruction process. Two types of the signals, synthesized and measured, are used to examine the effectiveness of the ANN-based filter. After training process is completed, the ANN successfully extracts the underlying signals form the synthesized or measured noisy signals. In particular, compared with the results form without filtering or moving averaged, the ANN-based filter gives much better spectrograms to identify underlying signals from the measured noisy data. This filtering process is achieved without using and kind of highly accurate signal processing technique. More experimentation needs to be followed to develop the ANN-based filtering technique to the level of complete understanding.

  • PDF

The Capacity of Multi-Valued Single Layer CoreNet(Neural Network) and Precalculation of its Weight Values (단층 코어넷 다단입력 인공신경망회로의 처리용량과 사전 무게값 계산에 관한 연구)

  • Park, Jong-Joon
    • Journal of IKEEE
    • /
    • v.15 no.4
    • /
    • pp.354-362
    • /
    • 2011
  • One of the unsolved problems in Artificial Neural Networks is related to the capacity of a neural network. This paper presents a CoreNet which has a multi-leveled input and a multi-leveled output as a 2-layered artificial neural network. I have suggested an equation for calculating the capacity of the CoreNet, which has a p-leveled input and a q-leveled output, as $a_{p,q}=\frac{1}{2}p(p-1)q^2-\frac{1}{2}(p-2)(3p-1)q+(p-1)(p-2)$. With an odd value of p and an even value of q, (p-1)(p-2)(q-2)/2 needs to be subtracted further from the above equation. The simulation model 1(3)-1(6) has 3 levels of an input and 6 levels of an output with no hidden layer. The simulation result of this model gives, out of 216 possible functions, 80 convergences for the number of implementable function using the cot(x) input leveling method. I have also shown that, from the simulation result, the two diverged functions become implementable by precalculating the weight values. The simulation result and the precalculation of the weight values give the same result as the above equation in the total number of implementable functions.

The Flood Water Stage Prediction based on Neural Networks Method in Stream Gauge Station (하천수위표지점에서 신경망기법을 이용한 홍수위의 예측)

  • Kim, Seong-Won;Salas, Jose-D.
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.2
    • /
    • pp.247-262
    • /
    • 2000
  • In this paper, the WSANN(Water Stage Analysis with Neural Network) model was presented so as to predict flood water stage at Jindong which has been the major stream gauging station in Nakdong river basin. The WSANN model used the improved backpropagation training algorithm which was complemented by the momentum method, improvement of initial condition and adaptive-learning rate and the data which were used for this study were classified into training and testing data sets. An empirical equation was derived to determine optimal hidden layer node between the hidden layer node and threshold iteration number. And, the calibration of the WSANN model was performed by the four training data sets. As a result of calibration, the WSANN22 and WSANN32 model were selected for the optimal models which would be used for model verification. The model verification was carried out so as to evaluate model fitness with the two-untrained testing data sets. And, flood water stages were reasonably predicted through the results of statistical analysis. As results of this study, further research activities are needed for the construction of a real-time warning of the impending flood and for the control of flood water stage with neural network method in river basin. basin.

  • PDF