• 제목/요약/키워드: Hidden Neurons

검색결과 131건 처리시간 0.027초

NETLA Based Optimal Synthesis Method of Binary Neural Network for Pattern Recognition

  • Lee, Joon-Tark
    • 한국지능시스템학회논문지
    • /
    • 제14권2호
    • /
    • pp.216-221
    • /
    • 2004
  • This paper describes an optimal synthesis method of binary neural network for pattern recognition. Our objective is to minimize the number of connections and the number of neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm (NETLA) for the multilayered neural networks. The synthesis method in NETLA uses the Expanded Sum of Product (ESP) of the boolean expressions and is based on the multilayer perceptron. It has an ability to optimize a given binary neural network in the binary space without any iterative learning as the conventional Error Back Propagation (EBP) algorithm. Furthermore, NETLA can reduce the number of the required neurons in hidden layer and the number of connections. Therefore, this learning algorithm can speed up training for the pattern recognition problems. The superiority of NETLA to other learning algorithms is demonstrated by an practical application to the approximation problem of a circular region.

NETLA를 이용한 이진 신경회로망의 최적합성 (Optimal Synthesis of Binary Neural Network using NETLA)

  • 정종원;성상규;지석준;최우진;이준탁
    • 한국마린엔지니어링학회:학술대회논문집
    • /
    • 한국마린엔지니어링학회 2002년도 춘계학술대회논문집
    • /
    • pp.273-277
    • /
    • 2002
  • This paper describes an optimal synthesis method of binary neural network(BNN) for an approximation problem of a circular region and synthetic image having four class using a newly proposed learning algorithm. Our object is to minimize the number of connections and neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm(NETLA) based on the multilayer BNN. The synthesis method in the NETLA is based on the extension principle of Expanded and Truncated Learning (ETL) learning algorithm using the multilayer perceptron and is based on Expanded Sum of Product (ESP) as one of the boolean expression techniques. The number of the required neurons in hidden layer can be reduced and fasted for learning pattern recognition.. The superiority of this NETLA to other algorithms was proved by simulation.

  • PDF

Diagnosis of Plasma Equipment using Neural Network and Impedance Match Monitoring

  • Byungwhan Kim
    • KIEE International Transaction on Systems and Control
    • /
    • 제2D권2호
    • /
    • pp.120-124
    • /
    • 2002
  • A new methodology is presented to diagnose faults in equipment plasma. This is accomplished by using neural networks as a pattern recognizer of radio frequency (rf) impedance match data. Using a match monitor system, the match data were collected. The monitor system consisted mainly of a multifunction board and a signal flow diagram coded by Visual Designer. Plasma anomaly was effectively represented by electrical match positions. Twenty sets of fault-symptom patterns were experimentally simulated with variations in process factors, which include rf source power, pressure, Ar, and $O_$2 flow rates. As an input to neural networks, two means and standard deviations of positions were used as well as a reflected power. Diagnostic accuracy was measured as a function of training factors, which include the number of hidden neurons, the magnitude of initial weights, and two gradients of neuron activation functions. The accuracy was the most sensitive to the number of hidden neurons. Interaction effects on the accuracy were also examined by performing a 2$^$4 full factorial experiment. The experiments were performed on multipole inductively coupled plasma equipment.

  • PDF

Model Selection in Artificial Neural Network

  • Kim, Byung Joo
    • International journal of advanced smart convergence
    • /
    • 제7권4호
    • /
    • pp.57-65
    • /
    • 2018
  • Artificial neural network is inspired by the biological neural network. For simplicity, in computer science, it is represented as a set of layers. Many research has been made in evaluating the number of neurons in the hidden layer but still, none was accurate. Several methods are used until now which do not provide the exact formula for calculating the number of thehidden layer as well as the number of neurons in each hidden layer. In this paper model selection approach was presented. Proposed model is based on geographical analysis of decision boundary. Proposed model selection method is useful when we know the distribution of the training data set. To evaluate the performance of the proposed method we compare it to the traditional architecture on IRIS classification problem. According to the experimental result on Iris data proposed method is turned out to be a powerful one.

다층구조 퍼셉트론을 이용한 분류 영상압축 및 코딩 (Classified Image Compression and Coding using Multi-Layer Percetpron)

  • 조광보;박철훈;이수영
    • 한국통신학회논문지
    • /
    • 제19권11호
    • /
    • pp.2264-2275
    • /
    • 1994
  • 본 논문에서는 블록 분류와 코딩과 함께 신경회로망을 이용한 영상압축을 보였다. 오차 역전파 알고리즘으로 학습되는 다층구조 신경회로망은 정규화된 영상데이타를 감소된 공간 중복성을 가지는 은닉층의 값으로 변환하는데 사용된다. 기본적으로 영상압축은 입력층과 출력층의 뉴런보다 적은 수의 은닉층 뉴런에 의해 얻어진다. 여기에 시각체계의 민감도에 따른 영상블럭 복잡성에 따라 적응적으로 압축되므로 블록을 분류한다. 또한 은닉뉴런의 양자화된 값은 효과적인 전송을 위해 entropy coding을 이용한 경우 화질의 큰 저하없이 약 25:1의 압축률을 얻었다.

  • PDF

Random generator-controlled backpropagation neural network to predicting plasma process data

  • Kim, Sungmo;Kim, Sebum;Kim, Byungwhan
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2003년도 ISIS 2003
    • /
    • pp.599-602
    • /
    • 2003
  • A new technique is presented to construct predictive models of plasma etch processes. This was accomplished by combining a backpropagation neural network (BPNN) and a random generator (RC). The RG played a critical role to control neuron gradients in the hidden layer, The predictive model constructed in this way is referred to as a randomized BPNN (RG-BPNN). The proposed scheme was evaluated with a set of experimental plasma etch process data. The etch process was characterized by a 2$^3$ full factorial experiment. The etch responses modeled are 4, including aluminum (Al) etch rate, profile angle, Al selectivity, and do bias. Additional test data were prepared to evaluate model appropriateness. The performance of RC-BPNN was evaluated as a function of the number of hidden neurons and the range of gradient. for given range and hidden neurons, 100 sets of random neuron gradients were generated and among them one best set was selected for evaluation. Compared to the conventional BPNN, the proposed RC-BPNN demonstrated about 50% improvements in all comparisons. This illustrates that the RG-BPNN of multi-valued gradients is an effective way to considerably improve the predictive ability of current BPNN of single-valued gradient.

  • PDF

다층회귀예측신경망의 음성인식성능에 관한 연구 (A Study on the Speech Recognition Performance of the Multilayered Recurrent Prediction Neural Network)

  • 안점영
    • 한국정보통신학회논문지
    • /
    • 제3권2호
    • /
    • pp.313-319
    • /
    • 1999
  • 4층구조의 다층퍼셉트론을 변형하여 3 종류의 다층회귀예측신경망을 구성하고, 예측차수, 두 은닉층의 뉴런개수, 연결세기의 초기치 및 전달함수 변화에 따른 각 망의 음성인식성능을 실험을 통해 각각 비교 분석한다. 실험결과에 의하면, 다층회귀신경망이 다층퍼셉트론에 비해 음성인식성능이 우수하다. 그리고 구조적으로는 상위은닉층의 출력을 하위은닉층으로 회귀할 때 인식성능이 가장 우수하며, 각 망 공히 상, 하위은닉층의 뉴런 10 혹은 15개, 예측차수 3 혹은 4차일 때 인식률이 양호하다. 학습시 연결세기의 초기치를 -0.5에서 0.5사이로 설정하고, 하위은닉층에서 단극성 시그모이드 전달함수를 사용할 때 인식성능이 더욱 향상된다.

  • PDF

An Automatic Diagnosis System for Hepatitis Diseases Based on Genetic Wavelet Kernel Extreme Learning Machine

  • Avci, Derya
    • Journal of Electrical Engineering and Technology
    • /
    • 제11권4호
    • /
    • pp.993-1002
    • /
    • 2016
  • Hepatitis is a major public health problem all around the world. This paper proposes an automatic disease diagnosis system for hepatitis based on Genetic Algorithm (GA) Wavelet Kernel (WK) Extreme Learning Machines (ELM). The classifier used in this paper is single layer neural network (SLNN) and it is trained by ELM learning method. The hepatitis disease datasets are obtained from UCI machine learning database. In Wavelet Kernel Extreme Learning Machine (WK-ELM) structure, there are three adjustable parameters of wavelet kernel. These parameters and the numbers of hidden neurons play a major role in the performance of ELM. Therefore, values of these parameters and numbers of hidden neurons should be tuned carefully based on the solved problem. In this study, the optimum values of these parameters and the numbers of hidden neurons of ELM were obtained by using Genetic Algorithm (GA). The performance of proposed GA-WK-ELM method is evaluated using statical methods such as classification accuracy, sensitivity and specivity analysis and ROC curves. The results of the proposed GA-WK-ELM method are compared with the results of the previous hepatitis disease studies using same database as well as different database. When previous studies are investigated, it is clearly seen that the high classification accuracies have been obtained in case of reducing the feature vector to low dimension. However, proposed GA-WK-ELM method gives satisfactory results without reducing the feature vector. The calculated highest classification accuracy of proposed GA-WK-ELM method is found as 96.642 %.

인공신경망을 이용한 드레이프성 예측 (Prediction of Fabric Drape Using Artificial Neural Networks)

  • 이소민;유동주;신보나;윤선영;심명희;윤창상
    • 한국의류학회지
    • /
    • 제45권6호
    • /
    • pp.978-985
    • /
    • 2021
  • This study aims to propose a prediction model for the drape coefficient using artificial neural networks and to analyze the nonlinear relationship between the drape properties and physical properties of fabrics. The study validates the significance of each factor affecting the fabric drape through multiple linear regression analysis with a sample size of 573. The analysis constructs a model with an adjusted R2 of 77.6%. Seven main factors affect the drape coefficient: Grammage, extruded length values for warp and weft (mwarp, mweft), coefficients of quadratic terms in the tensile-force quadratic graph in the warp, weft, and bias directions (cwarp, cweft, cbias), and force required for 1% tension in the warp direction (fwarp). Finally, an artificial neural network was created using seven selected factors. The performance was examined by increasing the number of hidden neurons, and the most suitable number of hidden neurons was found to be 8. The mean squared error was .052, and the correlation coefficient was .863, confirming a satisfactory model. The developed artificial neural network model can be used for engineering and high-quality clothing design. It is expected to provide essential data for clothing appearance, such as the fabric drape.

비단조 뉴런 모델을 이용한 결정론적 볼츠만 머신 (Deterministic Boltzmann Machine Based on Nonmonotonic Neuron Model)

  • 강형원;박철영
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅲ
    • /
    • pp.1553-1556
    • /
    • 2003
  • In this paper, We evaluate the learning ability of non-monotonic DBM(Deterministic Boltzmann Machine) network through numerical simulations. The simulation results show that the proposed system has higher performance than monotonic DBM network model. Non-monotonic DBM network also show an interesting result that network itself adjusts the number of hidden layer neurons. DBM network can be realized with fewer components than other neural network models. These results enhance the utilization of non-monotonic neurons in the large scale integration of neuro-chips.

  • PDF