• Title/Summary/Keyword: Backpropagation algorithm

Search Result 351, Processing Time 0.029 seconds

Fraud Detection in E-Commerce

  • Alqethami, Sara;Almutanni, Badriah;AlGhamdi, Manal
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.200-206
    • /
    • 2021
  • Fraud in e-commerce transaction increased in the last decade especially with the increasing number of online stores and the lockdown that forced more people to pay for services and groceries online using their credit card. Several machine learning methods were proposed to detect fraudulent transaction. Neural networks showed promising results, but it has some few drawbacks that can be overcome using optimization methods. There are two categories of learning optimization methods, first-order methods which utilizes gradient information to construct the next training iteration whereas, and second-order methods which derivatives use Hessian to calculate the iteration based on the optimization trajectory. There also some training refinements procedures that aims to potentially enhance the original accuracy while possibly reduce the model size. This paper investigate the performance of several NN models in detecting fraud in e-commerce transaction. The backpropagation model which is classified as first learning algorithm achieved the best accuracy 96% among all the models.

A Method on the Learning Speed Improvement of the Online Error Backpropagation Algorithm in Speech Processing (음성처리에서 온라인 오류역전파 알고리즘의 학습속도 향상방법)

  • 이태승;이백영;황병원
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.5
    • /
    • pp.430-437
    • /
    • 2002
  • Having a variety of good characteristics against other pattern recognition techniques, the multilayer perceptron (MLP) has been widely used in speech recognition and speaker recognition. But, it is known that the error backpropagation (EBP) algorithm that MLP uses in learning has the defect that requires restricts long learning time, and it restricts severely the applications like speaker recognition and speaker adaptation requiring real time processing. Because the learning data for pattern recognition contain high redundancy, in order to increase the learning speed it is very effective to use the online-based learning methods, which update the weight vector of the MLP by the pattern. A typical online EBP algorithm applies the fixed learning rate for each update of the weight vector. Though a large amount of speedup with the online EBP can be obtained by choosing the appropriate fixed rate, firing the rate leads to the problem that the algorithm cannot respond effectively to different learning phases as the phases change and the number of patterns contributing to learning decreases. To solve this problem, this paper proposes a Changing rate and Omitting patterns in Instant Learning (COIL) method to apply the variable rate and the only patterns necessary to the learning phase when the phases come to change. In this paper, experimentations are conducted for speaker verification and speech recognition, and results are presented to verify the performance of the COIL.

Fuzzy Supervised Learning Algorithm by using Self-generation (Self-generation을 이용한 퍼지 지도 학습 알고리즘)

  • 김광백
    • Journal of Korea Multimedia Society
    • /
    • v.6 no.7
    • /
    • pp.1312-1320
    • /
    • 2003
  • In this paper, we consider a multilayer neural network, with a single hidden layer. Error backpropagation learning method used widely in multilayer neural networks has a possibility of local minima due to the inadequate weights and the insufficient number of hidden nodes. So we propose a fuzzy supervised learning algorithm by using self-generation that self-generates hidden nodes by the compound fuzzy single layer perceptron and modified ART1. From the input layer to hidden layer, a modified ART1 is used to produce nodes. And winner take-all method is adopted to the connection weight adaptation, so that a stored pattern for some pattern gets updated. The proposed method has applied to the student identification card images. In simulation results, the proposed method reduces a possibility of local minima and improves learning speed and paralysis than the conventional error backpropagation learning algorithm.

  • PDF

An Efficient Traning of Multilayer Neural Newtorks Using Stochastic Approximation and Conjugate Gradient Method (확률적 근사법과 공액기울기법을 이용한 다층신경망의 효율적인 학습)

  • 조용현
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.8 no.5
    • /
    • pp.98-106
    • /
    • 1998
  • This paper proposes an efficient learning algorithm for improving the training performance of the neural network. The proposed method improves the training performance by applying the backpropagation algorithm of a global optimization method which is a hybrid of a stochastic approximation and a conjugate gradient method. The approximate initial point for f a ~gtl obal optimization is estimated first by applying the stochastic approximation, and then the conjugate gradient method, which is the fast gradient descent method, is applied for a high speed optimization. The proposed method has been applied to the parity checking and the pattern classification, and the simulation results show that the performance of the proposed method is superior to those of the conventional backpropagation and the backpropagation algorithm which is a hyhrid of the stochastic approximation and steepest descent method.

  • PDF

Performance Comparison of Neural Network Algorithm for Shape Recognition of Welding Flaws (용접결함의 형상인식을 위한 신경회로망 알고리즘의 성능 비교)

  • 김재열;심재기;이동기;김창현;송경석;양동조
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2003.10a
    • /
    • pp.271-276
    • /
    • 2003
  • In this study, we compared backpropagation neural network(BPNN) with probabilistic neural network(PNN) as shape recognition algorithm of welding flaws. For this purpose, variables are applied the same to two algorithm. Here, feature variable is composed of time domain signal itself and frequency domain signal itself, Through this process, we comfirmed advantages/disadvantages of two algorithms and identified application methods of two algorithms.

  • PDF

Modeling of plasma etch process using genetic algorithm optimization of neural network initial weights (유전자 알고리즘-응용 역전파 신경망 웨이트 최적화 기법을 이용한 플라즈마 식각 공정 모델링)

  • Bae, Jung-Gi;Kim, Byung-Whan
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2004.11a
    • /
    • pp.272-275
    • /
    • 2004
  • 플라즈마 식각공정은 소자제조를 위한 미세 패턴닝 제작에 이용되고 있다. 공정 메커니즘의 정성적 해석, 최적화, 그리고 제어를 위해서는 컴퓨터 예측모델의 개발이 요구된다. 역전파 신경망 (backpropagation neural network-BPNN) 모델을 개발하는 데에는 다수의 학습인자가 관여하고 있으며, 가장 그 최적화가 어려운 학습인자는 초기웨이트이다. 모델개발시, 초기웨이트는 random 값으로 설정이 되며, 이로 인해 초기웨이트의 최적화가 어렵다. 본 연구에서는 유전자 알고리즘 (genetic algorithm-GA)을 이용하여 BPNN의 초기웨이트를 최적화하였으며, 이를 식각공정 모델링에 적용하여 평가하였다. 실리카 식각공정 데이터는 $2^3$ 인자 실험계획법을 이용하여 수집하였으며, GA에 관여하는 두 확률인자의 영향을 42 인자 실험계획법을 이용하여 최적화 하였다. 종래의 모델에 비해, 최적화된 모델은 실리카 식각률, Al 식각률, Al 선택비, 그리고 프로파일 응답에 대해서 각 기 24%, 13%,, 16%, 그리고 17%의 향상률을 보였다. 이는 제안된 최적화 기법이 플라즈마 모델의 예측성능을 증진하는데 효과적으로 응용될 수 있음을 의미한다.

  • PDF

A Study on the Adaptive Neural Network Filter for Signal Detection (신호 검출을 위한 적응형 신경망 필터에 관한 연구)

  • 안종구;추형석
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.5 no.2
    • /
    • pp.132-137
    • /
    • 2004
  • In this paper, the adaptive noise canceler using neural network with backpropagation is designed. The adaptive noise canceler using the least mean square algorithm has the large correlativity of the reference signal. The performance of the adaptive noise canceler shows the limitation when the information signal is relatively small to the noise. The system proposed in this paper plays an important role in denoising these signals. In addition, the experiments are carried out to analyze the effects of the number of hidden layers and nodes about the system. The performance of the proposed adaptive noise canceler is compared with that of the system which is used the least mean square algorithm.

  • PDF

Performance Comparison of Neural Network Algorithm for Shape Recognition of Welding Flaws (초음파 검사 기반의 용접결함 분류성능 개선에 관한 연구)

  • 김재열;윤성운;김창현;송경석;양동조
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2004.04a
    • /
    • pp.287-292
    • /
    • 2004
  • In this study, we made a comparative study of backpropagation neural network and probabilistic neural network and bayesian classifier and perceptron as shape recognition algorithm of welding flaws. For this purpose, variables are applied the same to four algorithms. Here, feature variable is composed of time domain signal itself and frequency domain signal itself, Through this process, we confirmed advantages/disadvantages of four algorithms and identified application methods of few algorithms.

  • PDF

Pan Evaporation Modeling using Cascade-Correlation Algorithm (Cascade-Correlation Algorithm을 이용한 증발접시 증발량의 모형화)

  • Kim, Seong-Won
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2005.05b
    • /
    • pp.766-770
    • /
    • 2005
  • Cascade-Correlation Neural Networks Model(CCNNM) is used to estimate daily evaporation using limited climatical variables such as atmospheric temperature, dewpoint temperature, relative humidity, wind speed, sunshine duration and radiation. DeBruln equation is applied to estimate daily free-surface evaporation. It is converted into pan evaporation using pan coefficient. The results of CCNNM shows better than those of Debruin equation. This research represents that the strong nonlinear relationship such as evaporation modeling can be generalized by the CCNNM ; a special type of Backpropagation algorithm Neural Networks Model.

  • PDF

An Efficient Fault-diagnosis of Digital Circuits Using Multilayer Neural Networks (다층신경망을 이용한 디지털회로의 효율적인 결함진단)

  • 조용현;박용수
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.1033-1036
    • /
    • 1999
  • This paper proposes an efficient fault diagnosis for digital circuits using multilayer neural networks. The efficient learning algorithm is also proposed for the multilayer neural network, which is combined the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The fault-diagnosis system using the multilayer neural network of the proposed algorithm has been applied to the parity generator circuit. The simulation results shows that the proposed system is higher convergence speed and rate, in comparision with system using the backpropagation algorithm based on the gradient descent.

  • PDF