• Title/Summary/Keyword: BP algorithm

Search Result 235, Processing Time 0.029 seconds

Dynamic Neural Units and Genetic Algorithms With Applications to the Optimal Control of Nonlinear Systems (신경망과 유전 알고리즘을 사용한 비선형 시스템의 최적 제어)

  • Cho Hyeon-Seob;Min Jin-Kyoung;Lee Hyung-Chung
    • Proceedings of the KAIS Fall Conference
    • /
    • 2004.06a
    • /
    • pp.217-220
    • /
    • 2004
  • 'Dynamic Neural Unit'(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised loaming algorithms, such as the backpropagation (BP) algorithm, that needs training information In each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin.

  • PDF

A Component-wise Load Forecasting by Adaptable Artificial Neural Network (적응력을 갖는 신경회로망에 의한 성분별 부하 예측)

  • Lim, Jae-Yoon;Kim, Jin-Soo;Kim, Jung-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 1994.11a
    • /
    • pp.21-23
    • /
    • 1994
  • The degree of forecast accuracy with BP-algorithm largely depends upon the neuron number in hidden layer. In order to construct the optimal structure, first, we prescribe the error bounds of learning procedure, and then, we provid the method of incrementing the number of hidden neurons by using the derivative of errors with respect to an output neuron weights. For the case study, we apply the proposed method to forecast the component-wise residential load, and compare this results to that of time series forecasting.

  • PDF

Uncertainty-Compensating Neural Network Control for Nonlinear Systems (비선형 시스템의 불확실성을 보상하는 신경회로망 제어)

  • Cho, Hyun-Seob;Oh, Myoung-Kwan
    • Proceedings of the KAIS Fall Conference
    • /
    • 2008.05a
    • /
    • pp.152-156
    • /
    • 2008
  • We consider the problem of constructing observers for nonlinear systems with unknown inputs. Connectionist networks, also called neural networks, have been broadly applied to solve many different problems since McCulloch and Pitts had shown mathematically their information processing ability in 1943. In this thesis, we present a genetic neuro-control scheme for nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

  • PDF

Efficient Neural Network for Downscaling climate scenarios

  • Moradi, Masha;Lee, Taesam
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2018.05a
    • /
    • pp.157-157
    • /
    • 2018
  • A reliable and accurate downscaling model which can provide climate change information, obtained from global climate models (GCMs), at finer resolution has been always of great interest to researchers. In order to achieve this model, linear methods widely have been studied in the past decades. However, nonlinear methods also can be potentially beneficial to solve downscaling problem. Therefore, this study explored the applicability of some nonlinear machine learning techniques such as neural network (NN), extreme learning machine (ELM), and ELM autoencoder (ELM-AE) as well as a linear method, least absolute shrinkage and selection operator (LASSO), to build a reliable temperature downscaling model. ELM is an efficient learning algorithm for generalized single layer feed-forward neural networks (SLFNs). Its excellent training speed and good generalization capability make ELM an efficient solution for SLFNs compared to traditional time-consuming learning methods like back propagation (BP). However, due to its shallow architecture, ELM may not capture all of nonlinear relationships between input features. To address this issue, ELM-AE was tested in the current study for temperature downscaling.

  • PDF

A Heuristic Algorithm for the Two-Dimensional Bin Packing Problem Using a Fitness Function (적합성 함수를 이용한 2차원 저장소 적재 문제의 휴리스틱 알고리즘)

  • Yon, Yong-Ho;Lee, Sun-Young;Lee, Jong-Yun
    • The KIPS Transactions:PartB
    • /
    • v.16B no.5
    • /
    • pp.403-410
    • /
    • 2009
  • The two-dimensional bin packing problem(2D-BPP) has been known to be NP-hard, and it is difficult to solve the problem exactly. Many approximation methods, such as genetic algorithm, simulated annealing and tabu search etc, have been also proposed to gain better solutions. However, the existing approximation algorithms, such as branch-and-bound and tabu search, have shown the low efficiency and the long execution time due to a large of iterations. To solve these problems, we first define the fitness function to simplify and increase the utility of algorithm. The function decides whether an item is packed into a given area, and as an important information for a packing strategy, the number of subarea that can accommodate a given item is obtained from the variant of the fitness function. Then we present a heuristic algorithm BF for 2D bin packing, constructed by the fitness function and subarea. Finally, the effectiveness of the proposed algorithm will be expressed by the comparison experiments with the heuristic and the metaheuristic of the literatures. As comparing with existing heuristic algorithms and metaheuristic algorithms, it has been found that the packing rate of algorithm BP is the same as 97% as existing heuristic algorithms, FFF and FBS, or better than them. Also, it has been shown the same as 86% as tabu search algorithm or better.

The combination of a histogram-based clustering algorithm and support vector machine for the diagnosis of osteoporosis

  • Kavitha, Muthu Subash;Asano, Akira;Taguchi, Akira;Heo, Min-Suk
    • Imaging Science in Dentistry
    • /
    • v.43 no.3
    • /
    • pp.153-161
    • /
    • 2013
  • Purpose: To prevent low bone mineral density (BMD), that is, osteoporosis, in postmenopausal women, it is essential to diagnose osteoporosis more precisely. This study presented an automatic approach utilizing a histogram-based automatic clustering (HAC) algorithm with a support vector machine (SVM) to analyse dental panoramic radiographs (DPRs) and thus improve diagnostic accuracy by identifying postmenopausal women with low BMD or osteoporosis. Materials and Methods: We integrated our newly-proposed histogram-based automatic clustering (HAC) algorithm with our previously-designed computer-aided diagnosis system. The extracted moment-based features (mean, variance, skewness, and kurtosis) of the mandibular cortical width for the radial basis function (RBF) SVM classifier were employed. We also compared the diagnostic efficacy of the SVM model with the back propagation (BP) neural network model. In this study, DPRs and BMD measurements of 100 postmenopausal women patients (aged >50 years), with no previous record of osteoporosis, were randomly selected for inclusion. Results: The accuracy, sensitivity, and specificity of the BMD measurements using our HAC-SVM model to identify women with low BMD were 93.0% (88.0%-98.0%), 95.8% (91.9%-99.7%) and 86.6% (79.9%-93.3%), respectively, at the lumbar spine; and 89.0% (82.9%-95.1%), 96.0% (92.2%-99.8%) and 84.0% (76.8%-91.2%), respectively, at the femoral neck. Conclusion: Our experimental results predict that the proposed HAC-SVM model combination applied on DPRs could be useful to assist dentists in early diagnosis and help to reduce the morbidity and mortality associated with low BMD and osteoporosis.

Recognition of Car Plate using Gray Brightness Variation, HSI Information and Enhanced ART2 Algorithm (명암도 변화 및 HSI 정보와 개선된 ART2 알고리즘을 이용한 차량 번호판 인식)

  • 김광백;김영주
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.5
    • /
    • pp.379-387
    • /
    • 2001
  • We proposed an enhanced extraction method of vehicle plate, in which both the brightness variation of gray and the Hue value of HSI color model were used. For the extraction of the vehicle plate from a vehicle image, first of all, candidate regions for the vehicle plate were extracted from the image by using the property of brightness variation of the image. A real place region was determined among candidate regions by the density of pixels with the Hue value of green and white. For- extracting the feature area containing characters from the extracted vehicle plate, we used the histogram-based approach of individual characters. And we proposed and applied for the recognition of characters the enhanced ART2 algorithm which support the dynamical establishment of the vigilance threshold with the genera]iced union operator of Yager. In addition, we propose an enhanced SOSL algorithm which is integrated both enhanced ART2 and supervised learning methods. The performance evaluation was performed using 100's real vehicle images and the evaluation results demonstrated that the extraction rates of tole proposed extraction method were improved, compared with that of previous methods based un brightness variation, RGB and HSI individually . Furthermore, the recognition rates of the proposed algorithms were improved much more than that of the conventional ART2 and BP algorithms.

  • PDF

Optimization of Process Parameters of Incremental Sheet Forming of Al3004 Sheet Using Genetic Algorithm-BP Neural Network (유전 알고리즘-BP신경망을 이용한 Al3004 판재 점진성형 공정변수에 대한 최적화 연구)

  • Yang, Sen;Kim, Young-Suk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.1
    • /
    • pp.560-567
    • /
    • 2020
  • Incremental Sheet Forming (ISF) is a unique sheet-forming technique. The process is a die-less sheet metal manufacturing process for rapid prototyping and small batch production. In the forming process, the critical parameters affecting the formability of sheet materials are the tool diameter, step depth, feed rate, spindle speed, etc. This study examined the effects of these parameters on the formability in the forming of the varying wall angle conical frustum model for a pure Al3004 sheet with 1mm in thickness. Using Minitab software based on Back Propagation Neural Network (BPNN) and Genetic Algorithm (GA), a second order mathematical prediction model was established to predict and optimize the wall angle. The results showed that the maximum forming angle was 87.071° and the best combination of these parameters to give the best performance of the experiment is as follows: tool diameter of 6mm, spindle speed of 180rpm, step depth of 0.4mm, and feed rate of 772mm/min.

Research on Intelligent Game Character through Performance Enhancements of Physics Engine in Computer Games (컴퓨터 게임을 위한 물리 엔진의 성능 향상 및 이를 적용한 지능적인 게임 캐릭터에 관한 연구)

  • Choi Jong-Hwa;Shin Dong-Kyoo;Shin Dong-Il
    • The KIPS Transactions:PartB
    • /
    • v.13B no.1 s.104
    • /
    • pp.15-20
    • /
    • 2006
  • This paper describes research on intelligent game character through performance enhancements of physics engine in computer games. The algorithm that recognizes the physics situation uses momentum back-propagation neural networks. Also, we present an experiment and its results, integration methods that display optimum performance based on the physics situation. In this experiment on integration methods, the Euler method was shown to produce the best results in terms of fps in a simulation environment with collision detection. Simulation with collision detection was shown similar fps for all three methods and the Runge-kutta method was shown the greatest accuracy. In the experiment on physics situation recognition, a physics situation recognition algorithm where the number of input layers (number of physical parameters) and output layers (destruction value for the master car) is fixed has shown the best performance when the number of hidden layers is 3 and the learning count number is 30,000. Since we tested with rigid bodies only, we are currently studying efficient physics situation recognition for soft body objects.

Enhancement of Image Sharpness in X-ray Digital Tomosynthesis Using Self-Layer Subtraction Backprojection Method (관심 단층 제거 후 역투사법을 이용한 X-선 디지털 영상합성법에서의 단층영상 선명도 향상에 관한 연구)

  • Shon, Cheol-Soon;Cho, Min-Kook;Lim, Chang-Hwy;Cheong, Min-Ho;Kim, Ho-Kyung;Lee, Sung-Sik
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.27 no.1
    • /
    • pp.8-14
    • /
    • 2007
  • X-ray digital tomosynthesis is widely used in the nondestructive testing and evaluation, especially for the printed circuit boards (PCBs). In this study, we propose a simple method to reduce the blur artefact, frequently claimed in the conventional digital tomosynthesis based on SAA (shift-and-add) algorithm, and thus restore the image sharpness. The proposed method is basically based on the SAA, but has a correction procedure by finding blur artefacts from the forward-and back-projection for the firstly obtained, manipulated backprojection data. The manipulation is the replacement of the original data at the POI (plane-of-interest) by zeros. This method has been compared with the conventional SAA algorithm using the experimental measurements and Monte Carlo simulation for the designed PCB phantom. The comparison showed a much enhancement of sharpness in the images obtained from the proposed method.