• Title/Summary/Keyword: Learning structure optimization

Search Result 148, Processing Time 0.024 seconds

The optimization of fuzzy neural network using genetic algorithms and its application to the prediction of the chaotic time series data (유전 알고리듬을 이용한 퍼지 신경망의 최적화 및 혼돈 시계열 데이터 예측에의 응용)

  • Jang, Wook;Kwon, Oh-Gook;Joo, Young-Hoon;Yoon, Tae-Sung;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.708-711
    • /
    • 1997
  • This paper proposes the hybrid algorithm for the optimization of the structure and parameters of the fuzzy neural networks by genetic algorithms (GA) to improve the behaviour and the design of fuzzy neural networks. Fuzzy neural networks have a distinguishing feature in that they can possess the advantage of both neural networks and fuzzy systems. In this way, we can bring the low-level learning and computational power of neural networks into fuzzy systems and also high-level, human like IF-THEN rule thinking and reasoning of fuzzy systems into neural networks. As a result, there are many research works concerning the optimization of the structure and parameters of fuzzy neural networks. In this paper, we propose the hybrid algorithm that can optimize both the structure and parameters of fuzzy neural networks. Numerical example is provided to show the advantages of the proposed method.

  • PDF

Genetic algorithm based deep learning neural network structure and hyperparameter optimization (유전 알고리즘 기반의 심층 학습 신경망 구조와 초모수 최적화)

  • Lee, Sanghyeop;Kang, Do-Young;Park, Jangsik
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.4
    • /
    • pp.519-527
    • /
    • 2021
  • Alzheimer's disease is one of the challenges to tackle in the coming aging era and is attempting to diagnose and predict through various biomarkers. While the application of various deep learning-based technologies as powerful imaging technologies has recently expanded across the medical industry, empirical design is not easy because there are various deep earning neural networks architecture and categorical hyperparameters that rely on problems and data to solve. In this paper, we show the possibility of optimizing a deep learning neural network structure and hyperparameters for Alzheimer's disease classification in amyloid brain images in a representative deep earning neural networks architecture using genetic algorithms. It was observed that the optimal deep learning neural network structure and hyperparameter were chosen as the values of the experiment were converging.

The Structure and Parameter Optimization of the Fuzzy-Neuro Controller (퍼지 신경망 제어기의 구조 및 매개 변수 최적화)

  • Chang, Wook;Kwon, Oh-Kook;Joo, Young-Hoon;Yoon, Tae-Sung;Park, Jin-Bae
    • Proceedings of the KIEE Conference
    • /
    • 1997.07b
    • /
    • pp.739-742
    • /
    • 1997
  • This paper proposes the structure and parameter optimization technique of fuzzy neural networks using genetic algorithm. Fuzzy neural network has advantages of both the fuzzy inference system and neural network. The determination of the optimal parameters and structure of the fuzzy neural networks, however, requires special efforts. To solve these problems, we propose a new learning method for optimization of fuzzy neural networks using genetic algorithm. It can optimize the structure and parameters of the entire fuzzy neural network globally. Numerical example is provided to show the advantages of the proposed method.

  • PDF

Evaluations of AI-based malicious PowerShell detection with feature optimizations

  • Song, Jihyeon;Kim, Jungtae;Choi, Sunoh;Kim, Jonghyun;Kim, Ikkyun
    • ETRI Journal
    • /
    • v.43 no.3
    • /
    • pp.549-560
    • /
    • 2021
  • Cyberattacks are often difficult to identify with traditional signature-based detection, because attackers continually find ways to bypass the detection methods. Therefore, researchers have introduced artificial intelligence (AI) technology for cybersecurity analysis to detect malicious PowerShell scripts. In this paper, we propose a feature optimization technique for AI-based approaches to enhance the accuracy of malicious PowerShell script detection. We statically analyze the PowerShell script and preprocess it with a method based on the tokens and abstract syntax tree (AST) for feature selection. Here, tokens and AST represent the vocabulary and structure of the PowerShell script, respectively. Performance evaluations with optimized features yield detection rates of 98% in both machine learning (ML) and deep learning (DL) experiments. Among them, the ML model with the 3-gram of selected five tokens and the DL model with experiments based on the AST 3-gram deliver the best performance.

Functionally Graded Structure Design for Heat Conduction Problems using Machine Learning (머신 러닝을 사용한 열전도 문제에 대한 기능적 등급구조 설계)

  • Moon, Yunho;Kim, Cheolwoong;Park, Soonok;Yoo, Jeonghoon
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.34 no.3
    • /
    • pp.159-165
    • /
    • 2021
  • This study introduces a topology optimization method for the simultaneous design of macro-scale structural configuration and unit structure variation to ensure effective heat conduction. Shape changes in the unit structure depending on its location within the macro-scale structure result in micro- as well as macro-scale design and enable better performance than using isotropic unit structures. They result in functionally graded composite structures combining both configurations. The representative volume element (RVE) method is applied to obtain various thermal conductivity properties of the multi-material based unit structure according to its shape change. Based on the RVE analysis results, the material properties of the unit structure having a certain shape can be derived using machine learning. Macro-scale topology optimization is performed using the traditional solid isotropic material with penalization method, while the unit structures composing the macro-structure can have various shapes to improve the heat conduction performance according to the simultaneous optimization process. Numerical examples of the thermal compliance minimization issue are provided to verify the effectiveness of the proposed method.

License Plate Detection with Improved Adaboost Learning based on Newton's Optimization and MCT (뉴턴 최적화를 통해 개선된 아다부스트 훈련과 MCT 특징을 이용한 번호판 검출)

  • Lee, Young-Hyun;Kim, Dae-Hun;Ko, Han-Seok
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.12
    • /
    • pp.71-82
    • /
    • 2012
  • In this paper, we propose a license plate detection method with improved Adaboost learning and MCT (Modified Census Transform). The MCT represents the local structure patterns as integer numbered feature values which has robustness to illumination change and memory efficiency. However, since these integer values are discrete, a lookup table is needed to design a weak classifier for Adaboost learning. Some previous research efforts have focused on minimization of exponential criterion for Adaboost optimization. In this paper, a method that uses MCT and improved Adaboost learning based on Newton's optimization to exponential criterion is proposed for license plate detection. Experimental results on license patch images and field images demonstrate that the proposed method yields higher performance of detection rates with low false positives than the conventional method using the original Adaboost learning.

An inverse approach based on uniform load surface for damage detection in structures

  • Mirzabeigy, Alborz;Madoliat, Reza
    • Smart Structures and Systems
    • /
    • v.24 no.2
    • /
    • pp.233-242
    • /
    • 2019
  • In this paper, an inverse approach based on uniform load surface (ULS) is presented for structural damage localization and quantification. The ULS is excellent approximation for deformed configuration of a structure under distributed unit force applied on all degrees of freedom. The ULS make use of natural frequencies and mode shapes of structure and in mathematical point of view is a weighted average of mode shapes. An objective function presented to damage detection is discrepancy between the ULS of monitored structure and numerical model of structure. Solving this objective function to find minimum value yields damage's parameters detection. The teaching-learning based optimization algorithm has been employed to solve inverse problem. The efficiency of present damage detection method is demonstrated through three numerical examples. By comparison between proposed objective function and another objective function which make use of natural frequencies and mode shapes, it is revealed present objective function have faster convergence and is more sensitive to damage. The method has good robustness against measurement noise and could detect damage by using the first few mode shapes. The results indicate that the proposed method is reliable technique to damage detection in structures.

Structure Optimization of a Feedforward Neural Controller using the Genetic Algorithm (유전 알고리즘을 이용한 전방향 신경망 제어기의 구조 최적화)

  • 조철현;공성곤
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.12
    • /
    • pp.95-105
    • /
    • 1996
  • This paper presents structure optimization of a feedforward neural netowrk controller using the genetic algorithm. It is important to design the neural network with minimum structure for fast response and learning. To minimize the structure of the feedforward neural network, a genralization of multilayer neural netowrks, the genetic algorithm uses binary coding for the structure and floating-point coding for weights. Local search with an on-line learnign algorithm enhances the search performance and reduce the time for global search of the genetic algorithm. The relative fitness defined as the multiplication of the error and node functions prevents from premature convergence. The feedforward neural controller of smaller size outperformed conventional multilayer perceptron network controller.

  • PDF

An Optimization Method of Neural Networks using Adaptive Regulraization, Pruning, and BIC (적응적 정규화, 프루닝 및 BIC를 이용한 신경망 최적화 방법)

  • 이현진;박혜영
    • Journal of Korea Multimedia Society
    • /
    • v.6 no.1
    • /
    • pp.136-147
    • /
    • 2003
  • To achieve an optimal performance for a given problem, we need an integrative process of the parameter optimization via learning and the structure optimization via model selection. In this paper, we propose an efficient optimization method for improving generalization performance by considering the property of each sub-method and by combining them with common theoretical properties. First, weight parameters are optimized by natural gradient teaming with adaptive regularization, which uses a diverse error function. Second, the network structure is optimized by eliminating unnecessary parameters with natural pruning. Through iterating these processes, candidate models are constructed and evaluated based on the Bayesian Information Criterion so that an optimal one is finally selected. Through computational experiments on benchmark problems, we confirm the weight parameter and structure optimization performance of the proposed method.

  • PDF

Optimal design of a wind turbine supporting system accounting for soil-structure interaction

  • Ali I. Karakas;Ayse T. Daloglua
    • Structural Engineering and Mechanics
    • /
    • v.88 no.3
    • /
    • pp.273-285
    • /
    • 2023
  • This study examines how the interaction between soil and a wind turbine's supporting system affects the optimal design. The supporting system resting on an elastic soil foundation consists of a steel conical tower and a concrete circular raft foundation, and it is subjected to wind loads. The material cost of the supporting system is aimed to be minimized employing various metaheuristic optimization algorithms including teaching-learning based optimization (TLBO). To include the influence of the soil in the optimization process, modified Vlasov and Gazetas elastic soil models are integrated into the optimization algorithms using the application programing interface (API) feature of the structural analysis program providing two-way data flow. As far as the optimal designs are considered, the best minimum cost design is achieved for the TLBO algorithm, and the modified Vlasov model makes the design economical compared with the simple Gazetas and infinitely rigid soil models. Especially, the optimum design dimensions of the raft foundation extremely reduce when the Vlasov realistic soil reactions are included in the optimum analysis. Additionally, as the designated design wind speed is decreased, the beneficial impact of soil interaction on the optimum material cost diminishes.