• 제목/요약/키워드: premature convergence problem

검색결과 44건 처리시간 0.026초

적응 군집화 기법과 유전 알고리즘을 이용한 영상 영역화 (Image segmentation using adaptive clustering algorithm and genetic algorithm)

  • 하성욱;강대성
    • 전자공학회논문지S
    • /
    • 제34S권8호
    • /
    • pp.92-103
    • /
    • 1997
  • This paper proposes a new gray-level image segmentation method using GA(genetic algorithm) and an ACA(adaptive clustering algorithm). The solution in the general GA can be moving because of stochastic reinsertion, and suffer from the premature convergence problem owing to deficiency of individuals before finding the optimal solution. To cope with these problems and to reduce processing time, we propose the new GBR algorithm and the technique that resolves the premature convergence problem. GBR selects the individual in the child pool that has the fitness value superior to that of the individual in the parents pool. We resolvethe premature convergence problem with producing the mutation in the parents population, and propose the new method that removes the small regions in the segmented results. The experimental results show that the proposed segmentation algorithm gives better perfodrmance than the ACA ones in Gaussian noise environments.

  • PDF

Derivative Evaluation and Conditional Random Selection for Accelerating Genetic Algorithms

  • Jung, Sung-Hoon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제5권1호
    • /
    • pp.21-28
    • /
    • 2005
  • This paper proposes a new method for accelerating the search speed of genetic algorithms by taking derivative evaluation and conditional random selection into account in their evolution process. Derivative evaluation makes genetic algorithms focus on the individuals whose fitness is rapidly increased. This accelerates the search speed of genetic algorithms by enhancing exploitation like steepest descent methods but also increases the possibility of a premature convergence that means most individuals after a few generations approach to local optima. On the other hand, derivative evaluation under a premature convergence helps genetic algorithms escape the local optima by enhancing exploration. If GAs fall into a premature convergence, random selection is used in order to help escaping local optimum, but its effects are not large. We experimented our method with one combinatorial problem and five complex function optimization problems. Experimental results showed that our method was superior to the simple genetic algorithm especially when the search space is large.

Fast Evolution by Multiple Offspring Competition for Genetic Algorithms

  • Jung, Sung-Hoon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제10권4호
    • /
    • pp.263-268
    • /
    • 2010
  • The premature convergence of genetic algorithms (GAs) is the most major factor of slow evolution of GAs. In this paper we propose a novel method to solve this problem through competition of multiple offspring of in dividuals. Unlike existing methods, each parents in our method generates multiple offspring and then generated multiple offspring compete each other, finally winner offspring become to real offspring. From this multiple offspring competition, our GA rarel falls into the premature convergence and easily gets out of the local optimum areas without negative effects. This makes our GA fast evolve to the global optimum. Experimental results with four function optimization problems showed that our method was superior to the original GA and had similar performances to the best ones of queen-bee GA with best parameters.

유전자 알고리즘에 대한 수렴특성의 개선 (Improvement of Convergence Properties for Genetic Algorithms)

  • 이홍규
    • 한국항행학회논문지
    • /
    • 제12권5호
    • /
    • pp.412-419
    • /
    • 2008
  • 유전자 알고리즘은 효과적으로 최적의 해를 구하는 기법이나 진화연상산자의 선정에 따라 조기에 국부 최적해에 고착되어 전역 최적해로의 탐색을 어렵게 하는 문제점을 가지고 있다. 본 논문에서는 국부 최적해로 수렴하게 되는 원인을 분석하고, 국부 최적해에서 벗어나 전역 최적해로의 천이가 가능하도록 하는 방법을 제안하였다. 본 논문에서 사용한 방법은 평균 해밍거리에 따라 진화연산자를 가변시키는 방법으로서 국부 최적해에 고착되지 않도록 유전자에 다양성을 부여하여 지속적으로 모집단의 진화 특성을 유지하는 방법이다. 제안된 방법은 시뮬레이션을 통하여 효용성을 입증하였다.

  • PDF

미소-유전 알고리듬을 이용한 오류 역전파 알고리듬의 학습 속도 개선 방법 (Speeding-up for error back-propagation algorithm using micro-genetic algorithms)

  • 강경운;최영길;심귀보;전홍태
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1993년도 한국자동제어학술회의논문집(국내학술편); Seoul National University, Seoul; 20-22 Oct. 1993
    • /
    • pp.853-858
    • /
    • 1993
  • The error back-propagation(BP) algorithm is widely used for finding optimum weights of multi-layer neural networks. However, the critical drawback of the BP algorithm is its slow convergence of error. The major reason for this slow convergence is the premature saturation which is a phenomenon that the error of a neural network stays almost constant for some period time during learning. An inappropriate selections of initial weights cause each neuron to be trapped in the premature saturation state, which brings in slow convergence speed of the multi-layer neural network. In this paper, to overcome the above problem, Micro-Genetic algorithms(.mu.-GAs) which can allow to find the near-optimal values, are used to select the proper weights and slopes of activation function of neurons. The effectiveness of the proposed algorithms will be demonstrated by some computer simulations of two d.o.f planar robot manipulator.

  • PDF

유전자알고리즘의 성능향상을 위한 선택적 돌연변이 (Selective Mutation for Performance Improvement of Genetic Algorithms)

  • 정성훈
    • 정보처리학회논문지B
    • /
    • 제17B권2호
    • /
    • pp.149-156
    • /
    • 2010
  • 유전자알고리즘의 조숙수렴현상(premature convergence phenomenon)은 유전자알고리즘의 성능을 크게 저하시키기 때문에 이 문제를 해결하는 것이 성능향상에 크게 영향을 준다. 본 논문에서는 유전자알고리즘의 조숙수렴현상을 완화하여 성능을 향상시키기 위한 선택적 돌연변이 방법을 제안한다. 선택적 돌연변이에서는 유전자알고리즘 개체의 등급에 따라서 염색체의 특정영역에 비트를 추가적으로 돌연변이 시킨다. 이렇게 함으로서 등급이 낮은 개체는 표현형 상에서 많은 변화가 일어나고 등급이 높은 개체는 작은 변화가 일어나게 된다. 결국 좋은 개체는 그 주변을 세부적으로 탐색하며 좋지 못한 개체는 새로운 영역을 탐색할 기회가 높아지게 되어 조숙수렴현상을 완화하면서 성능향상을 꾀할 수 있게 된다. 성능향상을 측정하기 위하여 4개의 대표적 함수 최적화 문제에 적용해서 제안한 방법의 성능을 측정하였다. 실험결과 기존의 유전자알고리즘보다 성능이 크게 향상됨을 확인하였다.

혼합 교차-엔트로피 알고리즘을 활용한 다수 에이전트-다수 작업 할당 문제 (Multi Agents-Multi Tasks Assignment Problem using Hybrid Cross-Entropy Algorithm)

  • 김광
    • 한국산업정보학회논문지
    • /
    • 제27권4호
    • /
    • pp.37-45
    • /
    • 2022
  • 본 논문에서는 대표적인 조합 최적화(combinatorial optimization) 문제인 다수 에이전트-다수 작업 할당 문제를 제시한다. 할당 문제의 목적은 각 작업의 달성률(achievement rate)의 합을 최대로 하는 에이전트-작업 할당을 결정하는 것이다. 달성률은 각 작업의 할당된 에이전트의 수에 따라 아래 오목 증가(concave down increasing)형태로 다루어지며, 본 할당 문제는 비선형(non-linearity)의 목적함수를 갖는 NP-난해(NP-hard) 문제로 표현된다. 본 논문에서는 할당 문제를 해결하기 위한 효과적이면서 효율적인 문제 해결 방법론으로 혼합 교차-엔트로피 알고리즘(hybrid cross-entropy algorithm)을 제안한다. 일반적인 교차-엔트로피 알고리즘은 문제 상황에 따라 느린 매개변수 업데이트 속도와 조기수렴(premature convergence)이 발생할 수 있다. 본 연구에서 제안하는 문제 해결 방법론은 이러한 단점의 발생 확률을 낮추도록 설계되었으며, 실험적으로도 우수한 성능을 보이는 알고리즘임을 수치실험을 통해 제시한다.

Fast Optimization by Queen-bee Evolution and Derivative Evaluation in Genetic Algorithms

  • Jung, Sung-Hoon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제5권4호
    • /
    • pp.310-315
    • /
    • 2005
  • This paper proposes a fast optimization method by combining queen-bee evolution and derivative evaluation in genetic algorithms. These two operations make it possible for genetic algorithms to focus on highly fitted individuals and rapidly evolved individuals, respectively. Even though the two operations can also increase the probability that genetic algorithms fall into premature convergence phenomenon, that can be controlled by strong mutation rates. That is, the two operations and the strong mutation strengthen exploitation and exploration of the genetic algorithms, respectively. As a result, the genetic algorithm employing queen-bee evolution and derivative evaluation finds optimum solutions more quickly than those employing one of them. This was proved by experiments with one pattern matching problem and two function optimization problems.

새로운 적응 유전 알고리즘을 이용한 배전계통계획의 최적경로탐색 (Optimal Routing for Distribution System Planning using New Adaptive GA)

  • 김민수;김병섭;이태형;신중린
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2000년도 하계학술대회 논문집 A
    • /
    • pp.137-141
    • /
    • 2000
  • This paper presents an application of a new Adaptive Genetic Algorithms(AGA) to solve the Optimal Routing problem(ORP) for distribution system planning. In general, since the ORP is modeled as a mixed integer problem with some various mathematical constraints, it is hard to solve the problem. In this paper, we proposed a new adaptive strategy in GA to overcome the premature convergence and improve the convergence efficiency. And for these purposes, we proposed a fitness function suited for the ORP. In the proposed AGA, we used specially designed adaptive probabilities for genetic operators to consider the characteristics of distribution systems that are operated under radial configuration. The proposed algorithm has been tested in sample networks and the results are presented.

  • PDF

A Novel Hybrid Intelligence Algorithm for Solving Combinatorial Optimization Problems

  • Deng, Wu;Chen, Han;Li, He
    • Journal of Computing Science and Engineering
    • /
    • 제8권4호
    • /
    • pp.199-206
    • /
    • 2014
  • The ant colony optimization (ACO) algorithm is a new heuristic algorithm that offers good robustness and searching ability. With in-depth exploration, the ACO algorithm exhibits slow convergence speed, and yields local optimization solutions. Based on analysis of the ACO algorithm and the genetic algorithm, we propose a novel hybrid genetic ant colony optimization (NHGAO) algorithm that integrates multi-population strategy, collaborative strategy, genetic strategy, and ant colony strategy, to avoid the premature phenomenon, dynamically balance the global search ability and local search ability, and accelerate the convergence speed. We select the traveling salesman problem to demonstrate the validity and feasibility of the NHGAO algorithm for solving complex optimization problems. The simulation experiment results show that the proposed NHGAO algorithm can obtain the global optimal solution, achieve self-adaptive control parameters, and avoid the phenomena of stagnation and prematurity.