• Title/Summary/Keyword: Large-scale optimization

Search Result 371, Processing Time 0.024 seconds

Multi-factor Evolution for Large-scale Multi-objective Cloud Task Scheduling

  • Tianhao Zhao;Linjie Wu;Di Wu;Jianwei Li;Zhihua Cui
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.4
    • /
    • pp.1100-1122
    • /
    • 2023
  • Scheduling user-submitted cloud tasks to the appropriate virtual machine (VM) in cloud computing is critical for cloud providers. However, as the demand for cloud resources from user tasks continues to grow, current evolutionary algorithms (EAs) cannot satisfy the optimal solution of large-scale cloud task scheduling problems. In this paper, we first construct a large- scale multi-objective cloud task problem considering the time and cost functions. Second, a multi-objective optimization algorithm based on multi-factor optimization (MFO) is proposed to solve the established problem. This algorithm solves by decomposing the large-scale optimization problem into multiple optimization subproblems. This reduces the computational burden of the algorithm. Later, the introduction of the MFO strategy provides the algorithm with a parallel evolutionary paradigm for multiple subpopulations of implicit knowledge transfer. Finally, simulation experiments and comparisons are performed on a large-scale task scheduling test set on the CloudSim platform. Experimental results show that our algorithm can obtain the best scheduling solution while maintaining good results of the objective function compared with other optimization algorithms.

Cooperative Coevolution Differential Evolution Based on Spark for Large-Scale Optimization Problems

  • Tan, Xujie;Lee, Hyun-Ae;Shin, Seong-Yoon
    • Journal of information and communication convergence engineering
    • /
    • v.19 no.3
    • /
    • pp.155-160
    • /
    • 2021
  • Differential evolution is an efficient algorithm for solving continuous optimization problems. However, its performance deteriorates rapidly, and the runtime increases exponentially when differential evolution is applied for solving large-scale optimization problems. Hence, a novel cooperative coevolution differential evolution based on Spark (known as SparkDECC) is proposed. The divide-and-conquer strategy is used in SparkDECC. First, the large-scale problem is decomposed into several low-dimensional subproblems using the random grouping strategy. Subsequently, each subproblem can be addressed in a parallel manner by exploiting the parallel computation capability of the resilient distributed datasets model in Spark. Finally, the optimal solution of the entire problem is obtained using the cooperation mechanism. The experimental results on 13 high-benchmark functions show that the new algorithm performs well in terms of speedup and scalability. The effectiveness and applicability of the proposed algorithm are verified.

OVERALL BENEFIT-DURATION OPTIMIZATION (OBDO) FOR OWNERS IN LARGE-SCALE CONSTRUCTION PROJECTS

  • Seng-Kiong Ting;Heng Pan
    • International conference on construction engineering and project management
    • /
    • 2005.10a
    • /
    • pp.780-785
    • /
    • 2005
  • This paper aims to consider an overall benefit-duration optimization (OBDO) problem for the sake of maximizing owner's economic benefits, whilst considering influences of schedule compression incurred opportunity income on the profitability of a large-scale construction project. Unlike previous schedule optimization models and techniques that have focused on project duration or cost minimization, with greater weight on contractors' interests, OBDO facilitates owner's economic benefits through overall benefit-duration optimization. In this paper, the objective function of OBDO model is formulated. An example is illustrated to prove the feasibility and practicability of the overall benefit-duration optimization problem. The significance of employing OBDO model and future research work are also described.

  • PDF

A Hybrid Mechanism of Particle Swarm Optimization and Differential Evolution Algorithms based on Spark

  • Fan, Debin;Lee, Jaewan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.12
    • /
    • pp.5972-5989
    • /
    • 2019
  • With the onset of the big data age, data is growing exponentially, and the issue of how to optimize large-scale data processing is especially significant. Large-scale global optimization (LSGO) is a research topic with great interest in academia and industry. Spark is a popular cloud computing framework that can cluster large-scale data, and it can effectively support the functions of iterative calculation through resilient distributed datasets (RDD). In this paper, we propose a hybrid mechanism of particle swarm optimization (PSO) and differential evolution (DE) algorithms based on Spark (SparkPSODE). The SparkPSODE algorithm is a parallel algorithm, in which the RDD and island models are employed. The island model is used to divide the global population into several subpopulations, which are applied to reduce the computational time by corresponding to RDD's partitions. To preserve population diversity and avoid premature convergence, the evolutionary strategy of DE is integrated into SparkPSODE. Finally, SparkPSODE is conducted on a set of benchmark problems on LSGO and show that, in comparison with several algorithms, the proposed SparkPSODE algorithm obtains better optimization performance through experimental results.

Parallel Topology Optimization on Distributed Memory System (분산 메모리 시스템에서의 병렬 위상 최적설계)

  • Lee Ki-Myung;Cho Seon-Ho
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2006.04a
    • /
    • pp.291-298
    • /
    • 2006
  • A parallelized topology design optimization method is developed on a distributed memory system. The parallelization is based on a domain decomposition method and a boundary communication scheme. For the finite element analysis of structural responses and design sensitivities, the PCG method based on a Krylov iterative scheme is employed. Also a parallelized optimization method of optimality criteria is used to solve large-scale topology optimization problems. Through several numerical examples, the developed method shows efficient and acceptable topology optimization results for the large-scale problems.

  • PDF

Structural Shape Optimization under Static Loads Transformed from Dynamic Loads (동하중으로부터 변환된 등가정하중을 통한 구조물의 형상최적설계)

  • Park, Ki-Jong;Lee, Jong-Nam;Park, Gyung-Jin
    • Proceedings of the KSME Conference
    • /
    • 2003.04a
    • /
    • pp.1262-1269
    • /
    • 2003
  • In structural optimization, static loads are generally utilized although real external forces are dynamic. Dynamic loads have been considered in only small-scale problems. Recently, an algorithm for dynamic response optimization using transformation of dynamic loads into equivalent static loads has been proposed. The transformation is conducted to match the displacement fields from dynamic and static analyses. The algorithm can be applied to large-scale problems. However, the application has been limited to size optimization. The present study applies the algorithm to shape optimization. Because the number of degrees of freedom of finite element models is usually very large in shape optimization, it is difficult to conduct dynamic response optimization with the conventional methods that directly threat dynamic response in the time domain. The optimization process is carried out via interfacing an optimization system and an analysis system for structural dynamics. Various examples are solved to verify the algorithm. The results are compared to the results from static loads. It is found that the algorithm using static loads transformed from dynamic loads based on displacement is valid even for very large-scale problems such as shape optimization.

  • PDF

Structural Shape Optimization under Static Loads Transformed from Dynamic Loads (동하중으로부터 변환된 등가정하중을 통한 구조물의 형상최적설계)

  • Park, Ki-Jong;Lee, Jong-Nam;Park, Gyung-Jin
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.27 no.8
    • /
    • pp.1363-1370
    • /
    • 2003
  • In structural optimization, static loads are generally utilized although real external forces are dynamic. Dynamic loads have been considered in only small-scale problems. Recently, an algorithm for dynamic response optimization using transformation of dynamic loads into equivalent static loads has been proposed. The transformation is conducted to match the displacement fields from dynamic and static analyses. The algorithm can be applied to large-scale problems. However, the application has been limited to size optimization. The present study applies the algorithm to shape optimization. Because the number of degrees of freedom of finite element models is usually very large in shape optimization, it is difficult to conduct dynamic response optimization with the conventional methods that directly threat dynamic response in the time domain. The optimization process is carried out via interfacing an optimization system and an analysis system for structural dynamics. Various examples are solved to verify the algorithm. The results are compared to the results from static loads. It is found that the algorithm using static loads transformed from dynamic loads based on displacement is valid even for very large-scale problems such as shape optimization.

Topology Optimization for a Knuckle Using Design Space Adjustment and Refinement (설계공간 조정과 세분화를 이용한 너클의 위상 최적설계)

  • Yu Yong-Gyun;Kwak Byung-Man;Jang In-Gwun
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.30 no.5 s.248
    • /
    • pp.595-601
    • /
    • 2006
  • Design space optimization using design space adjustment and refinement is used to optimize a knuckle in the suspension system of an automobile. This approach is a new efficient method for large-scale topology optimization by virtue of two reasons. First, design space adjustment including design space expansion and reduction is suitable for large-scale problems. Second, the design space refinement can be done globally or locally where and when necessary and thus is very effective in obtaining a target resolution with much less number of elements. Compliance minimization for a knuckle is considered with a realistic working condition to show the effectiveness and superiority of the new approach.

Large-scale Nonseparabel Convex Optimization:Smooth Case (대규모 비분리 콘벡스 최적화 - 미분가능한 경우)

  • 박구현;신용식
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.21 no.1
    • /
    • pp.1-17
    • /
    • 1996
  • There have been considerable researches for solving large-scale separable convex optimization ptoblems. In this paper we present a method for large-scale nonseparable smooth convex optimization problems with block-angular linear constraints. One of them is occurred in reconfiguration of the virtual path network which finds the routing path and assigns the bandwidth of the path for each traffic class in ATM (Asynchronous Transfer Mode) network [1]. The solution is approximated by solving a sequence of the block-angular structured separable quadratic programming problems. Bundle-based decomposition method [10, 11, 12]is applied to each large-scale separable quadratic programming problem. We implement the method and present some computational experiences.

  • PDF

Structural Optimization by Global-Local Approximations Structural Reanalysis based on Substructuring (부구조화 기반 전역-부분 근사화 구조재해석에 의한 구조최적화)

  • 김태봉;서상구;김창운
    • Journal of the Korean Society of Safety
    • /
    • v.12 no.3
    • /
    • pp.120-131
    • /
    • 1997
  • This paper presents an approximate reanalysis methods of structures based on substructuring for an effective optimization of large-scale structural systems. In most optimal design procedures the analysis of the structure must be repeated many times. In particular, one of the main obstacles in the optimization of structural systems are involved high computational cost and expended long time in the optimization of large-scale structures. The purpose of this paper is to evaluate efficiently the structural behavior of new designs using information from previous ones, without solving basic equations for successive modification in the optimal design. The proposed reanalysis procedure is combined Taylor series expansions which is a local approximation and reduced basis method which is a global approximation based on substructuring. This technique is to choose each of the terms of Taylor series expansions as the basis vector of reduced basis method in substructuring system which is one of the most effective analysis of large -scale structures. Several numerical examples illustrate the effectiveness of the solution process.

  • PDF