Browse > Article
http://dx.doi.org/10.11627/jkise.2017.40.1.095

The Effect of Sample and Particle Sizes in Discrete Particle Swarm Optimization for Simulation-based Optimization Problems  

Yim, Dong-Soon (Department of Industrial and Management Engineering, Hannam University)
Publication Information
Journal of Korean Society of Industrial and Systems Engineering / v.40, no.1, 2017 , pp. 95-104 More about this Journal
Abstract
This paper deals with solution methods for discrete and multi-valued optimization problems. The objective function of the problem incorporates noise effects generated in case that fitness evaluation is accomplished by computer based experiments such as Monte Carlo simulation or discrete event simulation. Meta heuristics including Genetic Algorithm (GA) and Discrete Particle Swarm Optimization (DPSO) can be used to solve these simulation based multi-valued optimization problems. In applying these population based meta heuristics to simulation based optimization problem, samples size to estimate the expected fitness value of a solution and population (particle) size in a generation (step) should be carefully determined to obtain reliable solutions. Under realistic environment with restriction on available computation time, there exists trade-off between these values. In this paper, the effects of sample and population sizes are analyzed under well-known multi-modal and multi-dimensional test functions with randomly generated noise effects. From the experimental results, it is shown that the performance of DPSO is superior to that of GA. While appropriate determination of population sizes is more important than sample size in GA, appropriate determination of sample size is more important than particle size in DPSO. Especially in DPSO, the solution quality under increasing sample sizes with steps is inferior to constant or decreasing sample sizes with steps. Furthermore, the performance of DPSO is improved when OCBA (Optimal Computing Budget Allocation) is incorporated in selecting the best particle in each step. In applying OCBA in DPSO, smaller value of incremental sample size is preferred to obtain better solutions.
Keywords
Simulation-Based Optimization; Genetic Algorithm; Particle Swarm Optimization; Optimal Computing Budget Allocation;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Aizawa, A.N. and Wah, B.W., Dynamic Control of Genetic Algorithms in a Noisy Environment, Proceeding of the Fifth International Conference on Genetic Algorithms, 1993, pp. 103-115.
2 Bartz-Beielstein, T., Blum, D., and Branke, J., Particle Swarm Optimization and Sequential Sampling in Noisy Environments, Proceedings of the 6th Metaheuristics International Conference (MIC2005), 2005, pp. 89-94.
3 Branke, J., Schmidt, C., and Schmeck, H., Efficient Fitness Estimation in Noisy Environment, in Genetic and Evolutionary Computation, Spector, L. et al., Eds, Morgan Kaufman, 2001, pp. 243-250.
4 Chen, C.-H., Lin, J., Yucesan, E., and Chick, S.E., Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization, Discrete Event Dynamic Systems : Theory and Applications, Vol. 10, No. 3, 2000, pp. 251-270.   DOI
5 Fitzpatrick, J.M. and Grefenstette, J.I., Genetic Algorithm in Noisy Environments, Machine Learning, Vol. 3, No. 2, 1988, pp. 101-120.   DOI
6 Horng, S.-C., Yang, F.-Y., and Lin, S.-S., Applying PSO and OCBA to minimize the Overkills and Re-Probes in Wafer Probe Testing, IEEE Transactions on Semiconductor Manufacturing, Vol. 25, No. 3, 2012, pp. 531-540.   DOI
7 Jin, Y. and Branke, J., Evolutionary Optimization in Uncertain Environments-A Survey, IEEE Transactions on Evolutionary Computation, Vol. 9, No. 3, 2005, pp. 303-317.   DOI
8 Kennedy, J. and Eberhart, R.C., A Discrete Binary Version of the Particle Swarm Algorithm, IEEE International Conference on Systems, Man, and Cybernetics, 1997, pp. 4104-4108.
9 Miller, B.L. and Goldberg, D.E., Genetic Algorithms, Selection Schemes and the Varying Effects of Noise, Evolutionary Computation, Vol. 4, No. 2, 1996, pp. 113-131.   DOI
10 Pugh, J. and Martinoli, A., Discrete Multi-Valued Particle Swarm Optimization, Proceedings of IEEE Swarm Intelligence Symposium, 2006, pp. 103-110.
11 Rada-Juan, R.-V., Zhang, M., and Joknston, M., Optimal Computing Budget Allocation in Particle Swarm Optimization, GECCO '13, 2013, pp. 81-88.
12 Song, H., Diolata, R., and Joo, Y., Photovoltaic System Allocation Using Discrete Particle Swarm Optimization with Multi-level Quantization, Journal of Electrical Engineering and Technology, Vol. 4, No. 2, 2009, pp. 185-193.   DOI
13 Yim, D.S., Particle Swarm Optimization to Solve Multi-Valued Discrete Problems, Journal of the Society of Korea Industrial and Systems Engineering, 2013, Vol. 36, No. 3, pp. 63-70.   DOI
14 Veeramachaneni, K., Osadciw, L., and Kamath, G., Probabilistically Driven Particle Swarms for optimization of Multi Valued Discrete Problems : Design and Analysis, Proceedings of IEEE Swarm Intelligence Symposium, 2007, pp. 141-149.
15 Vesterstrom, J. and Thomsen, R., A Comparative Study of Differential Evolution, Particle Swarm Optimization, and Evolutionary Algorithms on Numerical Benchmark Problems, Evolutionary Computation CEC 2004 Congress, Vol. 2, 2004, pp. 1980-1987.
16 Yang, X.-S., Test Problems in Optimization, in Engineering Optimization : An Introduction with Metaheuristic Applications (Eds Xin-She Yang), John Wiley & Sons, 2010.
17 Pan, H., Wang, L., and Liu, B., Particle Swarm Optimization for Function Optimization in Noisy Environment, Applied mathematics and Computation, Vol. 181, No. 2, 2006, pp. 908-919.   DOI
18 Zhai, W., Kelly, P., and Gong, W.-B., Genetic Algorithms with Noisy Fitness, Mathematical and Computer Modeling, Vol. 23, No. 11/12, 1996, pp. 131-142.
19 Zhang, R., Song, S., and Wu, C., A Two stage hybrid particle swarm optimization algorithm for the stochastic job shop scheduling problem, Knowledge-Based Systems, Vol. 27, 2012, pp. 393-406.   DOI
20 Zhang, S., Chen, P., Lee, H.L., Peng, C.E., and Chen, C.-H., Simulation Optimization Using the Particle Swarm Optimization with Optimal Computing Budget Allocation, Proceedings of the 2011 Winter Simulation Conference, edited by Jain, S., Creasey, R.R., Himmelspach, J., White, K.P., Fu, M., 2011, pp. 4303-4313.