505bd3fe-7fa2-42ad-b26a-06dfbaab6acf20210318082717527wseamdt@crossref.orgMDT DepositWSEAS TRANSACTIONS ON SYSTEMS AND CONTROL1991-876310.37394/23203http://wseas.org/wseas/cms.action?id=4073220202022020201510.37394/23203.2020.15http://wseas.org/wseas/cms.action?id=23195An Adaptive Differential Evolution Algorithm with Restart for Solving Continuous Optimization ProblemsJeerayutWetweerapongDepartmentof Mathematics, Faculty of Science, Khon Kaen University, Khon Kaen, THAILANDPikulPuphasukDepartmentof Mathematics, Faculty of Science, Khon Kaen University, Khon Kaen, THAILANDA new adaptive differential evolution algorithm with restart (ADE-R) is proposed as a general-purpose method for solving continuous optimization problems. Its design aims at simplicity of use, efficiency and robustness. ADE-R simulates a population evolution of real vectors using vector mixing operations with an adaptive parameter control based on the switching of two selected intervals of values for each scaling factor and crossover rate of the basic differential evolution algorithm. It also incorporates a restart technique to supply new contents to the population to prevent premature convergence and stagnation. The method is tested on several benchmark functions covering various types of functions and compared with some well-known and state-of-art methods. The experimental results show that ADE-R is effective and outperforms the compared methods.62520206252020254269https://www.wseas.org/multimedia/journals/control/2020/a545103-955.pdf10.37394/23203.2020.15.27https://www.wseas.org/multimedia/journals/control/2020/a545103-955.pdf10.1016/j.swevo.2013.11.003S. J.Nanda and G.Panda, A survey on nature inspired metaheuristic algorithms for partitional clustering, Swarm and Evolutionary Computation, 16, 2014, pp. 1-18.10.1016/j.asoc.2015.12.001A. José-Garcíaand W. Gómez-Flores, Automatic clustering using nature-inspired metaheuristics: A survey, Applied Soft Computing, 41, 2016, pp. 192-213.10.1007/s11063-007-9048-7L.Hamm, B. W.Brorsen and M. T.Hagan, Comparison of stochastic global optimization methods to estimate neural network weights, Neural Process Lett, 26, 2007, pp. 145-158.10.1016/j.asoc.2014.03.039A. P. Piotrowski, Differential evolution algorithms applied to neural network training suffer from stagnation,Applied Soft Computing, 21, 2014, pp. 382-406.G.Venter, Review of optimization techniques, in: R. Blockley, S. Wei (eds.), Encyclopedia of aerospace engineering, Wiley and Sons, 2010.10.1016/j.ins.2013.02.041I.Boussaïd, J.Lepagnot and P.Siarry, A survey on optimization metaheuristics, Information sciences, 237, 2013, pp. 82-117.R.Storn and K.Price, Differential evolution: A simple and efficient heuristic for global optimization over continuous spaces, J Glob Optim, 11(4), 1997, pp. 341-359.S. Das and P. N. Suganthan, Differential evolution: Asurvey of the state-of-the-art, IEEE Trans Evol Comput, 15(1), 2011, pp.4-31.10.1016/j.swevo.2016.01.004S. Das, S.S.Mullick and P.Suganthan, Recent advances in differential evolution -An updated survey, Swarm Evol. Comput, 27, 2016, pp. 1-30.R. Storn and K. Price, Differential evolution a simple and efficient adaptive scheme for global optimization over continuous spaces, Technical Report TR-95-012, ICSI, 1995.10.1007/978-3-540-68830-3_1R.Storn, Differential evolution research-trends and open questions, in: U. K.Chakraborty (ed.), Advances in Differential Evolution, Springer, 2008, pp. 1-31.10.1007/s10462-009-9137-2F. Neri and V.Tirronen, Recent advances in differential evolution: A survey and experimental analysis, Artif Intell Rev, 33, 2010, pp. 61-106.T. Eltaeib and A. Mahmood, Differential Evolution: A Survey and Analysis, Applied Sciences, 8(10), 2018, pp. 1945.T. BäckandH. P. Schwefel, An overview of evolutionary algorithms for parameter optimization, Evol. Comput, 1(1),1993, pp. 1-23.J.Lampinen and I.Zelinka, On stagnation of the differential evolution algorithm, in: R. Matouek, P. Omera (eds.), Proceedings of Mendel 2000, 6th international conference on soft computing, 2000, pp. 76-83.R.Gamperle, S. D.Muller and P.Koumoutsakos, A parameter study for differential evolution, in: A. Gremla, N. E. Mastorakis (eds.), Advances in intelligent systems,fuzzy systems, evolutionary computation, WSEAS Press, 2002, pp. 293-298.D. Zaharie, Critical values for control parameters of differential evolution algorithm,Proceedings of the 8th international Mendel conference on soft computing, 2002, pp. 62-67.D. Zaharie, Control of population diversity and adaptation in differential evolution algorithms, Proceedings of the 9th international Mendel conference on soft computing, 2003, pp. 41-46.A. P. Piotrowski, Review of differential evolution population size, Swarm Evol. Comput., 32,2017,pp. 1-24.10.1109/sde.2013.6601435T. C. Chiang, C. N. Chen and Y. C. Lin, Parameter control mechanisms in differential evolution: a tutorial review and taxonomy, 2013IEEE symposium on differential evolution (SDE), 2013, pp. 1-8.10.1016/j.swevo.2018.03.008R. D. Al-Dabbagh, F. Neri, N. Idris, and M. S. Baba, Algorithmic design issues in adaptive differential evolution schemes: Reviewand taxonomy, Swarm Evol. Comput., 43, 2018, pp. 284-311.10.1109/4235.771166A. E. Eiben, R. Hinterding, and Z. Michalewicz, Parameter control in evolutionary algorithms, IEEE Trans. Evol. Comput., 3(2), 1999, pp. 124-141.10.1007/s00500-004-0363-xJ. Liu and J. Lampinen, A fuzzy adaptive differential evolution algorithm, Soft Comput, 9(6), 2005, pp. 448-462.10.1109/tevc.2006.872133J. Brest, S. Greiner, B. Boskovic, M. Mernik, and V. Zumer, Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems, Evol. Comput. IEEE Trans., 10(6), 2006, pp. 646-657.10.1109/cec.2005.1554904A. K. Qin and P. N. Suganthan, Self-adaptive differential evolution algorithm for numerical optimization, Proceedings of the 2005 IEEE congress on evolutionary computation, 2, 2005, pp. 1785-1791.10.1109/tevc.2008.927706A. K. Qin, V. L. Huang, and P. N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Trans Evol Comput, 13(2), 2009, pp. 398-417.10.1109/tevc.2009.2014613J. Q. Zhang and A. C. Sanderson, JADE: adaptive differential evolution with optional external archive, IEEE Trans. Evol. Comput., 13(5),2009, pp. 945-958.10.1515/jaiscr-2016-0009M. Leon and N. Xiong, Adapting differential evolution algorithms for continuous optimization via greedy adjustment of control parameters, Journal of artificial intelligence and soft computing research,6(2),2016,pp. 103-118.10.1016/j.swevo.2018.06.010K. Opara and J. Arabas, Differential Evolution: A survey of theoretical analyses, Swarm Evol. Comput., 44, 2019, pp. 546-558.Z. Hu, Q. Su, X. Yang, and Z. Xiong, Not guaranteeing convergence of differential evolution on a class of multimodal functions, Appl. Soft Comput., 41, 2016, pp. 479-487.Z. Hu, S. Xiong, Q. Su, and Z. Fang, Finite Markov chain analysis of classical differential evolution algorithm, J. Comput. Appl. Math., 268, 2014, pp. 121-134.Y.Wang and J. Zhang, Global optimization by an improved differential evolutionary algorithm, Appl. Math. Comput., 188(1), 2007, pp. 669-680.P. N. Suganthan, N. Hansen, J. J. Liang, K. Deb, Y. P. Chen, A. Auger, and S. Tiwari, Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization, Nanyang Technol. Univ., Singapore, Tech. Rep. KanGAL #2005005, IIT Kanpur, India, 2005.10.1016/j.ipl.2011.06.002W. Gao and S. Liu, Improved artificial bee colony algorithm for global optimization, Information Processing Letters, 111,2011, pp. 871-882.10.1109/cec.1999.785511Y. Shi and R. C. Eberhart, Empirical study of particle swarm optimization, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99,1999,pp. 1945-1950.10.1016/j.asoc.2007.05.007D. Karaboga and B. Basturk, On the performance of artificial bee colony (ABC)algorithm, Applied Soft Computing,8, 2008, pp. 687-697.10.1007/s00366-011-0241-yA. H. Gandomi, X. S. Yang, and A. H. Alavi, Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems, Engineering with Computers, 29, 2013, pp. 17-35.10.1504/ijbic.2013.058910X. S. Yang, C. Huyck, M. Karamanoglu, and N. Khan, True global optimality of the pressure vessel design problem: A benchmark for bio-inspired optimization algorithms, International Journal of Bio-Inspired Computation (IJBIC), 5(6), 2013, pp. 329-335.