Balancing Exploration and Exploitation With Decomposition-Based Dynamic Multi-Objective Evolutionary Algorithm

Balancing Exploration and Exploitation With Decomposition-Based Dynamic Multi-Objective Evolutionary Algorithm

Qing Zhang, Ruwang Jiao, Sanyou Zeng, Zhigao Zeng
DOI: 10.4018/IJCINI.20211001.oa25
Article PDF Download
Open access articles are freely available for download

Abstract

Balancing exploration and exploitation is a crucial issue in evolutionary global optimization. This paper proposes a decomposition-based dynamic multi-objective evolutionary algorithm for addressing global optimization problems. In the proposed method, the niche count function is regarded as a helper objective to maintain the population diversity, which converts a global optimization problem to a multi-objective optimization problem (MOP). The niche-count value is controlled by the niche radius. In the early stage of evolution, a large niche radius promotes the population diversity for better exploration; in the later stage of evolution, a niche radius close to 0 focuses on convergence for better exploitation. Through the whole evolution process, the niche radius is dynamically decreased from a large value to zero, which can provide a sound balance between the exploration and exploitation. Experimental results on CEC 2014 benchmark problems reveal that the proposed algorithm is capable of offering high-quality solutions, in comparison with four state-of-the-art algorithms.
Article Preview
Top

1. Introduction

In most science, business, and engineering fields, global optimization problems often arise with the purpose of locating the global optimum. Many approaches have been proposed to deal with global optimization problems. Nevertheless, when the objective of global optimization problems is nonlinear, non-convex or non-differentiable, traditional mathematical approaches may become inefficient, or even fail to work. Evolutionary algorithm (EA) is a kind of population based iterative heuristic optimization paradigm. Over the last two decades, EAs have been widely studied and applied for many scientific and real-world optimization problems with promising results (Del, Osaba, & Molina, 2019). However, the basic EAs are easy to fall into some local optima when tackling complicated global optimization problems with a large number of local optima. Apparently, the key to solving global optimization problems using EAs is how to handle the relationship between the exploration and exploitation.

The exploration refers to the capability of an EA to investigate undiscovered regions in the decision space to find more potential solutions, while the exploitation means the ability of an EA to apply the knowledge of discovered promising solutions to further improve their fitness. A loss of exploration might result in stagnation in suboptimal areas, producing the effect known as premature convergence. By contrast, a low exploitation rate cannot make the population convergence to the global optimum. In practice, exploration and exploitation are conflicting with each other. Thus, in order to achieve good performances on global optimization problems, the exploration and exploitation abilities should be well balanced (Singh & Deep, 2019). It is extensively recognized that an EA should put more emphasis on exploration at the early stage of the evolution and high exploitation at the later stage of the evolution.

To balance the exploration and exploitation in EAs, this paper makes an attempt to adopt decomposition-based dynamic MOEA to solve complicated global optimization problems. Firstly, a global optimization problem is converted to a dynamic bi-objective optimization problem by taking the niche count function as a helper objective. Subsequently, a decomposition-based MOEA: MOEA/D-M2M (Liu, Gu, & Zhang, 2014), with DE operator (Storn & Price, 1997) is employed to solve the transformed dynamic bi-objective optimization problem. The dynamic version of MOEA/D-M2M is named DMOEA/D-M2M. DMOEA/D-M2M decomposes the converted bi-objective optimization problem into a number of bi-objective optimization subproblems which are easier to solve. In DMOEA/D-M2M, optimization of the original objective is beneficial to the population convergence while minimization of the niche-count objective is helpful to the population diversity. Throughout the entire evolution stage, the gradually-decreasing-to-zero niche radius is capable of achieving a tradeoff between exploration and exploitation.

The remainder of the paper is organized as follows. Section 2 briefly reviewed related works. Section 3 depicts some preliminary. Section 4 presents the dynamic multi-objective technique, which a global optimization problem is converted to a dynamic bi-objective optimization problem. Section 5 shows the detailed of proposed DMOEA/D-M2M algorithm. Section 6 conducts the experiments and makes a comparison of DMOEA/D-M2M with four competitors. Section 7 makes some further discussions. At last, Section 8 draws conclusions.

Complete Article List

Search this Journal:
Reset
Volume 18: 1 Issue (2024)
Volume 17: 1 Issue (2023)
Volume 16: 1 Issue (2022)
Volume 15: 4 Issues (2021)
Volume 14: 4 Issues (2020)
Volume 13: 4 Issues (2019)
Volume 12: 4 Issues (2018)
Volume 11: 4 Issues (2017)
Volume 10: 4 Issues (2016)
Volume 9: 4 Issues (2015)
Volume 8: 4 Issues (2014)
Volume 7: 4 Issues (2013)
Volume 6: 4 Issues (2012)
Volume 5: 4 Issues (2011)
Volume 4: 4 Issues (2010)
Volume 3: 4 Issues (2009)
Volume 2: 4 Issues (2008)
Volume 1: 4 Issues (2007)
View Complete Journal Contents Listing