Biogeography based optimization

Underlying principles

Mathematical models of biogeography describe speciation (the evolution of new species), the migration of species (animals, fish, birds, or insects) between islands, and the extinction of species. Islands that are friendly to life are said to have a high habitat suitability index (HSI). Features that correlate with HSI include rainfall, vegetative diversity, topographic diversity, land area, temperature, and others. The features that determine are called suitability index variables (SIVs). In terms of habitability, SIVs are the independent variables and HSI is the dependent variable.

Islands with a high HSI can support many species, and islands with a low HSI can support only a few species. Islands with a high HSI have many species that emigrate to nearby habitats because of the large populations and the large numbers of species that they host. Note that emigration from an island with a high HSI does not occur because species want to leave their home; after all, their home island is an attractive place to live. Emigration occurs because of the accumulation of random effects on a large number of species with large populations. Emigration occurs as animals ride flotsam, swim, fly, or ride the wind to neighboring islands. When a species emigrates from an island, it does not mean that the species completely disappears from its original island; only a few representatives emigrate, so an emigrating species remains present on its original island while at the same time migrating to a neighboring island. However, in BBO it is assumed that emigration from an island results in extinction from that island. This assumption is necessary in BBO because species represent the independent variables of a function, and each island represents a candidate solution to a function optimization problem.

Islands with a high HSI not only have a high emigration rate, but they also have a low immigration rate because they already support many species. Species that migrate to such islands will tend to die in spite of the island's high HSI, because there is too much competition for resources from other species.

Islands with a low HSI have a high immigration rate because of their low populations. Again, this is not because species want to immigrate to such islands; after all, these islands are undesirable places to live. The reason that immigration occurs to these islands is because there is a lot of room for additional species. Whether or not the immigrating species can survive in its new home, and for how long, is another question. However, species diversity is correlated with HSI, so when more species arrive at a low HSI island, the island's HSI will tend to increase.

The figure on the right illustrates an island migration model. The immigration rate λ and the emigration rate μ are functions of the number of species on the island. The maximum possible immigration rate I occurs when there are zero species on the island. As the number of species increases, the island becomes more crowded, fewer species are able to survive immigration, and the immigration rate decreases. The largest possible number of species that the habitat can support is S max , at which point the immigration rate is zero. If there are no species on the island, then the emigration rate is zero. As the number of species on the island increases, it becomes more crowded, more species representatives are able to leave the island, and the emigration rate increases. When the island contains the largest number of possible species S max , the emigration rate reaches its maximum possible value E .

In BBO, λ k is the probability that a given independent variable in the k -th candidate solution will be replaced; that is, λ k is the immigration probability of x k . If an independent variable is to be replaced, then the emigrating candidate solution is chosen with a probability that is proportional to the emigration probability μ k . This is usually performed using roulette wheel selection.

for j = 1 , ⋯ , N , where N is the number of candidate solutions in the population.

Algorithm

Like most other EAs, BBO includes mutation. A basic BBO algorithm with a population size of N for optimizing an n -dimensional function can be described as follows.

Initialize a population of N candidate solutions { x k } While not(termination criterion) For each x k , set emigration probability μ k ∝ fitness of x k , with μ k ∈ [ 0 , 1 ] For each x k , set immigration probability λ k = 1 − μ k { z k } ← { x k } For each individual z k ( k = 1 , ⋯ , N ) For each independent variable index s ∈ [ 1 , n ] Use λ k to probabilistically decide whether to immigrate to z k If immigrating then Use { μ i } to probabilistically select the emigrating individual x j z k ( s ) ← x j ( s ) End if Next independent variable index: s ← s + 1 Probabilistically mutate z k Next individual: k ← k + 1 { x k } ← { z k } Next generation

Discussion of the BBO algorithm

The population size N is a tuning parameter. If N is too small or too large, then the optimization performance of BBO will suffer. Typical implementations of BBO use a value of N somewhere between 20 and 200.

The initial population of candidate solutions { x k } k = 1 N is usually generated randomly. However, it could be generated in a problem-dependent way based on some reasonable guesses or previously-known good solutions to the optimization problem.

The termination criterion is problem-dependent, like in any other EA. In most applications the termination criterion is a generation count limit or a function evaluation limit (that is, how often the objective function is evaluated).

{ z k } is a temporary population so that all emigrating variables can originate from the population that is in place at the beginning of the generation, which is { x k } .

Algorithmic variations

Many variations have been proposed to the basic BBO algorithm, among which are the following.

Elitism is implemented in most EAs to make sure that the best candidate solution is not lost from one generation to the next. This can be implemented in a variety of ways, but one common way is to save the best candidate solutions at the beginning of each generation in a set E ; then replace the worst candidate solutions with E at the end of the generation, after migration and mutation have completed. The size of E is a tuning parameter, but E typically includes the best two individuals. Elitism was originally proposed for genetic algorithms by DeJong. Elitism can make a significant difference in the performance of BBO, and is highly recommended.

Duplicate replacement is often implemented in BBO. This is a procedure at the end of each generation that replaces duplicate individuals in the population. Scanning for duplicates can be computationally intensive because it is an O ( N 2 ) operation, so it is often performed only every few generations, rather than every generation.

Blending can be implemented in BBO. With blending, instead of replacing z k ( s ) in an immigrating candidate solution with x j ( s ) from the emigrating candidate solution, z k ( s ) is set equal to a linear combination of its original value and x j ( s ) :

where α ∈ [ 0 , 1 ] , and α = 0 corresponds to standard migration as shown in the algorithm above. Blended BBO is based on blended crossover in genetic algorithms, and has been shown to outperform standard BBO.

The BBO algorithm presented above is called partial immigration-based BBO because the immigrating candidate solution is selected before the emigrating candidate solution is selected, and migration for each independent variable in the immigrating candidate solution is performed independently of all other independent variables. Other approaches for selecting the immigrating and emigrating candidate solutions have also been proposed.

The migration curves in the above figure are linear, but nonlinear migration curves often give better performance.

Hybridization

BBO has been hybridized with several other EAs, including particle swarm optimization, differential evolution, evolution strategy, opposition-based computing, case-based reasoning, artificial bee colony algorithm, bacterial foraging optimization, harmony search, and the simplex algorithm.

BBO can be combined with local search to create a memetic algorithm that performs much better than BBO alone.

MATLAB

The following MATLAB code gives a BBO implementation for minimizing the 20-dimensional Rosenbrock function. Note that the following code is very basic, although it does include elitism. A serious BBO implementation should include some of the variations discussed above, such as duplicate replacement, blending, nonlinear migration, and local optimization.

R

"bbo: Biogeography-Based Optimization" is an R package for continuous BBO.

Extensions

BBO has been extended to noisy functions (that is, functions whose fitness evaluation is corrupted by noise); constrained functions; combinatorial functions; and multi-objective functions.

Mathematical analyses

BBO has been mathematically analyzed using Markov models and dynamic system models.

Applications

Scholars have applied BBO into various academic and industrial applications. They found BBO performed better than state-of-the-art global optimization methods.

For example, Wang et al. proved BBO performed equal performance with FSCABC but with simpler codes.

Yang et al. showed BBO was superior to GA, PSO, and ABC.