scispace - formally typeset
Open AccessJournal Article

Black-Box Search by Unbiased Variation.

Reads0
Chats0
TLDR
In this paper, a more restricted black-box model for optimisation of pseudo-Boolean functions is introduced, which captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others.
Abstract
The complexity theory for black-box algorithms, introduced by Droste, Jansen, and Wegener (Theory Comput. Syst. 39:525---544, 2006), describes common limits on the efficiency of a broad class of randomised search heuristics. There is an obvious trade-off between the generality of the black-box model and the strength of the bounds that can be proven in such a model. In particular, the original black-box model provides for well-known benchmark problems relatively small lower bounds, which seem unrealistic in certain cases and are typically not met by popular search heuristics. In this paper, we introduce a more restricted black-box model for optimisation of pseudo-Boolean functions which we claim captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others. The key concept worked out is an unbiased variation operator. Considering this class of algorithms, significantly better lower bounds on the black-box complexity are proved, amongst them an Ω(nlogn) bound for functions with unique optimum. Moreover, a simple unimodal function and plateau functions are considered. We show that a simple (1+1) EA is able to match the runtime bounds in several cases.

read more

Citations
More filters
Journal ArticleDOI

Tight Bounds on the Optimization Time of a Randomized Search Heuristic on Linear Functions

TL;DR: The standard mutation probability p = 1/n is optimal for all linear functions, and the (1+1) EA is found to be an optimal mutation-based algorithm that turns out to be surprisingly robust since the large neighbourhood explored by the mutation operator does not disrupt the search.
Journal ArticleDOI

From black-box complexity to designing new genetic algorithms

TL;DR: This work designs a new crossover-based genetic algorithm that uses mutation with a higher-than-usual mutation probability to increase the exploration speed and crossover with the parent to repair losses incurred by the more aggressive mutation.
Book ChapterDOI

Probabilistic Tools for the Analysis of Randomized Optimization Heuristics.

TL;DR: This chapter collects several probabilistic tools that have proven to be useful in the analysis of randomized search heuristics, including classic material such as the Markov, Chebyshev, and Chernoff inequalities, but also lesser-known topics such as stochastic domination and coupling.
Journal ArticleDOI

Simplified Drift Analysis for Proving Lower Bounds in Evolutionary Computation

TL;DR: The present paper picks up Hajek's line of thought to prove a drift theorem that is very easy to use in evolutionary computation and shows how previous analyses involving the complicated theorem can be redone in a much simpler and clearer way.
BookDOI

Analyzing Evolutionary Algorithms

Thomas Jansen
TL;DR: The author provides an introduction to the methods used to analyze evolutionary algorithms and other randomized search heuristics with a complexity-theoretical perspective, derives general limitations for black-box optimization, yielding lower bounds on the performance of evolutionary algorithms.
References
More filters
Journal ArticleDOI

Optimization by Simulated Annealing

TL;DR: There is a deep and useful connection between statistical mechanics and multivariate or combinatorial optimization (finding the minimum of a given function depending on many parameters), and a detailed analogy with annealing in solids provides a framework for optimization of very large and complex systems.
Book

Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation

TL;DR: This book presents an introduction to Evolutionary Algorithms, a meta-language for programming with real-time implications, and some examples of how different types of algorithms can be tuned for different levels of integration.
BookDOI

Estimation of Distribution Algorithms

TL;DR: This work approaches the problem of partial abductive inference in Bayesian networks by means of Estimation of Distribution Algorithms, and an empirical comparison between the results obtained by Genetic Algorithm and Estimating of DistributionAlgorithms is carried out.

Ant Colony Optimization Theory

TL;DR: Theoretical Considerations on ACO, The Problem and the Algorithm, Convergence Proofs, ACO and Model-Based Search, Bibliographical Remarks, Things to Remember, Thought and Computer Exercises as mentioned in this paper.
Journal ArticleDOI

On the analysis of the (1+ 1) evolutionary algorithm

TL;DR: A step towards a theory on Evolutionary Algorithms, in particular, the so-called (1+1) evolutionary Algorithm, is performed and linear functions are proved to be optimized in expected time O(nlnn) but only mutation rates of size (1/n) can ensure this behavior.