Recent research has revealed that the output of deep neural networks (DNNs) can be easily altered by adding relatively small perturbations to the input vector. In this paper, we analyze an attack in an extremely limited scenario where only one pixel can be modified. For that we propose a novel method for generating one-pixel adversarial perturbations based on differential evolution (DE). It requires less adversarial information (a black-box attack) and can fool more types of networks due to the inherent features of DE. The results show that 67.97% of the natural images in Kaggle CIFAR-10 test dataset and 16.04% of the ImageNet (ILSVRC 2012) test images can be perturbed to at least one target class by modifying just one pixel with 74.03% and 22.91% confidence on average. We also show the same vulnerability on the original CIFAR-10 dataset. Thus, the proposed attack explores a different take on adversarial machine learning in an extreme limited scenario, showing that current DNNs are also vulnerable to such low dimension attacks. Besides, we also illustrate an important application of DE (or broadly speaking, evolutionary computation) in the domain of adversarial machine learning: creating tools that can effectively generate low-cost adversarial attacks against neural networks for evaluating robustness.

One Pixel Attack for Fooling Deep Neural Networks

Swarm intelligence (SI) is briefly defined as the collective behaviour of decentralized and self-organized swarms. The well known examples for these swarms are bird flocks, fish schools and the colony of social insects such as termites, ants and bees. In 1990s, especially two approaches based on ant colony and on fish schooling/bird flocking introduced have highly attracted the interest of researchers. Although the self-organization features are required by SI are strongly and clearly seen in honey bee colonies, unfortunately the researchers have recently started to be interested in the behaviour of these swarm systems to describe new intelligent approaches, especially from the beginning of 2000s. During a decade, several algorithms have been developed depending on different intelligent behaviours of honey bee swarms. Among those, artificial bee colony (ABC) is the one which has been most widely studied on and applied to solve the real world problems, so far. Day by day the number of researchers being interested in ABC algorithm increases rapidly. This work presents a comprehensive survey of the advances with ABC and its applications. It is hoped that this survey would be very beneficial for the researchers studying on SI, particularly ABC algorithm.

A comprehensive survey: artificial bee colony (ABC) algorithm and applications

Review: Digital image steganography: Survey and analysis of current methods

Nature-Inspired Optimization Algorithms provides a systematic introduction to all major nature-inspired algorithms for optimization. The book's unified approach, balancing algorithm introduction, theoretical background and practical implementation, complements extensive literature with well-chosen case studies to illustrate how these algorithms work. Topics include particle swarm optimization, ant and bee algorithms, simulated annealing, cuckoo search, firefly algorithm, bat algorithm, flower algorithm, harmony search, algorithm analysis, constraint handling, hybrid methods, parameter tuning and control, as well as multi-objective optimization. This book can serve as an introductory book for graduates, doctoral students and lecturers in computer science, engineering and natural sciences. It can also serve a source of inspiration for new applications. Researchers and engineers as well as experienced experts will also find it a handy reference.Discusses and summarizes the latest developments in nature-inspired algorithms with comprehensive, timely literatureProvides a theoretical understanding as well as practical implementation hintsProvides a step-by-step introduction to each algorithm

Nature-Inspired Optimization Algorithms

Recent research has revealed that the output of Deep Neural Networks (DNN) can be easily altered by adding relatively small perturbations to the input vector. In this paper, we analyze an attack in an extremely limited scenario where only one pixel can be modified. For that we propose a novel method for generating one-pixel adversarial perturbations based on differential evolution (DE). It requires less adversarial information (a black-box attack) and can fool more types of networks due to the inherent features of DE. The results show that 67.97% of the natural images in Kaggle CIFAR-10 test dataset and 16.04% of the ImageNet (ILSVRC 2012) test images can be perturbed to at least one target class by modifying just one pixel with 74.03% and 22.91% confidence on average. We also show the same vulnerability on the original CIFAR-10 dataset. Thus, the proposed attack explores a different take on adversarial machine learning in an extreme limited scenario, showing that current DNNs are also vulnerable to such low dimension attacks. Besides, we also illustrate an important application of DE (or broadly speaking, evolutionary computation) in the domain of adversarial machine learning: creating tools that can effectively generate low-cost adversarial attacks against neural networks for evaluating robustness.

One pixel attack for fooling deep neural networks

In this paper, the algorithmic concepts of the Cuckoo-search (CK), Particle swarm optimization (PSO), Differential evolution (DE) and Artificial bee colony (ABC) algorithms have been analyzed. The numerical optimization problem solving successes of the mentioned algorithms have also been compared statistically by testing over 50 different benchmark functions. Empirical results reveal that the problem solving success of the CK algorithm is very close to the DE algorithm. The run-time complexity and the required function-evaluation number for acquiring global minimizer by the DE algorithm is generally smaller than the comparison algorithms. The performances of the CK and PSO algorithms are statistically closer to the performance of the DE algorithm than the ABC algorithm. The CK and DE algorithms supply more robust and precise results than the PSO and ABC algorithms.

A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms

This paper introduces a comparison of training algorithms of radial basis function (RBF) neural networks for classification purposes. RBF networks provide effective solutions in many science and engineering fields. They are especially popular in the pattern classification and signal processing areas. Several algorithms have been proposed for training RBF networks. The Artificial Bee Colony (ABC) algorithm is a new, very simple and robust population based optimization algorithm that is inspired by the intelligent behavior of honey bee swarms. The training performance of the ABC algorithm is compared with the Genetic algorithm, Kalman filtering algorithm and gradient descent algorithm. In the experiments, not only well known classification problems from the UCI repository such as the Iris, Wine and Glass datasets have been used, but also an experimental setup is designed and inertial sensor based terrain classification for autonomous ground vehicles was also achieved. Experimental results show that the use of the ABC algorithm results in better learning than those of others.

A Comparison of RBF Neural Network Training Algorithms for Inertial Sensor Based Terrain Classification

This paper introduces the comparison of evolutionary and swarm-based optimization algorithms for multilevel color image thresholding problem which is a process used for segmentation of an image into different regions. Thresholding has various applications such as video image compression, geovideo and document processing, particle counting, and object recognition. Evolutionary and swarm-based computation techniques are widely used to reduce the computational complexity of the multilevel thresholding problem. In this study, well-known evolutionary algorithms such as Evolution Strategy, Genetic Algorithm, Differential Evolution, Adaptive Differential Evolution and swarm-based algorithms such as Particle Swarm Optimization, Artificial Bee Colony, Cuckoo Search and Differential Search Algorithm have been used for solving multilevel thresholding problem. Kapur's entropy is used as the fitness function to be maximized. Experiments are conducted on 20 different test images to compare the algorithms in terms of quality, running CPU times and compression ratios. According to the statistical analysis of objective values, swarm based algorithms are more accurate and robust than evolutionary algorithms in general. However, experimental results exposed that evolutionary algorithms are faster than swarm based algorithms in terms of CPU running times.

Comparison of evolutionary and swarm based computational techniques for multilevel color image thresholding

A new impulse noise detector based on neuro-fuzzy methods is presented. The proposed detector comprises two identical neuro-fuzzy subdetectors combined with a decision maker. The internal parameters of the subdetectors are adaptively adjusted by training. Training of the subdetectors is accomplished by using a simple computer generated artificial image. The detector can be combined with any impulse noise removal operator. The operation of the detector is completely independent of the noise removal operator and it has no influence on the filtering behavior of the operator. Experimental results show that the proposed detector significantly reduces the distortion effects of any impulse noise removal operator even if the operator already has its own noise detector.

A simple neuro-fuzzy impulse detector for efficient blur reduction of impulse noise removal operators for digital images

In this paper, weighted differential evolution algorithm (WDE) has been proposed for solving real-valued numerical optimization problems. When all parameters of WDE are determined randomly, in practice, WDE has no control parameter but the pattern size. WDE can solve unimodal, multimodal, separable, scalable, and hybrid problems. WDE has a very fast and quite simple structure, in addition, it can be parallelized due to its non-recursive nature. WDE has a strong exploration and exploitation capability. In this paper, WDE’s success in solving CEC’ 2013 problems was compared to 4 different EAs (i.e., CS, ABC, JADE, and BSA) statistically. One 3D geometric optimization problem (i.e., GPS network adjustment problem) and 4 constrained engineering design problems were used to examine the WDE’s ability to solve real-world problems. Results obtained from the performed tests showed that, in general, problem-solving success of WDE is statistically better than the comparison algorithms that have been used in this paper.

Weighted differential evolution algorithm for numerical function optimization: a comparative study with cuckoo search, artificial bee colony, adaptive differential evolution, and backtracking search optimization algorithms

Erkan Beşdok

Papers

A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms

A Comparison of RBF Neural Network Training Algorithms for Inertial Sensor Based Terrain Classification

Comparison of evolutionary and swarm based computational techniques for multilevel color image thresholding

A simple neuro-fuzzy impulse detector for efficient blur reduction of impulse noise removal operators for digital images

Weighted differential evolution algorithm for numerical function optimization: a comparative study with cuckoo search, artificial bee colony, adaptive differential evolution, and backtracking search optimization algorithms