Differential evolution (DE) is arguably one of the most powerful stochastic real-parameter optimization algorithms in current use. DE operates through similar computational steps as employed by a standard evolutionary algorithm (EA). However, unlike traditional EAs, the DE-variants perturb the current-generation population members with the scaled differences of randomly selected and distinct population members. Therefore, no separate probability distribution has to be used for generating the offspring. Since its inception in 1995, DE has drawn the attention of many researchers all over the world resulting in a lot of variants of the basic algorithm with improved performance. This paper presents a detailed review of the basic concepts of DE and a survey of its major variants, its application to multiobjective, constrained, large scale, and uncertain optimization problems, and the theoretical studies conducted on DE so far. Also, it provides an overview of the significant engineering applications that have benefited from the powerful nature of DE.

/pdf/differential-evolution-a-survey-of-the-state-of-the-art-3lz840pz2t.pdf

Differential Evolution: A Survey of the State-of-the-Art

We explore the effect of dimensionality on the nearest neighbor problem. We show that under a broad set of conditions (much broader than independent and identically distributed dimensions), as dimensionality increases, the distance to the nearest data point approaches the distance to the farthest data point. To provide a practical perspective, we present empirical results on both real and synthetic data sets that demonstrate that this effect can occur for as few as 10-15 dimensions. These results should not be interpreted to mean that high-dimensional indexing is never meaningful; we illustrate this point by identifying some high-dimensional workloads for which this effect does not occur. However, our results do emphasize that the methodology used almost universally in the database literature to evaluate high-dimensional indexing techniques is flawed, and should be modified. In particular, most such techniques proposed in the literature are not evaluated versus simple linear scan, and are evaluated over workloads for which nearest neighbor is not meaningful. Often, even the reported experiments, when analyzed carefully, show that linear scan would outperform the techniques being proposed on the workloads studied in high (10-15) dimensionality!.

When is nearest neighbor meaningful

The partitional clustering concept started with K-means algorithm which was published in 1957. Since then many classical partitional clustering algorithms have been reported based on gradient descent approach. The 1990 kick started a new era in cluster analysis with the application of nature inspired metaheuristics. After initial formulation nearly two decades have passed and researchers have developed numerous new algorithms in this field. This paper embodies an up-to-date review of all major nature inspired metaheuristic algorithms employed till date for partitional clustering. Further, key issues involved during formulation of various metaheuristics as a clustering problem and major application areas are discussed.

A survey on nature inspired metaheuristic algorithms for partitional clustering

In this paper, we present a comprehensive review of the imbalance problems in object detection. To analyze the problems in a systematic manner, we introduce a problem-based taxonomy. Following this taxonomy, we discuss each problem in depth and present a unifying yet critical perspective on the solutions in the literature. In addition, we identify major open issues regarding the existing imbalance problems as well as imbalance problems that have not been discussed before. Moreover, in order to keep our review up to date, we provide an accompanying webpage which catalogs papers addressing imbalance problems, according to our problem-based taxonomy. Researchers can track newer studies on this webpage available at: https://github.com/kemaloksuz/ObjectDetectionImbalance .

Imbalance Problems in Object Detection: A Review

Thank you very much for reading probability a graduate course. As you may know, people have search numerous times for their favorite novels like this probability a graduate course, but end up in infectious downloads. Rather than enjoying a good book with a cup of coffee in the afternoon, instead they juggled with some infectious bugs inside their laptop. probability a graduate course is available in our book collection an online access to it is set as public so you can download it instantly. Our book servers spans in multiple locations, allowing you to get the most less latency time to download any of our books like this one. Merely said, the probability a graduate course is universally compatible with any devices to read.

Probability A Graduate Course

Class imbalance is a long-standing problem relevant to a number of real-world applications of deep learning. Oversampling techniques, which are effective for handling class imbalance in classical learning systems, can not be directly applied to end-to-end deep learning systems. We propose a three-player adversarial game between a convex generator, a multi-class classifier network, and a real/fake discriminator to perform oversampling in deep learning systems. The convex generator generates new samples from the minority classes as convex combinations of existing instances, aiming to fool both the discriminator as well as the classifier into misclassifying the generated samples. Consequently, the artificial samples are generated at critical locations near the peripheries of the classes. This, in turn, adjusts the classifier induced boundaries in a way which is more likely to reduce misclassification from the minority classes. Extensive experiments on multiple class imbalanced image datasets establish the efficacy of our proposal.

/pdf/generative-adversarial-minority-oversampling-3juyud5r7m.pdf

Generative Adversarial Minority Oversampling

Due to its simplicity and efficiency, a recently proposed optimization algorithm, Sine Cosine Algorithm (SCA), has gained the interest of researchers from various fields for solving optimization problems. However, it is prone to premature convergence at local minima as it lacks internal memory. To overcome this drawback, a novel Hybrid SCA-PSO algorithm for solving optimization problems and object tracking is proposed. The P b e s t and G b e s t components of PSO (Particle Swarm Optimization) is added to traditional SCA to guide the search process for potential candidate solutions and PSO is then initialized with P b e s t of SCA to exploit the search space further. The proposed algorithm combines the exploitation capability of PSO and exploration capability of SCA to achieve optimal global solutions. The effectiveness of this algorithm is evaluated using 23 classical, CEC 2005 and CEC 2014 benchmark functions. Statistical parameters are employed to observe the efficiency of the Hybrid SCA-PSO qualitatively and results prove that the proposed algorithm is very competitive compared to the state-of-the-art metaheuristic algorithms. The Hybrid SCA-PSO algorithm is applied for object tracking as a real thought-provoking case study. Experimental results show that the Hybrid SCA-PSO-based tracker can robustly track an arbitrary target in various challenging conditions. To reveal the capability of the proposed algorithm, comparative studies of tracking accuracy and speed of the Hybrid SCA-PSO based tracking framework and other trackers, viz., Particle filter, Mean-shift, Particle swarm optimization, Bat algorithm, Sine Cosine Algorithm (SCA) and Hybrid Gravitational Search Algorithm (HGSA) is presented.

A synergy of the sine-cosine algorithm and particle swarm optimizer for improved global optimization and object tracking

Cluster analysis means the organization of an unlabeled collection of objects or patterns into separate groups based on their similarity. The task of computerized data clustering has been approached from diverse domains of knowledge like graph theory, multivariate analysis, neural networks, fuzzy set theory, and so on. Clustering is often described as an unsupervised learning method but most of the traditional algorithms require a prior specification of the number of clusters in the data for guiding the partitioning process, thus making it not completely unsupervised. Modern data mining tools that predict future trends and behaviors for allowing businesses to make proactive and knowledge-driven decisions, demand fast and fully automatic clustering of very large datasets with minimal or no user intervention. In this volume, we formulate clustering as an optimization problem, where the best partitioning of a given dataset is achieved by minimizing/maximizing one (single-objective clustering) or more (multi-objective clustering) objective functions. Using several real world applications, we illustrate the performance of several metaheuristics, particularly the Differential Evolution algorithm when applied to both single and multi-objective clustering problems, where the number of clusters is not known beforehand and must be determined on the run. This volume comprises of 7 chapters including an introductory chapter giving the fundamental definitions and the last Chapter provides some important research challenges. Academics, scientists as well as engineers engaged in research, development and application of optimization techniques and data mining will find the comprehensive coverage of this book invaluable.

Metaheuristic Clustering

Hybrid flowshop (HFS) rescheduling has important applications in modern industry. Much of the existing research on HFS rescheduling only consider one type of dynamic event. However, realistic production systems often encounter several types of dynamic events. In this paper, HFS rescheduling considering simultaneously three types of dynamic events (i.e. machine breakdown, new job arrival and job release variation) is studied. The mathematical model of minimizing makespan and system instability is established. The approaches for calculating lower and upper bounds of the two optimization objectives are developed. A Multi-Start Variable Neighbourhood Descent (MSVND) algorithm is proposed for the HFS rescheduling. In the MSVND, a hybrid decoding is developed. To improve the intensification of the MSVND, a Fruit Fly Optimization (FFO)-based local search and an enhanced FFO-based local search are designed to improve the best solution found so far. Moreover, to enhance the diversification, a simulated annealing-like acceptance criterion is employed to determine whether the local optima can be accepted, and a restart strategy with perturbation is devised to guide the search to the so far unexplored area. Extensive experimental comparisons on 150 instances verify the effectiveness of the devised strategies. Further, a comprehensive comparison against seven highly efficient algorithms demonstrates the superiority of the MSVND.

A multi-start variable neighbourhood descent algorithm for hybrid flowshop rescheduling

We propose a novel Evolutionary Algorithm (EA) based on the Differential Evolution algorithm for solving global numerical optimization problem in real-valued continuous parameter space. The proposed MadDE algorithm leverages the power of the multiple adaptation strategy with respect to the control parameters and search mechanisms, and is tested on the benchmark functions taken from the CEC 2021 special session & competition on single-objective bound-constrained optimization. Experimental results indicate that MadDE is able to achieve superior performance on global numerical optimization problems when compared against state-of-the-art real-parameter optimizers. We also provide a hyperparameter optimization algorithm SUBHO for improving the search performance of any EA by finding an optimal set of control parameters, and demonstrate its efficacy in enhancing MadDE’s performance on the same benchmark. The source code of our implementation is publicly available at https://github.com/subhodipbiswas/MadDE.

Swagatam Das

Papers

Generative Adversarial Minority Oversampling

A synergy of the sine-cosine algorithm and particle swarm optimizer for improved global optimization and object tracking

Metaheuristic Clustering

A multi-start variable neighbourhood descent algorithm for hybrid flowshop rescheduling

Improving Differential Evolution through Bayesian Hyperparameter Optimization