Extracting governing equations from data is a central challenge in many diverse areas of science and engineering. Data are abundant whereas models often remain elusive, as in climate science, neuroscience, ecology, finance, and epidemiology, to name only a few examples. In this work, we combine sparsity-promoting techniques and machine learning with nonlinear dynamical systems to discover governing equations from noisy measurement data. The only assumption about the structure of the model is that there are only a few important terms that govern the dynamics, so that the equations are sparse in the space of possible functions; this assumption holds for many physical systems in an appropriate basis. In particular, we use sparse regression to determine the fewest terms in the dynamic governing equations required to accurately represent the data. This results in parsimonious models that balance accuracy with model complexity to avoid overfitting. We demonstrate the algorithm on a wide range of problems, from simple canonical systems, including linear and nonlinear oscillators and the chaotic Lorenz system, to the fluid vortex shedding behind an obstacle. The fluid example illustrates the ability of this method to discover the underlying dynamics of a system that took experts in the community nearly 30 years to resolve. We also show that this method generalizes to parameterized systems and systems that are time-varying or have external forcing.

https://www.pnas.org/content/pnas/113/15/3932.full.pdf

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

The proliferation of IoT devices that can be more easily compromised than desktop computers has led to an increase in IoT-based botnet attacks. To mitigate this threat, there is a need for new methods that detect attacks launched from compromised IoT devices and that differentiate between hours- and milliseconds-long IoT-based attacks. In this article, we propose a novel network-based anomaly detection method for the IoT called N-BaIoT that extracts behavior snapshots of the network and uses deep autoencoders to detect anomalous network traffic from compromised IoT devices. To evaluate our method, we infected nine commercial IoT devices in our lab with two widely known IoT-based botnets, Mirai and BASHLITE. The evaluation results demonstrated our proposed methods ability to accurately and instantly detect the attacks as they were being launched from the compromised IoT devices that were part of a botnet.

N-BaIoT—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders

EvoCOMNET Contributions.- New Research in Nature Inspired Algorithms for Mobility Management in GSM Networks.- Adaptive Local Search for a New Military Frequency Hopping Planning Problem.- SS vs PBIL to Solve a Real-World Frequency Assignment Problem in GSM Networks.- Reconstruction of Networks from Their Betweenness Centrality.- A Self-learning Optimization Technique for Topology Design of Computer Networks.- A Comparative Study of Fuzzy Inference Systems, Neural Networks and Adaptive Neuro Fuzzy Inference Systems for Portscan Detection.- EvoFIN Contributions.- Evolutionary Single-Position Automated Trading.- Genetic Programming in Statistical Arbitrage.- Evolutionary System for Generating Investment Strategies.- Horizontal Generalization Properties of Fuzzy Rule-Based Trading Models.- Particle Swarm Optimization for Tackling Continuous Review Inventory Models.- Option Model Calibration Using a Bacterial Foraging Optimization Algorithm.- A SOM and GP Tool for Reducing the Dimensionality of a Financial Distress Prediction Problem.- Quantum-Inspired Evolutionary Algorithms for Financial Data Analysis.- EvoHOT Contributions.- Analysis of Reconfigurable Logic Blocks for Evolvable Digital Architectures.- Analogue Circuit Control through Gene Expression.- Discovering Several Robot Behaviors through Speciation.- Architecture Performance Prediction Using Evolutionary Artificial Neural Networks.- Evolving a Vision-Driven Robot Controller for Real-World Indoor Navigation.- Evolving an Automatic Defect Classification Tool.- Deterministic Test Pattern Generator Design.- An Evolutionary Methodology for Test Generation for Peripheral Cores Via Dynamic FSM Extraction.- Exploiting MOEA to Automatically Geneate Test Programs for Path-Delay Faults in Microprocessors.- EvoIASP Contributions.- Evolutionary Object Detection by Means of Naive Bayes Models Estimation.- An Evolutionary Framework for Colorimetric Characterization of Scanners.- Artificial Creatures for Object Tracking and Segmentation.- Automatic Recognition of Hand Gestures with Differential Evolution.- Optimizing Computed Tomographic Angiography Image Segmentation Using Fitness Based Partitioning.- A GA-Based Feature Selection Algorithm for Remote Sensing Images.- An Evolutionary Approach for Ontology Driven Image Interpretation.- Hybrid Genetic Algorithm Based on Gene Fragment Competition for Polyphonic Music Transcription.- Classification of Seafloor Habitats Using Genetic Programming.- Selecting Local Region Descriptors with a Genetic Algorithm for Real-World Place Recognition.- Object Detection Using Neural Networks and Genetic Programming.- Direct 3D Metric Reconstruction from Multiple Views Using Differential Evolution.- Discrete Tomography Reconstruction through a New Memetic Algorithm.- A Fuzzy Hybrid Method for Image Decomposition Problem.- Triangulation Using Differential Evolution.- Fast Multi-template Matching Using a Particle Swarm Optimization Algorithm for PCB Inspection.- EvoMUSART Contributions.- A Generative Representation for the Evolution of Jazz Solos.- Automatic Invention of Fitness Functions with Application to Scene Generation.- Manipulating Artificial Ecosystems.- Evolved Diffusion Limited Aggregation Compositions.- Scaffolding for Interactively Evolving Novel Drum Tracks for Existing Songs.- AtomSwarm: A Framework for Swarm Improvisation.- Using DNA to Generate 3D Organic Art Forms.- Towards Music Fitness Evaluation with the Hierarchical SOM.- Evolutionary Pointillist Modules: Evolving Assemblages of 3D Objects.- An Artificial-Chemistry Approach to Generating Polyphonic Musical Phrases.- Implicit Fitness Functions for Evolving a Drawing Robot.- Free Flight in Parameter Space: A Dynamic Mapping Strategy for Expressive Free Impro.- Modelling Video Games' Landscapes by Means of Genetic Terrain Programming - A New Approach for Improving Users' Experience.- Virtual Constructive Swarm Compositions and Inspirations.- New-Generation Methods in an Interpolating EC Synthesizer Interface.- Composing Music with Neural Networks and Probabilistic Finite-State Machines.- TransFormer #13: Exploration and Adaptation of Evolution Expressed in a Dynamic Sculpture.- EvoNUM Contributions.- Multiobjective Tuning of Robust PID Controllers Using Evolutionary Algorithms.- Truncation Selection and Gaussian EDA: Bounds for Sustainable Progress in High-Dimensional Spaces.- Scalable Continuous Multiobjective Optimization with a Neural Network-Based Estimation of Distribution Algorithm.- Cumulative Step Length Adaptation for Evolution Strategies Using Negative Recombination Weights.- Computing Surrogate Constraints for Multidimensional Knapsack Problems Using Evolution Strategies.- A Critical Assessment of Some Variants of Particle Swarm Optimization.- An Evolutionary Game-Theoretical Approach to Particle Swarm Optimisation.- A Hybrid Particle Swarm Optimization Algorithm for Function Optimization.- EvoSTOC Contributions.- Memory Based on Abstraction for Dynamic Fitness Functions.- A Memory Enhanced Evolutionary Algorithm for Dynamic Scheduling Problems.- Compound Particle Swarm Optimization in Dynamic Environments.- An Evolutionary Algorithm for Adaptive Online Services in Dynamic Environment.- EvoTHEORY Contributions.- A Study of Some Implications of the No Free Lunch Theorem.- Negative Slope Coefficient and the Difficulty of Random 3-SAT Instances.- EvoTRANSLOG Contributions.- A Memetic Algorithm for the Team Orienteering Problem.- Decentralized Evolutionary Optimization Approach to the p-Median Problem.- Genetic Computation of Road Network Design and Pricing Stackelberg Games with Multi-class Users.- Constrained Local Search Method for Bus Fleet Scheduling Problem with Multi-depot with Line Change.- Evolutionary System with Precedence Constraints for Ore Harbor Schedule Optimization.

Applications of evolutionary computing: EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings.

Anomaly detection is an important problem that has been well-studied within diverse research areas and application domains. The aim of this survey is two-fold, firstly we present a structured and comprehensive overview of research methods in deep learning-based anomaly detection. Furthermore, we review the adoption of these methods for anomaly across various application domains and assess their effectiveness. We have grouped state-of-the-art research techniques into different categories based on the underlying assumptions and approach adopted. Within each category we outline the basic anomaly detection technique, along with its variants and present key assumptions, to differentiate between normal and anomalous behavior. For each category, we present we also present the advantages and limitations and discuss the computational complexity of the techniques in real application domains. Finally, we outline open issues in research and challenges faced while adopting these techniques.

Deep Learning for Anomaly Detection: A Survey.

More than a decade after the first extensive overview on parameter control, we revisit the field and present a survey of the state-of-the-art. We briefly summarize the development of the field and discuss existing work related to each major parameter or component of an evolutionary algorithm. Based on this overview, we observe trends in the area, identify some (methodological) shortcomings, and give recommendations for future research.

/pdf/parameter-control-in-evolutionary-algorithms-trends-and-24a9inzajy.pdf

Parameter Control in Evolutionary Algorithms: Trends and Challenges

We present AI2, an analyst-in-the-loop security system where Analyst Intuition (AI) is put together with state-of-the-art machine learning to build a complete end-to-end Artificially Intelligent solution (AI). The system presents four key features: a big data behavioral analytics platform, an outlier detection system, a mechanism to obtain feedback from security analysts, and a supervised learning module. We validate our system with a real-world data set consisting of 3.6 billion log lines and 70.2 million entities. The results show that the system is capable of learning to defend against unseen attacks. With respect to unsupervised outlier analysis, our system improves the detection rate in 2.92× and reduces false positives by more than 5×.

AI^2: Training a Big Data Machine to Defend

We propose a new means of executing a genetic program which improves its output quality. Our approach, called Multiple Regression Genetic Programming (MRGP) decouples and linearly combines a program's subexpressions via multiple regression on the target variable. The regression yields an alternate output: the prediction of the resulting multiple regression model. It is this output, over many fitness cases, that we assess for fitness, rather than the program's execution output. MRGP can be used to improve the fitness of a final evolved solution. On our experimental suite, MRGP consistently generated solutions fitter than the result of competent GP or multiple regression. When integrated into GP, inline MRGP, on the basis of equivalent computational budget, outperforms competent GP while also besting post-run MRGP. Thus MRGP's output method is shown to be superior to the output of program execution and it represents a practical, cost neutral, improvement to GP.

/pdf/multiple-regression-genetic-programming-3twnx8wi6s.pdf

Multiple regression genetic programming

We introduce Evolutionary Feature Synthesis (EFS), a regression method that generates readable, nonlinear models of small to medium size datasets in seconds EFS is, to the best of our knowledge, the fastest regression tool based on evolutionary computation reported to date The feature search involved in the proposed method is composed of two main steps: feature composition and feature subset selection EFS adopts a bottom-up feature composition strategy that eliminates the need for a symbolic representation of the features and exploits the variable selection process involved in pathwise regularized linear regression to perform the feature subset selection step The result is a regression method that is competitive against neural networks, and outperforms both linear methods and Multiple Regression Genetic Programming, up to now the best regression tool based on evolutionary computation

/pdf/building-predictive-models-via-feature-synthesis-2akpr621gu.pdf

Building Predictive Models via Feature Synthesis

/pdf/flexgp-cloud-based-ensemble-learning-with-genetic-k62yl0bf1j.pdf

FlexGP: Cloud-Based Ensemble Learning with Genetic Programming for Large Regression Problems

In the context of Parallel Evolutionary Algorithms, it has been shown that different population structures induce different search performances. Nevertheless, no work has shown a clear cut evidence that there is a correlation between the solver's population structure and the problem's network structure. In this work, we verify this correlation performing a clear and systematic analysis of a large set of population structures (based on the well known β-graphs and NK-landscape problems. Furthermore, we go beyond our findings in these idealised experiments by analysing the performance of variable-topology EAs on a dynamic real-world problem, the Multi-Skills Call Centre.

/pdf/matching-island-topologies-to-problem-structure-in-parallel-1jfhynygly.pdf

Ignacio Arnaldo

Papers

AI^2: Training a Big Data Machine to Defend

Multiple regression genetic programming

Building Predictive Models via Feature Synthesis

FlexGP: Cloud-Based Ensemble Learning with Genetic Programming for Large Regression Problems

Matching island topologies to problem structure in parallel evolutionary algorithms