Symbolic regression driven by training data and prior knowledge
Jiří Kubalík,Erik Derner,Robert Babuska +2 more
- pp 958-966
TLDR
In this article, the authors propose a multi-objective symbolic regression approach that is driven by both the training data and the prior knowledge of the properties the desired model should manifest.Abstract:
In symbolic regression, the search for analytic models is typically driven purely by the prediction error observed on the training data samples. However, when the data samples do not sufficiently cover the input space, the prediction error does not provide sufficient guidance toward desired models. Standard symbolic regression techniques then yield models that are partially incorrect, for instance, in terms of their steady-state characteristics or local behavior. If these properties were considered already during the search process, more accurate and relevant models could be produced. We propose a multi-objective symbolic regression approach that is driven by both the training data and the prior knowledge of the properties the desired model should manifest. The properties given in the form of formal constraints are internally represented by a set of discrete data samples on which candidate models are exactly checked. The proposed approach was experimentally evaluated on three test problems with results clearly demonstrating its capability to evolve realistic models that fit the training data well while complying with the prior knowledge of the desired model characteristics at the same time. It outperforms standard symbolic regression by several orders of magnitude in terms of the mean squared deviation from a reference model.read more
Citations
More filters
Posted Content
Symbolic Regression Methods for Reinforcement Learning
TL;DR: This paper introduces three off-line methods for finding value functions based on a state-transition model: symbolic value iteration, symbolic policy iteration, and a direct solution of the Bellman equation.
Journal ArticleDOI
Multi-objective symbolic regression for physics-aware dynamic modeling
TL;DR: This paper considers a multi-objective symbolic regression method that optimizes models with respect to their training error and the measure of how well they comply with the desired physical properties and proposes an extension to the existing algorithm that helps generate a diverse set of high-quality models.
Journal ArticleDOI
Functional-Hybrid modeling through automated adaptive symbolic regression for interpretable mathematical expressions
TL;DR: The Functional-Hybrid model as discussed by the authors uses the ranked domain-specific functional beliefs together with symbolic regression to develop dynamic models for the representation of (bio)-chemical processes, focusing on applying chemical reaction kinetic principles to classical chemical reactions, biochemistry, ecology, physiology and a bioreactor.
Journal ArticleDOI
Functional-Hybrid Modeling through automated adaptive symbolic regression for interpretable mathematical expressions
TL;DR: The Functional-Hybrid model as discussed by the authors uses the ranked domain-specific functional beliefs together with symbolic regression to develop dynamic models for the representation of (bio)-chemical processes, focusing on applying chemical reaction kinetic principles to classical chemical reactions, biochemistry, ecology, physiology and a bioreactor.
Journal ArticleDOI
Combining data and theory for derivable scientific discovery with AI-Descartes
Cristina Cornelio,Sanjeeb Dash,Vernon Austel,Tyler R. Josephson,Joao Goncalves,Kenneth L. Clarkson,Nimrod Megiddo,Bachir El Khadir,Lior Horesh +8 more
TL;DR: This paper developed a method to enable principled derivations of models of natural phenomena from axiomatic knowledge and experimental data by combining logical reasoning with symbolic regression, and demonstrated these concepts for Kepler's third law of planetary motion, Einstein's relativistic time-dilation law, and Langmuir's theory of adsorption.
References
More filters
Journal ArticleDOI
A fast and elitist multiobjective genetic algorithm: NSGA-II
TL;DR: This paper suggests a non-dominated sorting-based MOEA, called NSGA-II (Non-dominated Sorting Genetic Algorithm II), which alleviates all of the above three difficulties, and modify the definition of dominance in order to solve constrained multi-objective problems efficiently.
Posted Content
Continuous control with deep reinforcement learning
Timothy P. Lillicrap,Jonathan J. Hunt,Alexander Pritzel,Nicolas Heess,Tom Erez,Yuval Tassa,David Silver,Daan Wierstra +7 more
TL;DR: This work presents an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces, and demonstrates that for many of the tasks the algorithm can learn policies end-to-end: directly from raw pixel inputs.
Journal ArticleDOI
Distilling Free-Form Natural Laws from Experimental Data
Michael D. Schmidt,Hod Lipson +1 more
TL;DR: In this article, the authors proposed a method for automatically searching motion-tracking data captured from various physical systems, ranging from simple harmonic oscillators to chaotic double-pendula, without any prior knowledge about physics, kinematics, or geometry, the algorithm discovered Hamiltonians, Lagrangians, and other laws of geometric and momentum conservation.
Supporting Online Material for Distilling Free-Form Natural Laws from Experimental Data
Michael Schmidt,Hod Lipson +1 more
TL;DR: This work proposes a principle for the identification of nontriviality, and demonstrated this approach by automatically searching motion-tracking data captured from various physical systems, ranging from simple harmonic oscillators to chaotic double-pendula, and discovered Hamiltonians, Lagrangians, and other laws of geometric and momentum conservation.
Proceedings Article
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
TL;DR: PILCO reduces model bias, one of the key problems of model-based reinforcement learning, in a principled way by learning a probabilistic dynamics model and explicitly incorporating model uncertainty into long-term planning.