scispace - formally typeset
Open AccessJournal ArticleDOI

Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles

TLDR
It is shown that a PGRNN can improve prediction accuracy over that of physics-based models, while generating outputs consistent with physical laws, and is applicable more widely to a range of scientific and engineering disciplines where physics- based models are used.
Abstract
Physics-based models are often used to study engineering and environmental systems. The ability to model these systems is the key to achieving our future environmental sustainability and improving the quality of human life. This article focuses on simulating lake water temperature, which is critical for understanding the impact of changing climate on aquatic ecosystems and assisting in aquatic resource management decisions. General Lake Model (GLM) is a state-of-the-art physics-based model used for addressing such problems. However, like other physics-based models used for studying scientific and engineering systems, it has several well-known limitations due to simplified representations of the physical processes being modeled or challenges in selecting appropriate parameters. While state-of-the-art machine learning models can sometimes outperform physics-based models given ample amount of training data, they can produce results that are physically inconsistent. This article proposes a physics-guided recurrent neural network model (PGRNN) that combines RNNs and physics-based models to leverage their complementary strengths and improves the modeling of physical processes. Specifically, we show that a PGRNN can improve prediction accuracy over that of physics-based models (by over 20% even with very little training data), while generating outputs consistent with physical laws. An important aspect of our PGRNN approach lies in its ability to incorporate the knowledge encoded in physics-based models. This allows training the PGRNN model using very few true observed data while also ensuring high prediction accuracy. Although we present and evaluate this methodology in the context of modeling the dynamics of temperature in lakes, it is applicable more widely to a range of scientific and engineering disciplines where physics-based (also known as mechanistic) models are used.

read more

Citations
More filters
Posted Content

Integrating Physics-Based Modeling with Machine Learning: A Survey

TL;DR: An overview of techniques to integrate machine learning with physics-based modeling and classes of methodologies used to construct physics-guided machine learning models and hybrid physics-machine learning frameworks from a machine learning standpoint is provided.
Journal ArticleDOI

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

TL;DR: This paper proposes a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer.
Posted Content

Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems

TL;DR: There is a growing consensus that solutions to complex science and engineering problems require novel methodologies that are able to integrate traditional physics-based modeling approaches with state-of-the-art machine learning (ML) techniques as discussed by the authors.
Journal ArticleDOI

Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems

TL;DR: There is a growing consensus that solutions to complex science and engineering problems require novel methodologies that are able to integrate traditional physics-based modeling approaches with state-of-the-art machine learning (ML) techniques as discussed by the authors .
Journal ArticleDOI

Physics-Informed and Hybrid Machine Learning in Additive Manufacturing: Application to Fused Filament Fabrication

TL;DR: In this article, three types of strategies are explored to incorporate physics constraints and multi-physics FFF simulation results into a deep neural network (DNN), thus ensuring consistency with physical laws.
References
More filters
Proceedings Article

Adam: A Method for Stochastic Optimization

TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Journal ArticleDOI

Learning long-term dependencies with gradient descent is difficult

TL;DR: This work shows why gradient based learning algorithms face an increasingly difficult problem as the duration of the dependencies to be captured increases, and exposes a trade-off between efficient learning by gradient descent and latching on information for long periods.
Journal ArticleDOI

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

TL;DR: This work develops a novel framework to discover governing equations underlying a dynamical system simply from data measurements, leveraging advances in sparsity techniques and machine learning and using sparse regression to determine the fewest terms in the dynamic governing equations required to accurately represent the data.
Journal ArticleDOI

Machine learning for molecular and materials science.

TL;DR: A future in which the design, synthesis, characterization and application of molecules and materials is accelerated by artificial intelligence is envisaged.
Journal ArticleDOI

Blooms like it hot

TL;DR: A link exists between global warming and the worldwide proliferation of harmful cyanobacterial blooms as discussed by the authors, and it has been shown that global warming can be linked with the proliferation of these blooms.
Related Papers (5)