Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems.
Citations
230 citations
Cites background from "Enforcing Analytic Constraints in N..."
...Parameterization [198] [157] [203] [135] [169] [95] [43] [90] [186] [212] [29] [33] [189] [292] [23] [24] [285] [21] [23] [294]...
[...]
...show that enforcing energy conservation laws improves prediction when emulating cloud processes [23, 24]....
[...]
...Most of the existing work uses standard black box ML models for parameterization, but there is an increasing interest in integrating physics in the ML models [23], as it has the potential to make them more robust and generalizable to unseen scenarios as well as reduce the number of training samples needed for training....
[...]
174 citations
119 citations
88 citations
83 citations
Cites background from "Enforcing Analytic Constraints in N..."
...However, this new class of ML parameterizations often uses black box algorithms (e.g., neural networks) such that the laws of physics are not necessarily respected unless imposed (Beucler et al., 2019; Ling et al., 2016), and interpreting the data‐driven parameterization becomes intractable....
[...]
...The architecture of the FCNN is physically constrained (Beucler et al., 2019) such that the activationmaps (i.e., the results) of the third convolution layer represent the elements of a symmetric eddy stress tensor T....
[...]
References
111,197 citations
"Enforcing Analytic Constraints in N..." refers methods in this paper
...We optimized the NN’s weights and biases with the RMSprop optimizer [26] because it was more stable than the Adam optimizer [27] for LCnets, and save the NN’s state of minimal validation loss over 20 epochs....
[...]
38,211 citations
"Enforcing Analytic Constraints in N..." refers background in this paper
...This motivates physically-constraining a broader class of machine-learning algorithms, such as generative adversarial networks [28, 29]....
[...]
30,811 citations
15,005 citations
10,447 citations
"Enforcing Analytic Constraints in N..." refers methods in this paper
...We implement the three NN types (UCnet, LCnet, ACnet) using the Keras library [25] with the Tensorflow backend [26]....
[...]