This chapter introduces the finite element method (FEM) as a tool for solution of classical electromagnetic problems. Although we discuss the main points in the application of the finite element method to electromagnetic design, including formulation and implementation, those who seek deeper understanding of the finite element method should consult some of the works listed in the bibliography section.

Introduction to the Finite Element Method

Hydrodynamic and hydromagnetic stability

Abstract Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional equations, integral-differential equations, and stochastic PDEs. This novel methodology has arisen as a multi-task learning framework in which a NN must fit observed data while reducing a PDE residual. This article provides a comprehensive review of the literature on PINNs: while the primary goal of the study was to characterize these networks and their related advantages and disadvantages. The review also attempts to incorporate publications on a broader range of collocation-based physics informed neural networks, which stars form the vanilla PINN, as well as many other variants, such as physics-constrained neural networks (PCNN), variational hp-VPINN, and conservative PINN (CPINN). The study indicates that most research has focused on customizing the PINN through different activation functions, gradient optimization techniques, neural network structures, and loss function structures. Despite the wide range of applications for which PINNs have been used, by demonstrating their ability to be more feasible in some contexts than classical numerical techniques like Finite Element Method (FEM), advancements are still possible, most notably theoretical issues that remain unresolved. 

/pdf/scientific-machine-learning-through-physics-informed-neural-3uhx9t2l.pdf

Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next

Extreme theory of functional connections: A fast physics-informed neural network method for solving ordinary and partial differential equations

This article presents a new methodology called Deep Theory of Functional Connections (TFC) that estimates the solutions of partial differential equations (PDEs) by combining neural networks with the TFC. The TFC is used to transform PDEs into unconstrained optimization problems by analytically embedding the PDE’s constraints into a “constrained expression” containing a free function. In this research, the free function is chosen to be a neural network, which is used to solve the now unconstrained optimization problem. This optimization problem consists of minimizing a loss function that is chosen to be the square of the residuals of the PDE. The neural network is trained in an unsupervised manner to minimize this loss function. This methodology has two major differences when compared with popular methods used to estimate the solutions of PDEs. First, this methodology does not need to discretize the domain into a grid, rather, this methodology can randomly sample points from the domain during the training phase. Second, after training, this methodology produces an accurate analytical approximation of the solution throughout the entire training domain. Because the methodology produces an analytical solution, it is straightforward to obtain the solution at any point within the domain and to perform further manipulation if needed, such as differentiation. In contrast, other popular methods require extra numerical techniques if the estimated solution is desired at points that do not lie on the discretized grid, or if further manipulation to the estimated solution must be performed.

Deep Theory of Functional Connections: A New Method for Estimating the Solutions of Partial Differential Equations.

High accuracy least-squares solutions of nonlinear differential equations

In this paper we present a new approach to solve the fuel-efficient powered descent guidance problem on large planetary bodies with no atmosphere (e.g., Moon or Mars) using the recently developed Theory of Functional Connections. The problem is formulated using the indirect method which casts the optimal guidance problem as a system of nonlinear two-point boundary value problems. Using the Theory of Functional Connections, the problem’s linear constraints are analytically embedded into a functional, which maintains a free-function that is expanded using orthogonal polynomials with unknown coefficients. The constraints are always analytically satisfied regardless of the values of the unknown coefficients (e.g., the coefficients of the free-function) which converts the two-point boundary value problem into an unconstrained optimization problem. This process reduces the whole solution space into the admissible solution subspace satisfying the constraints and, therefore, simpler, more accurate, and faster numerical techniques can be used to solve it. In this paper a nonlinear least-squares method is used. In addition to the derivation of this technique, the method is validated in two scenarios and the results are compared to those obtained by the general purpose optimal control software, GPOPS-II. In general, the proposed technique produces solutions of 

$\mathcal {O}(10^{-10})$
 accuracy. Additionally, for the proposed test cases, it is reported that each individual TFC-based inner-loop iteration converges within 6 iterations, each iteration exhibiting a computational time between 72 and 81 milliseconds, with a total execution time of 2.1 to 2.6 seconds using MATLAB. Consequently, the proposed methodology is potentially suitable for real-time computation of optimal trajectories.

Fuel-Efficient Powered Descent Guidance on Large Planetary Bodies via Theory of Functional Connections

Differential equations (DEs) are used as numerical models to describe physical phenomena throughout the field of engineering and science, including heat and fluid flow, structural bending, and systems dynamics. While there are many other techniques for finding approximate solutions to these equations, this paper looks to compare the application of the Theory of Functional Connections (TFC) with one based on least-squares support vector machines (LS-SVM). The TFC method uses a constrained expression, an expression that always satisfies the DE constraints, which transforms the process of solving a DE into solving an unconstrained optimization problem that is ultimately solved via least-squares (LS). In addition to individual analysis, the two methods are merged into a new methodology, called constrained SVMs (CSVM), by incorporating the LS-SVM method into the TFC framework to solve unconstrained problems. Numerical tests are conducted on four sample problems: One first order linear ordinary differential equation (ODE), one first order nonlinear ODE, one second order linear ODE, and one two-dimensional linear partial differential equation (PDE). Using the LS-SVM method as a benchmark, a speed comparison is made for all the problems by timing the training period, and an accuracy comparison is made using the maximum error and mean squared error on the training and test sets. In general, TFC is shown to be slightly faster (by an order of magnitude or less) and more accurate (by multiple orders of magnitude) than the LS-SVM and CSVM approaches.

https://www.mdpi.com/2504-4990/1/4/60/pdf

Hunter Johnston

Papers

Extreme theory of functional connections: A fast physics-informed neural network method for solving ordinary and partial differential equations

High accuracy least-squares solutions of nonlinear differential equations

Fuel-Efficient Powered Descent Guidance on Large Planetary Bodies via Theory of Functional Connections

Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines Using the Theory of Functional Connections.

Least-squares solutions of boundary-value problems in hybrid systems