Showing papers in "arXiv: Numerical Analysis in 2021"

POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition

Abstract: Deep learning-based reduced order models (DL-ROMs) have been recently proposed to overcome common limitations shared by conventional reduced order models (ROMs) - built, e.g., through proper orthogonal decomposition (POD) - when applied to nonlinear time-dependent parametrized partial differential equations (PDEs). These might be related to (i) the need to deal with projections onto high dimensional linear approximating trial manifolds, (ii) expensive hyper-reduction strategies, or (iii) the intrinsic difficulty to handle physical complexity with a linear superimposition of modes. All these aspects are avoided when employing DL-ROMs, which learn in a non-intrusive way both the nonlinear trial manifold and the reduced dynamics, by relying on deep (e.g., feedforward, convolutional, autoencoder) neural networks. Although extremely efficient at testing time, when evaluating the PDE solution for any new testing-parameter instance, DL-ROMs require an expensive training stage, because of the extremely large number of network parameters to be estimated. In this paper we propose a possible way to avoid an expensive training stage of DL-ROMs, by (i) performing a prior dimensionality reduction through POD, and (ii) relying on a multi-fidelity pretraining stage, where different physical models can be efficiently combined. The proposed POD-DL-ROM is tested on several (both scalar and vector, linear and nonlinear) time-dependent parametrized PDEs (such as, e.g., linear advection-diffusion-reaction, nonlinear diffusion-reaction, nonlinear elastodynamics, and Navier-Stokes equations) to show the generality of this approach and its remarkable computational savings.

On the formulation of fractional Adams-Bashforth method with Atangana-Baleanu-Caputo derivative to model chaotic problems

Abstract: Mathematical analysis with numerical application of the newly formulated fractional version of the Adams-Bashforth method using the Atangana-Baleanu derivative which has nonlocal and nonsingular properties is considered in this paper. We adopt the fixed point theory and approximation method to prove the existence and uniqueness of the solution via general two-component time-fractional differential equations. The method is tested with three nonlinear chaotic dynamical systems in which the integer-order derivative is modeled with the proposed fractional-order case. Simulation result for different $\alpha$ values in $(0,1]$ is presented.

Stiff Neural Ordinary Differential Equations

Abstract: Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODE in the classical stiff ODE systems of Robertson's problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson's problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODE. The success of learning stiff neural ODE opens up possibilities of using neural ODEs in applications with widely varying time-scales, like chemical dynamics in energy conversion, environmental engineering, and the life sciences.

Improving the Accuracy and Consistency of the Scalar Auxiliary Variable (SAV) Method with Relaxation.

Abstract: The scalar auxiliary variable (SAV) method was introduced by Shen et al. and has been broadly used to solve thermodynamically consistent PDE problems. By utilizing scalar auxiliary variables, the original PDE problems are reformulated into equivalent PDE problems. The advantages of the SAV approach, such as linearity, unconditionally energy stability, and easy-to-implement, are prevalent. However, there is still an open issue unresolved, i.e., the numerical schemes resulted from the SAV method preserve a "modified" energy law according to the auxiliary variables instead of the original variables. Truncation errors are introduced during numerical calculations so that the numerical solutions of the auxiliary variables are no longer equivalent to their original continuous definitions. In other words, even though the SAV scheme satisfies a modified energy law, it does not necessarily satisfy the energy law of the original PDE models. This paper presents one essential relaxation technique to overcome this issue, which we named the relaxed-SAV (RSAV) method. Our RSAV method penalizes the numerical errors of the auxiliary variables by a relaxation technique. In general, the RSAV method keeps all the advantages of the baseline SAV method and improves its accuracy and consistency noticeably. Several examples have been presented to demonstrate the effectiveness of the RSAV approach.

Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities

Abstract: Highly accurate numerical or physical experiments are often time-consuming or expensive to obtain. When time or budget restrictions prohibit the generation of additional data, the amount of available samples may be too limited to provide satisfactory model results. Multi-fidelity methods deal with such problems by incorporating information from other sources, which are ideally well-correlated with the high-fidelity data, but can be obtained at a lower cost. By leveraging correlations between different data sets, multi-fidelity methods often yield superior generalization when compared to models based solely on a small amount of high-fidelity data. In this work, we present the use of artificial neural networks applied to multi-fidelity regression problems. By elaborating a few existing approaches, we propose new neural network architectures for multi-fidelity regression. The introduced models are compared against a traditional multi-fidelity scheme, co-kriging. A collection of artificial benchmarks are presented to measure the performance of the analyzed models. The results show that cross-validation in combination with Bayesian optimization consistently leads to neural network models that outperform the co-kriging scheme. Additionally, we show an application of multi-fidelity regression to an engineering problem. The propagation of a pressure wave into an acoustic horn with parametrized shape and frequency is considered, and the index of reflection intensity is approximated using the multi-fidelity models. A finite element model and a reduced basis model are adopted as the high- and low-fidelity, respectively. It is shown that the multi-fidelity neural network returns outputs that achieve a comparable accuracy to those from the expensive, full-order model, using only very few full-order evaluations combined with a larger amount of inaccurate but cheap evaluations of a reduced order model.

Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control

Abstract: Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world data sets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900-1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control.

Error estimates for DeepOnets: A deep learning framework in infinite dimensions.

Abstract: DeepOnets have recently been proposed as a framework for learning nonlinear operators mapping between infinite dimensional Banach spaces. We analyze DeepOnets and prove estimates on the resulting approximation and generalization errors. In particular, we extend the universal approximation property of DeepOnets to include measurable mappings in non-compact spaces. By a decomposition of the error into encoding, approximation and reconstruction errors, we prove both lower and upper bounds on the total error, relating it to the spectral decay properties of the covariance operators, associated with the underlying measures. We derive almost optimal error bounds with very general affine reconstructors and with random sensor locations as well as bounds on the generalization error, using covering number arguments. We illustrate our general framework with four prototypical examples of nonlinear operators, namely those arising in a nonlinear forced ODE, an elliptic PDE with variable coefficients and nonlinear parabolic and hyperbolic PDEs. In all these examples, we prove that DeepOnets break the curse of dimensionality, thus demonstrating the efficient approximation of infinite-dimensional operators with this machine learning framework.

A rank-adaptive robust integrator for dynamical low-rank approximation.

Abstract: A rank-adaptive integrator for the dynamical low-rank approximation of matrix and tensor differential equations is presented. The fixed-rank integrator recently proposed by two of the authors is extended to allow for an adaptive choice of the rank, using subspaces that are generated by the integrator itself. The integrator first updates the evolving bases and then does a Galerkin step in the subspace generated by both the new and old bases, which is followed by rank truncation to a given tolerance. It is shown that the adaptive low-rank integrator retains the exactness, robustness and symmetry-preserving properties of the previously proposed fixed-rank integrator. Beyond that, up to the truncation tolerance, the rank-adaptive integrator preserves the norm when the differential equation does, it preserves the energy for Schrodinger equations and Hamiltonian systems, and it preserves the monotonic decrease of the functional in gradient flows. Numerical experiments illustrate the behaviour of the rank-adaptive integrator.

Spectral Monic Chebyshev Approximation for Higher Order Differential Equations.

Abstract: This paper is focused on performing a new method for solving linear and nonlinear higher-order boundary value problems (HBVPs). This direct numerical method based on spectral method. The trial function of this method is the Monic Chebyshev polynomials (MCPs). This method was relying on derivative of MCPs which explicit in the series expansion. The advantage of this method is solved HBVPs without transforming it to a system of lower-order ordinary differential equations (ODEs). This method supported by examples of HBVPs in wide application. The mentioned examples showed that the proposed method is efficient and accurate.

Construction of arbitrary order finite element degree-of-freedom maps on polygonal and polyhedral cell meshes.

Abstract: We develop an approach to generating degree-of-freedom maps for arbitrary order finite element spaces for any cell shape. The approach is based on the composition of permutations and transformations by cell sub-entity. Current approaches to generating degree-of-freedom maps for arbitrary order problems typically rely on a consistent orientation of cell entities that permits the definition of a common local coordinate system on shared edges and faces. However, while orientation of a mesh is straightforward for simplex cells and is a local operation, it is not a strictly local operation for quadrilateral cells and in the case of hexahedral cells not all meshes are orientable. The permutation and transformation approach is developed for a range of element types, including Lagrange, and divergence- and curl-conforming elements, and for a range of cell shapes. The approach is local and can be applied to cells of any shape, including general polytopes and meshes with mixed cell types. A number of examples are presented and the developed approach has been implemented in an open-source finite element library.

Tensors in computations

Abstract: The notion of a tensor captures three great ideas: equivariance, multilinearity, separability. But trying to be three things at once makes the notion difficult to understand. We will explain tensors in an accessible and elementary way through the lens of linear algebra and numerical linear algebra, elucidated with examples from computational and applied mathematics.

Analysis-suitable unstructured T-splines: Multiple extraordinary points per face.

Abstract: Analysis-suitable T-splines (AST-splines) are a promising candidate to achieve a seamless integration between the design and the analysis of thin-walled structures in industrial settings. In this work, we generalize AST-splines to allow multiple extraordinary points within the same face. This generalization drastically increases the flexibility to build geometries using AST-splines; e.g., much coarser meshes can be generated to represent a certain geometry. The AST-spline spaces detailed in this work have $C^1$ inter-element continuity near extraordinary points and $C^2$ inter-element continuity elsewhere. We mathematically show that AST-splines with multiple extraordinary points per face are linearly independent and their polynomial basis functions form a non-negative partition of unity. We numerically show that AST-splines with multiple extraordinary points per face lead to optimal convergence rates for second- and fourth-order linear elliptic problems. To illustrate a possible isogeometric framework that is already available, we design the B-pillar and the side outer panel of a car using T-splines with the commercial software Autodesk Fusion360, import the control nets into our in-house code to build AST-splines, and import the Bezier extraction information into the commercial software LS-DYNA to solve eigenvalue problems. The results are compared with conventional finite elements. Good agreement is found, but conventional finite elements require significantly more degrees of freedom to reach a converged solution than AST-splines.

A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Equations

Abstract: This paper concerns the a priori generalization analysis of the Deep Ritz Method (DRM) [W. E and B. Yu, 2017], a popular neural-network-based method for solving high dimensional partial differential equations. We derive the generalization error bounds of two-layer neural networks in the framework of the DRM for solving two prototype elliptic PDEs: Poisson equation and static Schrodinger equation on the $d$-dimensional unit hypercube. Specifically, we prove that the convergence rates of generalization errors are independent of the dimension $d$, under the a priori assumption that the exact solutions of the PDEs lie in a suitable low-complexity space called spectral Barron space. Moreover, we give sufficient conditions on the forcing term and the potential function which guarantee that the solutions are spectral Barron functions. We achieve this by developing a new solution theory for the PDEs on the spectral Barron space, which can be viewed as an analog of the classical Sobolev regularity theory for PDEs.

High order direct parametrisation of invariant manifolds for model order reduction of finite element structures: application to large amplitude vibrations and uncovering of a folding point.

Abstract: This paper investigates model-order reduction methods for geometrically nonlinear structures. The parametrisation method of invariant manifolds is used and adapted to the case of mechanical systems expressed in the physical basis, so that the technique is directly applicable to problems discretised by the finite element method. Two nonlinear mappings, respectively related to displacement and velocity, are introduced, and the link between the two is made explicit at arbitrary order of expansion. The same development is performed on the reduced-order dynamics which is computed at generic order following the different styles of parametrisation. More specifically, three different styles are introduced and commented: the graph style, the complex normal form style and the real normal form style. These developments allow making better connections with earlier works using these parametrisation methods. The technique is then applied to three different examples. A clamped-clamped arch with increasing curvature is first used to show an example of a system with a softening behaviour turning to hardening at larger amplitudes, which can be replicated with a single mode reduction. Secondly, the case of a cantilever beam is investigated. It is shown that the invariant manifold of the first mode shows a folding point at large amplitudes which is not connected to an internal resonance. This exemplifies the failure of the graph style due to the folding point, whereas the normal form style is able to pass over the folding. Finally, A MEMS micromirror undergoing large rotations is used to show the importance of using high-order expansions on an industrial example.

Computational methods for large-scale inverse problems: a survey on hybrid projection methods.

Abstract: This paper surveys an important class of methods that combine iterative projection methods and variational regularization methods for large-scale inverse problems. Iterative methods such as Krylov subspace methods are invaluable in the numerical linear algebra community and have proved important in solving inverse problems due to their inherent regularizing properties and their ability to handle large-scale problems. Variational regularization describes a broad and important class of methods that are used to obtain reliable solutions to inverse problems, whereby one solves a modified problem that incorporates prior knowledge. Hybrid projection methods combine iterative projection methods with variational regularization techniques in a synergistic way, providing researchers with a powerful computational framework for solving very large inverse problems. Although the idea of a hybrid Krylov method for linear inverse problems goes back to the 1980s, several recent advances on new regularization frameworks and methodologies have made this field ripe for extensions, further analyses, and new applications. In this paper, we provide a practical and accessible introduction to hybrid projection methods in the context of solving large (linear) inverse problems.

Symplectic integration of learned Hamiltonian systems.

Abstract: Hamiltonian systems are differential equations which describe systems in classical mechanics, plasma physics, and sampling problems. They exhibit many structural properties, such as a lack of attractors and the presence of conservation laws. To predict Hamiltonian dynamics based on discrete trajectory observations, incorporation of prior knowledge about Hamiltonian structure greatly improves predictions. This is typically done by learning the system's Hamiltonian and then integrating the Hamiltonian vector field with a symplectic integrator. For this, however, Hamiltonian data needs to be approximated based on the trajectory observations. Moreover, the numerical integrator introduces an additional discretisation error. In this paper, we show that an inverse modified Hamiltonian structure adapted to the geometric integrator can be learned directly from observations. A separate approximation step for the Hamiltonian data avoided. The inverse modified data compensates for the discretisation error such that the discretisation error is eliminated.

A general and fast convolution-based method for peridynamics: applications to elasticity and brittle fracture.

Abstract: We introduce a general and fast convolution-based method (FCBM) for peridynamics (PD). Expressing the PD integrals in terms of convolutions and computing them by fast Fourier transform (FFT), we reduce the computational complexity of PD models from O(N^2) to O(Nlog_2 N), with N being the total number of discretization nodes. Initial neighbor identification and storing neighbor information is not required, and, as a consequence, memory allocation scales with O(N) instead of O(N^2), common for existing methods. The method is applicable to bounded domains with arbitrary shapes and boundary conditions via an embedded constraint (EC) approach. We explain the FCBM-EC formulation for certain bond-based and state-based, linear and nonlinear PD models of elasticity and dynamic brittle fracture, as applications. We solve a 3D elastostatic problem and show that the FCBM reduces the computational time from days to hours and from years to days, compared with the original meshfree discretization for PD models. Large-scale computations of PD models are feasible with the new method, and we demonstrate its versatility by simulating, with ease, the difficult problem of multiple crack branching in a brittle plate.

Tensor Random Projection for Low Memory Dimension Reduction.

Abstract: Random projections reduce the dimension of a set of vectors while preserving structural information, such as distances between vectors in the set. This paper proposes a novel use of row-product random matrices in random projection, where we call it Tensor Random Projection (TRP). It requires substantially less memory than existing dimension reduction maps. The TRP map is formed as the Khatri-Rao product of several smaller random projections, and is compatible with any base random projection including sparse maps, which enable dimension reduction with very low query cost and no floating point operations. We also develop a reduced variance extension. We provide a theoretical analysis of the bias and variance of the TRP, and a non-asymptotic error analysis for a TRP composed of two smaller maps. Experiments on both synthetic and MNIST data show that our method performs as well as conventional methods with substantially less storage.

The Neural Network shifted-Proper Orthogonal Decomposition: a Machine Learning Approach for Non-linear Reduction of Hyperbolic Equations

Abstract: Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate the Kolmogorov N-width decay thereby obtaining smaller linear subspaces with improved accuracy. These methods however must rely on the knowledge of the characteristic speeds in phase space of the solution, limiting their range of applicability to problems with explicit functional form for the advection field. In this work we approach the problem of automatically detecting the correct pre-processing transformation in a statistical learning framework by implementing a deep-learning architecture. The purely data-driven method allowed us to generalise the existing approaches of linear subspace manipulation to non-linear hyperbolic problems with unknown advection fields. The proposed algorithm has been validated against simple test cases to benchmark its performances and later successfully applied to a multiphase simulation.

An Introduction to Multi-point Flux (MPFA) and Stress (MPSA) Finite Volume Methods for Thermo-poroelasticity

Abstract: In this chapter, we give a unified introduction to the MPFA- and MPSA-type finite volume methods for Darcy flow and poro-elasticity, applicable to general polyhedral grids. This leads to a more systematic perspective of these methods than has been exposed in previous texts, and we therefore refer to this discretization family as the MPxA methods. We apply this MPxA framework to also define a consistent finite-volume discretization of thermo-poro-elasticity. The present chapter introduces the general theory and state-of-the-art of MPFA-type methods, leaving the more technical results to the provided references. We close the chapter by a section containing applications to problems with complex geometries and non-linear physics.

A proof of convergence for gradient descent in the training of artificial neural networks for constant target functions.

Abstract: Gradient descent optimization algorithms are the standard ingredients that are used to train artificial neural networks (ANNs). Even though a huge number of numerical simulations indicate that gradient descent optimization methods do indeed convergence in the training of ANNs, until today there is no rigorous theoretical analysis which proves (or disproves) this conjecture. In particular, even in the case of the most basic variant of gradient descent optimization algorithms, the plain vanilla gradient descent method, it remains an open problem to prove or disprove the conjecture that gradient descent converges in the training of ANNs. In this article we solve this problem in the special situation where the target function under consideration is a constant function. More specifically, in the case of constant target functions we prove in the training of rectified fully-connected feedforward ANNs with one-hidden layer that the risk function of the gradient descent method does indeed converge to zero. Our mathematical analysis strongly exploits the property that the rectifier function is the activation function used in the considered ANNs. A key contribution of this work is to explicitly specify a Lyapunov function for the gradient flow system of the ANN parameters. This Lyapunov function is the central tool in our convergence proof of the gradient descent method.

The role of mesh quality and mesh quality indicators in the Virtual Element Method.

Abstract: Since its introduction, the Virtual Element Method (VEM) was shown to be able to deal with a large variety of polygons, while achieving good convergence rates. The regularity assumptions proposed in the VEM literature to guarantee the convergence on a theoretical basis are therefore quite general. They have been deduced in analogy to the similar conditions developed in the Finite Element Methods (FEMs) analysis. In this work, we experimentally show that the VEM still converges with almost optimal rates and low errors in the L2 and H1 norms even if we significantly break the regularity assumptions that are used in the literature. These results suggest that the regularity assumptions proposed so far might be overestimated. We also exhibit examples on which the VEM sub-optimally converges or diverges. Finally, we introduce a mesh quality indicator that experimentally correlates the entity of the violation of the regularity assumptions and the performance of the VEM solution, thus predicting if a dataset is potentially critical for VEM.

A General-Purpose, Inelastic, Rotation-Free Kirchhoff-Love Shell Formulation for Peridynamics.

Abstract: We present a comprehensive rotation-free Kirchhoff-Love (KL) shell formulation for peridynamics (PD) that is capable of modeling large elasto-plastic deformations and fracture in thin-walled structures. To remove the need for a predefined global parametric domain, Principal Component Analysis is employed in a meshfree setting to develop a local parameterization of the shell midsurface. The KL shell kinematics is utilized to develop a correspondence-based PD formulation. A bond-stabilization technique is employed to naturally achieve stability of the discrete solution. Only the mid-surface velocity degrees of freedom are used in the governing thin-shell equations. 3D rate-form material models are employed to enable simulating a wide range of material behavior. A bond-associative damage correspondence modeling approach is adopted to use classical failure criteria at the bond level, which readily enables the simulation of brittle and ductile fracture. \NAT{Discretizing the model with asymptotically compatible meshfree approximation provides a scheme which converges to the classical KL shell model while providing an accurate and flexible framework for treating fracture.} A wide range of numerical examples, ranging from elastostatics to problems involving plasticity, fracture, and fragmentation, are conducted to validate the accuracy, convergence, and robustness of the developed PD thin-shell formulation. It is also worth noting that the present method naturally enables the discretization of a shell theory requiring higher-order smoothness on a completely unstructured surface mesh.

The numerical greatest common divisor of univariate polynomials.

Abstract: This paper presents a regularization theory for numerical computation of polynomial greatest common divisors and a convergence analysis, along with a detailed description of a blackbox-type algorithm. The root of the ill-posedness in conventional GCD computation is identified by its geometry where polynomials form differentiable manifolds entangled in a stratification structure. With a proper regularization, the numerical GCD is proved to be strongly well-posed. Most importantly, the numerical GCD solves the problem of finding the GCD accurately using floating point arithmetic even if the data are perturbed. A sensitivity measurement, error bounds at each computing stage, and the overall convergence are established rigorously. The computing results of selected test examples show that the algorithm and software appear to be robust and accurate.

3D-0D closed-loop model for the simulation of cardiac biventricular electromechanics.

Abstract: Two crucial factors for accurate numerical simulations of cardiac electromechanics, which are also essential to reproduce the synchronous activity of the heart, are: i) accounting for the interaction between the heart and the circulatory system that determines pressures and volumes loads in the heart chambers; ii) reconstructing the muscular fiber architecture that drives the electrophysiology signal and the myocardium contraction. In this work, we present a 3D biventricular electromechanical model coupled with a 0D closed-loop model of the whole cardiovascular system that addresses the two former crucial factors. With this aim, we introduce a boundary condition for the mechanical problem that accounts for the neglected part of the domain located on top of the biventricular basal plane and that is consistent with the principles of momentum and energy conservation. We also discuss in detail the coupling conditions that stand behind the 3D and the 0D models. We perform electromechanical simulations in physiological conditions using the 3D-0D model and we show that our results match the experimental data of relevant mechanical biomarkers available in literature. Furthermore, we investigate different arrangements in cross-fibers active contraction. We prove that an active tension along the sheet direction counteracts the myofiber contraction, while the one along the sheet-normal direction enhances the cardiac work. Finally, several myofiber architectures are analysed. We show that a different fiber field in the septal area and in the transmural wall effect the pumping functionality of the left ventricle.

Machine learning moment closure models for the radiative transfer equation I: directly learning a gradient based closure.

Abstract: In this paper, we take a data-driven approach and apply machine learning to the moment closure problem for radiative transfer equation in slab geometry. Instead of learning the unclosed high order moment, we propose to directly learn the gradient of the high order moment using neural networks. This new approach is consistent with the exact closure we derive for the free streaming limit and also provides a natural output normalization. A variety of benchmark tests, including the variable scattering problem, the Gaussian source problem and the two material problem, show both good accuracy and generalizability of our machine learning closure model.

Coupling of IGA and Peridynamics for Air-Blast Fluid-Structure Interaction Using an Immersed Approach

Abstract: We present a novel formulation based on an immersed coupling of Isogeometric Analysis (IGA) and Peridynamics (PD) for the simulation of fluid-structure interaction (FSI) phenomena for air blast. We aim to develop a practical computational framework that is capable of capturing the mechanics of air blast coupled to solids and structures that undergo large, inelastic deformations with extreme damage and fragmentation. An immersed technique is used, which involves an a priori monolithic FSI formulation with the implicit detection of the fluid-structure interface and without limitations on the solid domain motion. The coupled weak forms of the fluid and structural mechanics equations are solved on the background mesh. Correspondence-based PD is used to model the meshfree solid in the foreground domain. We employ the Non-Uniform Rational B-Splines (NURBS) IGA functions in the background and the Reproducing Kernel Particle Method (RKPM) functions for the PD solid in the foreground. We feel that the combination of these numerical tools is particularly attractive for the problem class of interest due to the higher-order accuracy and smoothness of IGA and RKPM, the benefits of using immersed methodology in handling the fluid-structure coupling, and the capabilities of PD in simulating fracture and fragmentation scenarios. Numerical examples are provided to illustrate the performance of the proposed air-blast FSI framework.

Hull shape design optimization with parameter space and model reductions, and self-learning mesh morphing

Abstract: In the field of parametric partial differential equations, shape optimization represents a challenging problem due to the required computational resources. In this contribution, a data-driven framework involving multiple reduction techniques is proposed to reduce such computational burden. Proper orthogonal decomposition (POD) and active subspace genetic algorithm (ASGA) are applied for a dimensional reduction of the original (high fidelity) model and for an efficient genetic optimization based on active subspace property. The parameterization of the shape is applied directly to the computational mesh, propagating the generic deformation map applied to the surface (of the object to optimize) to the mesh nodes using a radial basis function (RBF) interpolation. Thus, topology and quality of the original mesh are preserved, enabling application of POD-based reduced order modeling techniques, and avoiding the necessity of additional meshing steps. Model order reduction is performed coupling POD and Gaussian process regression (GPR) in a data-driven fashion. The framework is validated on a benchmark ship.

Eighty Years of the Finite Element Method: Birth, Evolution, and Future.

Abstract: This year marks the eightieth anniversary of the invention of the finite element method (FEM). FEM has become the computational workhorse for engineering design analysis and scientific modeling of a wide range of physical processes, including material and structural mechanics, fluid flow and heat conduction, various biological processes for medical diagnosis and surgery planning, electromagnetics and semi-conductor circuit and chip design and analysis, additive manufacturing, i.e. virtually every conceivable problem that can be described by partial differential equations (PDEs). FEM has fundamentally revolutionized the way we do scientific modeling and engineering design, ranging from automobiles, aircraft, marine structures, bridges, highways, and high-rise buildings. Associated with the development of finite element methods has been the concurrent development of an engineering science discipline called computational mechanics, or computational science and engineering. In this paper, we present a historical perspective on the developments of finite element methods mainly focusing on its applications and related developments in solid and structural mechanics, with limited discussions to other fields in which it has made significant impact, such as fluid mechanics, heat transfer, and fluid-structure interaction. To have a complete storyline, we divide the development of the finite element method into four time periods: I. (1941-1965) Early years of FEM; II. (1966-1991) Golden age of FEM; III. (1992-2017) Large scale, industrial applications of FEM and development of material modeling, and IV (2018-) the state-of-the-art FEM technology for the current and future eras of FEM research. Note that this paper may not strictly follow the chronological order of FEM developments, because often time these developments were interwoven across different time periods.

On the stability of robust dynamical low-rank approximations for hyperbolic problems

Abstract: The dynamical low-rank approximation (DLRA) is used to treat high-dimensional problems that arise in such diverse fields as kinetic transport and uncertainty quantification. Even though it is well known that certain spatial and temporal discretizations when combined with the DLRA approach can result in numerical instability, this phenomenon is poorly understood. In this paper we perform a L2 stability analysis for the corresponding nonlinear equations of motion. This reveals the source of the instability for the projector splitting integrator when first discretizing the equations and then applying the DLRA. Based on this we propose a projector splitting integrator, based on applying DLRA to the continuous system before performing the discretization, that recovers the classic CFL condition. We also show that the unconventional integrator has more favorable stability properties and explain why the projector splitting integrator performs better when approximating higher moments, while the unconventional integrator is generally superior for first order moments. Furthermore, an efficient and stable dynamical low-rank update for the scattering term in kinetic transport is proposed. Numerical experiments for kinetic transport and uncertainty quantification, which confirm the results of the stability analysis, are presented.