Showing papers in "arXiv: Numerical Analysis in 2013"

On Dynamic Mode Decomposition: Theory and Applications

Abstract: Originally introduced in the fluid mechanics community, dynamic mode decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of nonlinear systems. However, existing DMD theory deals primarily with sequential time series for which the measurement dimension is much larger than the number of measurements taken. We present a theoretical framework in which we define DMD as the eigendecomposition of an approximating linear operator. This generalizes DMD to a larger class of datasets, including nonsequential time series. We demonstrate the utility of this approach by presenting novel sampling strategies that increase computational efficiency and mitigate the effects of noise, respectively. We also introduce the concept of linear consistency, which helps explain the potential pitfalls of applying DMD to rank-deficient datasets, illustrating with examples. Such computations are not considered in the existing literature, but can be understood using our more general framework. In addition, we show that our theory strengthens the connections between DMD and Koopman operator theory. It also establishes connections between DMD and other techniques, including the eigensystem realization algorithm (ERA), a system identification method, and linear inverse modeling (LIM), a method from climate science. We show that under certain conditions, DMD is equivalent to LIM.

M-Tensors and Nonsingular M-Tensors

Abstract: The M-matrix is an important concept in matrix theory, and has many applications. Recently, this concept has been extended to higher order tensors [18]. In this paper, we establish some important properties of M-tensors and nonsingular M-tensors. An M-tensor is a Z-tensor. We show that a Z-tensor is a nonsingular M-tensor if and only if it is semi-positive. Thus, a nonsingular M-tensor has all positive diagonal entries; and an M-tensor, regarding as the limitation of a series of nonsingular M-tensors, has all nonnegative diagonal entries. We introduce even-order monotone tensors and present their spectral properties. In matrix theory, a Z-matrix is a nonsingular M-matrix if and only if it is monotone. This is no longer true in the case of higher order tensors. We show that an even-order monotone Z-tensor is an even-order nonsingular M-tensor but not vice versa. An example of an even-order nontrivial monotone Z-tensor is also given.

A new tool to study real dynamics: The Convergence Plane

Abstract: In this paper, the author presents a new tool, called The Convergence Plane, that allows to study the real dynamics of iterative methods whose iterations depends on one parameter in an easy and compact way. This tool can be used, inter alia, to find the elements of a family that have good convergence properties and discard the bad ones or to see how the basins of attraction changes along the elements of the family. To show the applicability of the tool an example of the dynamics of the Damped Newton's method applied to a cubic polynomial is presented.

Weak Galerkin Finite Element Methods for the Biharmonic Equation on Polytopal Meshes

Abstract: A new weak Galerkin (WG) finite element method is introduced and analyzed in this paper for the biharmonic equation in its primary form. This method is highly robust and flexible in the element construction by using discontinuous piecewise polynomials on general finite element partitions consisting of polygons or polyhedra of arbitrary shape. The resulting WG finite element formulation is symmetric, positive definite, and parameter-free. Optimal order error estimates in a discrete $H^2$ norm is established for the corresponding WG finite element solutions. Error estimates in the usual $L^2$ norm are also derived, yielding a sub-optimal order of convergence for the lowest order element and an optimal order of convergence for all high order of elements. Numerical results are presented to confirm the theory of convergence under suitable regularity assumptions.

Adaptive Primal-Dual Hybrid Gradient Methods for Saddle-Point Problems

Abstract: The Primal-Dual hybrid gradient (PDHG) method is a powerful optimization scheme that breaks complex problems into simple sub-steps. Unfortunately, PDHG methods require the user to choose stepsize parameters, and the speed of convergence is highly sensitive to this choice. We introduce new adaptive PDHG schemes that automatically tune the stepsize parameters for fast convergence without user inputs. We prove rigorous convergence results for our methods, and identify the conditions required for convergence. We also develop practical implementations of adaptive schemes that formally satisfy the convergence requirements. Numerical experiments show that adaptive PDHG methods have advantages over non-adaptive implementations in terms of both efficiency and simplicity for the user.

Multilevel Monte Carlo methods

Abstract: The author's presentation of multilevel Monte Carlo path simulation at the MCQMC 2006 conference stimulated a lot of research into multilevel Monte Carlo methods. This paper reviews the progress since then, emphasising the simplicity, flexibility and generality of the multilevel Monte Carlo approach. It also offers a few original ideas and suggests areas for future research.

Discontinuous Galerkin method for fractional convection-diffusion equations

Abstract: We propose a discontinuous Galerkin method for convection-subdiffusion equations with a fractional operator of order $\alpha (1<\alpha<2)$ defined through the fractional Laplacian. The fractional operator of order $\alpha$ is expressed as a composite of first order derivatives and fractional integrals of order $2-\alpha$, and the fractional convection-diffusion problem is expressed as a system of low order differential/integral equations and a local discontinuous Galerkin method scheme is derived for the equations. We prove stability and optimal order of convergence O($h^{k+1}$) for subdiffusion, and an order of convergence of ${\cal O}(h^{k+1/2})$ is established for the general fractional convection-diffusion problem. The analysis is confirmed by numerical examples.

Drawing dynamical and parameter planes of iterative families and methods

Abstract: In this paper the complex dynamical analysis of the parametric fourth-order Kim's iterative family is made on quadratic polynomials, showing the Matlab codes generated to draw the fractal images necessary to complete the study. The parameter spaces associated to the free critical points have been analyzed, showing the stable (and unstable) regions where the selection of the parameter will provide us excellent schemes (or dreadful ones).

Numerical Methods for the Fractional Laplacian: a Finite Difference-quadrature Approach

Abstract: The fractional Laplacian $(-\Delta)^{\alpha/2}$ is a non-local operator which depends on the parameter $\alpha$ and recovers the usual Laplacian as $\alpha \to 2$. A numerical method for the fractional Laplacian is proposed, based on the singular integral representation for the operator. The method combines finite difference with numerical quadrature, to obtain a discrete convolution operator with positive weights. The accuracy of the method is shown to be $O(h^{3-\alpha})$. Convergence of the method is proven. The treatment of far field boundary conditions using an asymptotic approximation to the integral is used to obtain an accurate method. Numerical experiments on known exact solutions validate the predicted convergence rates. Computational examples include exponentially and algebraically decaying solution with varying regularity. The generalization to nonlinear equations involving the operator is discussed: the obstacle problem for the fractional Laplacian is computed.

The deal.II Library, Version 8.1

Abstract: This paper provides an overview of the new features of the finite element library deal.II version 8.1.

A Weak Galerkin Finite Element Method with Polynomial Reduction

Abstract: The novel idea of weak Galerkin (WG) finite element methods is on the use of weak functions and their weak derivatives defined as distributions. Weak functions and weak derivatives can be approximated by polynomials with various degrees. Different combination of polynomial spaces leads to different weak Galerkin finite element methods, which makes WG methods highly flexible and efficient in practical computation. This paper explores the possibility of optimal combination of polynomial spaces that minimize the number of unknowns in the numerical scheme, yet without compromising the accuracy of the numerical approximation. For illustrative purpose, the authors use second order elliptic problems to demonstrate the basic idea of polynomial reduction. A new weak Galerkin finite element method is proposed and analyzed. This new finite element scheme features piecewise polynomials of degree $k\ge 1$ on each element plus piecewise polynomials of degree $k-1\ge 0$ on the edge or face of each element. Error estimates of optimal order are established for the corresponding WG approximations in both a discrete $H^1$ norm and the standard $L^2$ norm. In addition, the paper presents a great deal of numerical experiments to demonstrate the power of the WG method in dealing with finite element partitions consisting of arbitrary polygons in two dimensional spaces or polyhedra in three dimensional spaces. The numerical examples include various finite element partitions such as triangular mesh, quadrilateral mesh, honey comb mesh in 2d and mesh with deformed cubes in 3d. The numerical results show a great promise of the robustness, reliability, flexibility and accuracy of the WG method.

Model Reduction of Descriptor Systems by Interpolatory Projection Methods

Abstract: In this paper, we investigate interpolatory projection framework for model reduction of descriptor systems. With a simple numerical example, we first illustrate that employing subspace conditions from the standard state space settings to descriptor systems generically leads to unbounded H2 or H-infinity errors due to the mismatch of the polynomial parts of the full and reduced-order transfer functions. We then develop modified interpolatory subspace conditions based on the deflating subspaces that guarantee a bounded error. For the special cases of index-1 and index-2 descriptor systems, we also show how to avoid computing these deflating subspaces explicitly while still enforcing interpolation. The question of how to choose interpolation points optimally naturally arises as in the standard state space setting. We answer this question in the framework of the H2-norm by extending the Iterative Rational Krylov Algorithm (IRKA) to descriptor systems. Several numerical examples are used to illustrate the theoretical discussion.

A literature survey of low-rank tensor approximation techniques

Abstract: During the last years, low-rank tensor approximation has been established as a new tool in scientific computing to address large-scale linear and multilinear algebra problems, which would be intractable by classical techniques. This survey attempts to give a literature overview of current developments in this area, with an emphasis on function-related tensors.

Higher order qmc galerkin discretization for parametric operator equations

Abstract: We construct quasi-Monte Carlo methods to approximate the expected values of linear functionals of Galerkin discretizations of parametric operator equations which depend on a possibly infinite sequence of parameters. Such problems arise in the numerical solution of differential and integral equations with random field inputs. We analyze the regularity of the solutions with respect to the parameters in terms of the rate of decay of the fluctuations of the input field. If p ∈ (0,1) denotes the "summability exponent" corresponding to the fluctuations in affine-parametric families of operators, then we prove that deterministic "interlaced polynomial lattice rules" of order � = ⌊1/p⌋+1 in s dimensions with N points can be constructed using a fast component-by-component algorithm, in O(�sN logN + � 2 s 2 N) operations, to achieve a convergence rate of O(N 1/p ), with the implied constant independent of s. This dimension-independent convergence rate is superior to the rate O(N 1/p+1/2 ), for 2/3 ≤ p ≤ 1 recently established for randomly shifted lattice rules under comparable assumptions. In our analysis we use a non-standard Banach space setting and introduce "smoothness-driven product and order dependent (SPOD)" weights for which we show fast CBC construction. 1. Introduction. The efficient numerical computation of statistical quantities for solutions of partial differential and of integral equations with random inputs is a key task in uncertainty quantification in engineering and in the sciences. The quantity of interest is expressed as a mathematical expectation, and the efficient computation of these quantities involves two basic steps: i) the approximate (numerical) solution of the operator equation, and ii) the approximate evaluation of the mathematical expectation by numerical integration. In the present paper, we outline a strategy towards these two aims which is based on i) Galerkin discretization of the operator equation and on ii) Quasi-Monte Carlo (QMC) integration.

Error Analysis of Semidiscrete Finite Element Methods for Inhomogeneous Time-Fractional Diffusion

Abstract: We consider the initial boundary value problem for the inhomogeneous time-fractional diffusion equation with a homogeneous Dirichlet boundary condition and a nonsmooth right hand side data in a bounded convex polyhedral domain. We analyze two semidiscrete schemes based on the standard Galerkin and lumped mass finite element methods. Almost optimal error estimates are obtained for right hand side data $f(x,t)\in L^\infty(0,T;\dot H^q(\Omega))$, $-1< q \le 1$, for both semidiscrete schemes. For lumped mass method, the optimal $L^2(\Omega)$-norm error estimate requires symmetric meshes. Finally, numerical experiments for one- and two-dimensional examples are presented to verify our theoretical results.

A generalized empirical interpolation method : application of reduced basis techniques to data assimilation

Abstract: This paper, written as a tribute to Enrico Magenes, a giant that has kindly and warmly supported generations of young researchers, introduces a generalization of the empirical interpolation method (EIM) and the reduced basis method (RBM) in order to allow their combination with data mining and data assimilation. The purpose is to be able to derive sound information from data and reconstruct information, possibly taking into account noise in the acquisition, that can serve as an input to models expressed by partial differential equations. The approach combines data acquisition (with noise) with domain decomposition techniques and reduced basis approximations.

Double Greedy Algorithms: Reduced Basis Methods for Transport Dominated Problems

Abstract: The central objective of this paper is to develop reduced basis methods for parameter dependent transport dominated problems that are rigorously proven to exhibit rate-optimal performance when compared with the Kolmogorov $n$-widths of the solution sets. The central ingredient is the construction of computationally feasible "tight" surrogates which in turn are based on deriving a suitable well-conditioned variational formulation for the parameter dependent problem. The theoretical results are illustrated by numerical experiments for convection-diffusion and pure transport equations. In particular, the latter example sheds some light on the smoothness of the dependence of the solutions on the parameters.

Approximating spectral densities of large matrices

Abstract: In physics, it is sometimes desirable to compute the so-called \emph{Density Of States} (DOS), also known as the \emph{spectral density}, of a real symmetric matrix $A$. The spectral density can be viewed as a probability density distribution that measures the likelihood of finding eigenvalues near some point on the real line. The most straightforward way to obtain this density is to compute all eigenvalues of $A$. But this approach is generally costly and wasteful, especially for matrices of large dimension. There exists alternative methods that allow us to estimate the spectral density function at much lower cost. The major computational cost of these methods is in multiplying $A$ with a number of vectors, which makes them appealing for large-scale problems where products of the matrix $A$ with arbitrary vectors are relatively inexpensive. This paper defines the problem of estimating the spectral density carefully, and discusses how to measure the accuracy of an approximate spectral density. It then surveys a few known methods for estimating the spectral density, and proposes some new variations of existing methods. All methods are discussed from a numerical linear algebra point of view.

Active subspace methods in theory and practice: applications to kriging surfaces

Abstract: Many multivariate functions in engineering models vary primarily along a few directions in the space of input parameters. When these directions correspond to coordinate directions, one may apply global sensitivity measures to determine the most influential parameters. However, these methods perform poorly when the directions of variability are not aligned with the natural coordinates of the input space. We present a method to first detect the directions of the strongest variability using evaluations of the gradient and subsequently exploit these directions to construct a response surface on a low-dimensional subspace---i.e., the active subspace---of the inputs. We develop a theoretical framework with error bounds, and we link the theoretical quantities to the parameters of a kriging response surface on the active subspace. We apply the method to an elliptic PDE model with coefficients parameterized by 100 Gaussian random variables and compare it with a local sensitivity analysis method for dimension reduction.

Spectral Convergence of the connection Laplacian from random samples

Abstract: Spectral methods that are based on eigenvectors and eigenvalues of discrete graph Laplacians, such as Diffusion Maps and Laplacian Eigenmaps are often used for manifold learning and non-linear dimensionality reduction. It was previously shown by Belkin and Niyogi \cite{belkin_niyogi:2007} that the eigenvectors and eigenvalues of the graph Laplacian converge to the eigenfunctions and eigenvalues of the Laplace-Beltrami operator of the manifold in the limit of infinitely many data points sampled independently from the uniform distribution over the manifold. Recently, we introduced Vector Diffusion Maps and showed that the connection Laplacian of the tangent bundle of the manifold can be approximated from random samples. In this paper, we present a unified framework for approximating other connection Laplacians over the manifold by considering its principle bundle structure. We prove that the eigenvectors and eigenvalues of these Laplacians converge in the limit of infinitely many independent random samples. We generalize the spectral convergence results to the case where the data points are sampled from a non-uniform distribution, and for manifolds with and without boundary.

Analysis of a Mixed Finite Element Method for a Cahn-Hilliard-Darcy-Stokes System

Abstract: In this paper we devise and analyze a mixed finite element method for a modified Cahn-Hilliard equation coupled with a non-steady Darcy-Stokes flow that models phase separation and coupled fluid flow in immiscible binary fluids and diblock copolymer melts The time discretization is based on a convex splitting of the energy of the equation We prove that our scheme is unconditionally energy stable with respect to a spatially discrete analogue of the continuous free energy of the system and unconditionally uniquely solvable We prove that the phase variable is bounded in $L^\infty \left(0,T,L^\infty\right)$ and the chemical potential is bounded in $L^\infty \left(0,T,L^2\right)$ absolutely unconditionally in two and three dimensions, for any finite final time $T$ We subsequently prove that these variables converge with optimal rates in the appropriate energy norms in both two and three dimensions

Macroscopic modeling and simulations of room evacuation

Abstract: We analyze numerically two macroscopic models of crowd dynamics: the classical Hughes model and the second order model being an extension to pedestrian motion of the Payne-Whitham vehicular traffic model. The desired direction of motion is determined by solving an eikonal equation with density dependent running cost, which results in minimization of the travel time and avoidance of congested areas. We apply a mixed finite volume-finite element method to solve the problems and present error analysis for the eikonal solver, gradient computation and the second order model yielding a first order convergence. We show that Hughes' model is incapable of reproducing complex crowd dynamics such as stop-and-go waves and clogging at bottlenecks. Finally, using the second order model, we study numerically the evacuation of pedestrians from a room through a narrow exit.

Generalized multiscale finite element methods for wave propagation in heterogeneous media

Abstract: Numerical modeling of wave propagation in heterogeneous media is important in many applications. Due to the complex nature, direct numerical simulations on the fine grid are prohibitively expensive. It is therefore important to develop efficient and accurate methods that allow the use of coarse grids. In this paper, we present a multiscale finite element method for wave propagation on a coarse grid. The proposed method is based on the Generalized Multiscale Finite Element Method (GMsFEM). To construct multiscale basis functions, we start with two snapshot spaces in each coarse-grid block where one represents the degrees of freedom on the boundary and the other represents the degrees of freedom in the interior. We use local spectral problems to identify important modes in each snapshot space. These local spectral problems are different from each other and their formulations are based on the analysis. To our best knowledge, this is the first time where multiple snapshot spaces and multiple spectral problems are used and necessary for efficient computations. Using the dominant modes from local spectral problems, multiscale basis functions are constructed to represent the solution space locally within each coarse block. These multiscale basis functions are coupled via the symmetric interior penalty discontinuous Galerkin method which provides a block diagonal mass matrix, and, consequently, results in fast computations in an explicit time discretiza- tion. Our methods' stability and spectral convergence are rigorously analyzed. Numerical examples are presented to show our methods' performance. We also test oversampling strategies. In particular, we discuss how the modes from different snapshot spaces can affect the proposed methods' accuracy.

An Efficient Numerical Scheme for the Biharmonic Equation by Weak Galerkin Finite Element Methods on Polygonal or Polyhedral Meshes

Abstract: This paper presents a new and efficient numerical algorithm for the biharmonic equation by using weak Galerkin (WG) finite element methods. The WG finite element scheme is based on a variational form of the biharmonic equation that is equivalent to the usual $H^2$-semi norm. Weak partial derivatives and their approximations, called discrete weak partial derivatives, are introduced for a class of discontinuous functions defined on a finite element partition of the domain consisting of general polygons or polyhedra. The discrete weak partial derivatives serve as building blocks for the WG finite element method. The resulting matrix from the WG method is symmetric, positive definite, and parameter free. An error estimate of optimal order is derived in an $H^2$-equivalent norm for the WG finite element solutions. Error estimates in the usual $L^2$ norm are established, yielding optimal order of convergence for all the WG finite element algorithms except the one corresponding to the lowest order (i.e., piecewise quadratic elements). Some numerical experiments are presented to illustrate the efficiency and accuracy of the numerical scheme.

Multipoint Volterra Series Interpolation and H2 Optimal Model Reduction of Bilinear Systems

Abstract: In this paper, we focus on model reduction of large-scale bilinear systems The main contributions are threefold First, we introduce a new framework for interpolatory model reduction of bilinear systems In contrast to the existing methods where interpolation is forced on some of the leading subsystem transfer functions, the new framework shows how to enforce multipoint interpolation of the underlying Volterra series Then, we show that the first-order conditions for optimal H2 model reduction of bilinear systems require multivariate Hermite interpolation in terms of the new Volterra series interpolation framework; and thus we extend the interpolation-based first-order necessary conditions for H2 optimality of LTI systems to the bilinear case Finally, we show that multipoint interpolation on the truncated Volterra series representation of a bilinear system leads to an asymptotically optimal approach to H2 optimal model reduction, leading to an efficient model reduction algorithm Several numerical examples illustrate the effectiveness of the proposed approach

Galerkin approximations for the stochastic Burgers equation

Abstract: Existence and uniqueness for semilinear stochastic evolution equations with additive noise by means of finite dimensional Galerkin approximations is established and the convergence rate of the Galerkin approximations to the solution of the stochastic evolution equation is estimated. These abstract results are applied to several examples of stochastic partial differential equations (SPDEs) of evolutionary type including a stochastic heat equation, a stochastic reaction diffusion equation and a stochastic Burgers equation. The estimated convergence rates are illustrated by numerical simulations. The main novelty in this article is to estimate the difference of the finite dimensional Galerkin approximations and of the solution of the infinite dimensional SPDE uniformly in space, i.e., in the L^{\infty}-topology, instead of the usual Hilbert space estimates in the L^2-topology, that were shown before.

A Weak Galerkin Mixed Finite Element Method for Biharmonic Equations

Abstract: This article introduces and analyzes a weak Galerkin mixed finite element method for solving the biharmonic equation The weak Galerkin method, first introduced by two of the authors (J Wang and X Ye) in (Wang et al, Comput Appl Math 241:103–115, 2013) for second-order elliptic problems, is based on the concept of discrete weak gradients The method uses completely discrete finite element functions, and, using certain discrete spaces and with stabilization, it works on partitions of arbitrary polygon or polyhedron In this article, the weak Galerkin method is applied to discretize the Ciarlet–Raviart mixed formulation for the biharmonic equation In particular, an a priori error estimation is given for the corresponding finite element approximations The error analysis essentially follows the framework of Babuska, Osborn, and Pitkaranta (Math Comp 35:1039–1062, 1980) and uses specially designed mesh-dependent norms The proof is technically tedious due to the discontinuous nature of the weak Galerkin finite element functions Some computational results are presented to demonstrate the efficiency of the method

A spectrally accurate direct solution technique for frequency-domain scattering problems with variable media

Abstract: This paper presents a direct solution technique for the scattering of time-harmonic waves from a bounded region of the plane in which the wavenumber varies smoothly in space.The method constructs the interior Dirichlet-to-Neumann (DtN) map for the bounded region via bottom-up recursive merges of (discretization of) certain boundary operators on a quadtree of boxes.These operators take the form of impedance-to-impedance (ItI) maps. Since ItI maps are unitary, this formulation is inherently numerically stable, and is immune to problems of artificial internal resonances. The ItI maps on the smallest (leaf) boxes are built by spectral collocation on tensor-product grids of Chebyshev nodes. At the top level the DtN map is recovered from the ItI map and coupled to a boundary integral formulation of the free space exterior problem, to give a provably second kind equation.Numerical results indicate that the scheme can solve challenging problems 70 wavelengths on a side to 9-digit accuracy with 4 million unknowns, in under 5 minutes on a desktop workstation. Each additional solve corresponding to a different incident wave (right-hand side) then requires only 0.04 seconds.

Nonnegative Tensor Factorization, Completely Positive Tensors and an Hierarchical Elimination Algorithm

Abstract: Nonnegative tensor factorization has applications in statistics, computer vision, exploratory multiway data analysis and blind source separation. A symmetric nonnegative tensor, which has a symmetric nonnegative factorization, is called a completely positive (CP) tensor. The H-eigenvalues of a CP tensor are always nonnegative. When the order is even, the Z-eigenvalue of a CP tensor are all nonnegative. When the order is odd, a Z-eigenvector associated with a positive (negative) Z-eigenvalue of a CP tensor is always nonnegative (nonpositive). The entries of a CP tensor obey some dominance properties. The CP tensor cone and the copositive tensor cone of the same order are dual to each other. We introduce strongly symmetric tensors and show that a symmetric tensor has a symmetric binary decomposition if and only if it is strongly symmetric. Then we show that a strongly symmetric, hierarchically dominated nonnegative tensor is a CP tensor, and present a hierarchical elimination algorithm for checking this. Numerical examples are also given.

Description of the minimizers of least squares regularized~ with~ $\bm{\ell_0}$-norm. Uniqueness of the global minimizer

Abstract: We have an $\m\x $ real-valued arbitrary matrix $A$ (e.g. a dictionary) with $\m 0$. For several decades, this objective has attracted a ceaseless effort to conceive algorithms approaching a good minimizer. Our theoretical contributions, summarized below, shed new light on the existing algorithms and can help the conception of innovative numerical schemes. To solve the normal equation associated with any $\m$-row submatrix of $A$ is equivalent to compute a local minimizer $\hu$ of $\Fd$. (Local) minimizers $\hu$ of $\Fd$ are strict if and only if the submatrix, composed of those columns of $A$ whose indexes form the support of $\hu$, has full column rank. An outcome is that strict local minimizers of $\Fd$ are easily computed without knowing the value of $\be$. Each strict local minimizer is linear in data. It is proved that $\Fd$ has global minimizers and that they are always strict. They are studied in more details under the (standard) assumption that $\rank(A)=\m \be_\k$, all global minimizers of $\Fd$ are $\k$-sparse. An assumption on $A$ is adopted and proved to fail only on a closed negligible subset. Then for all data $d$ beyond a closed negligible subset, the objective $\Fd$ for $\be>\be_\k$, $\k\leq\m-1$, has a unique global minimizer and this minimizer is $\k$-sparse. Instructive small-size ($5\x 10$) numerical illustrations confirm the main theoretical results.