Signal Recovery from Random Measurements Via Orthogonal Matching Pursuit: The Gaussian Case
01 Aug 2007-
TL;DR: In this paper, a greedy algorithm called Orthogonal Matching Pursuit (OMP) was proposed to recover a signal with m nonzero entries in dimension 1 given O(m n d) random linear measurements of that signal.
Abstract: This report demonstrates theoretically and empirically that a greedy algorithm called
Orthogonal Matching Pursuit (OMP) can reliably recover a signal with m nonzero entries in dimension
d given O(mln d) random linear measurements of that signal. This is a massive improvement
over previous results, which require O(m2) measurements. The new results for OMP are comparable
with recent results for another approach called Basis Pursuit (BP). In some settings, the
OMP algorithm is faster and easier to implement, so it is an attractive alternative to BP for signal
recovery problems.
Citations
More filters
TL;DR: The result shows that MS-FCAP is capable of recovering the sampled sensor data accurately and efficiently, reflecting the real-time temperature change in the refrigerated truck during cold chain logistics, and providing effective decision support traceability for quality and safety assurance of frozen and chilled aquatic products.
78 citations
TL;DR: A new framework is proposed that allows the nodes to build a map of the parameter of interest with a small number of measurements and enables a novel non-invasive approach to mapping obstacles by using wireless channel measurements.
Abstract: In this paper, we consider a mobile cooperative network that is tasked with building a map of the spatial variations of a parameter of interest, such as an obstacle map or an aerial map. We propose a new framework that allows the nodes to build a map of the parameter of interest with a small number of measurements. By using the recent results in the area of compressive sensing, we show how the nodes can exploit the sparse representation of the parameter of interest in the transform domain in order to build a map with minimal sensing. The proposed work allows the nodes to efficiently map the areas that are not sensed directly. We consider three main areas essential to the cooperative operation of a mobile network: building a map of the spatial variations of a field of interest such as aerial mapping, mapping of the obstacles based on only wireless measurements, and mapping of the communication signal strength. For the case of obstacle mapping, we show how our framework enables a novel noninvasive mapping approach (without direct sensing), by using wireless channel measurements. Overall, our results demonstrate the potentials of this framework.
78 citations
TL;DR: The results indicate that the Bayesian formalism can provide a sharp and sparse image absence of side-lobes, which is the common problem in conventional imaging methods and has fewer artifacts compared with the previous version of CS-based methods.
Abstract: To achieve high-resolution two dimension images, synthetic aperture radar (SAR) with ultra wide-band faces considerably technical challenges such as long data collection time, huge amount of data storage and high hardware complexity In these years, several imaging modalities based on compressive sensing (CS) have been proposed which can provide high-resolution images using significantly reduced number of samples However, the CS-based methods are sensitive to noise and clutter In this study, a new imaging modality based on Bayesian compressive sensing (BCS) is proposed along with a novel compressed sampling scheme Clutter, which the previous CS-based methods not considered, is also included in this study This new imaging scheme requires minor change to traditional system and allows both range and azimuth compressed sampling Also, the Bayesian formalism accounts for additive noise encountered in the compressed measurement process Experiments are carried out with noisy and cluttered imaging scenes to verify the new imaging scheme The results indicate that the Bayesian formalism can provide a sharp and sparse image absence of side-lobes, which is the common problem in conventional imaging methods and has fewer artifacts compared with the previous version of CS-based methods
78 citations
TL;DR: A new parametric weighted L1 minimization algorithm for ISAR imaging based on the parametric sparse representation of ISAR signals is proposed, which can adaptively refine the basis matrix to achieve the best sparse representation for the ISar signals.
Abstract: It has been shown in the literature that, the inverse synthetic aperture radar (ISAR) echo can be seen as sparse and the ISAR imaging can be implemented by sparse recovery approaches. In this paper, we propose a new parametric weighted L1 minimization algorithm for ISAR imaging based on the parametric sparse representation of ISAR signals. Since the basis matrix used for sparse representation of ISAR signals is determined by the unknown rotation parameter of a moving target, we have to estimate both the ISAR image and basis matrix jointly. The proposed algorithm can adaptively refine the basis matrix to achieve the best sparse representation for the ISAR signals. Finally the high-resolution ISAR image is obtained by solving a weighted L1 minimization problem. Both numerical and real experiments are implemented to show the effectiveness of the proposed algorithm.
78 citations
TL;DR: A simple sparse channel estimation and tracking method for orthogonal frequency-division multiplexing (OFDM) systems based on a dynamic parametric channel model, where the channel is parameterized by a small number of distinct paths, each characterized by path delay and path gain, and all parameters are time varying.
Abstract: We propose a simple sparse channel estimation and tracking method for orthogonal frequency-division multiplexing (OFDM) systems based on a dynamic parametric channel model, where the channel is parameterized by a small number of distinct paths, each characterized by path delay and path gain, and all parameters are time varying. In the proposed method, we adaptively choose the delay grid and estimate each channel path delay iteratively. To further reduce the complexity, we also propose a tracking algorithm based on the fact that the changes in the channel path number and path delays are small over a few adjacent OFDM symbols. After the physical path delays are estimated, we then estimate the channel path gains by using the polynomial basis expansion model (P-BEM). Simulation results demonstrate the effectiveness of the proposed channel estimation and tracking method in dynamic environments. Compared with the compressive-sensing-based channel estimator using the orthogonal matching pursuit (OMP) algorithm, the new technique proposed here has much lower computational complexity while offering comparable performance.
78 citations
References
More filters
Book•
[...]
TL;DR: It is possible to design n=O(Nlog(m)) nonadaptive measurements allowing reconstruction with accuracy comparable to that attainable with direct knowledge of the N most important coefficients, and a good approximation to those N important coefficients is extracted from the n measurements by solving a linear program-Basis Pursuit in signal processing.
Abstract: Suppose x is an unknown vector in Ropfm (a digital image or signal); we plan to measure n general linear functionals of x and then reconstruct. If x is known to be compressible by transform coding with a known transform, and we reconstruct via the nonlinear procedure defined here, the number of measurements n can be dramatically smaller than the size m. Thus, certain natural classes of images with m pixels need only n=O(m1/4log5/2(m)) nonadaptive nonpixel samples for faithful recovery, as opposed to the usual m pixel samples. More specifically, suppose x has a sparse representation in some orthonormal basis (e.g., wavelet, Fourier) or tight frame (e.g., curvelet, Gabor)-so the coefficients belong to an lscrp ball for 0
18,609 citations
TL;DR: Basis Pursuit (BP) is a principle for decomposing a signal into an "optimal" superposition of dictionary elements, where optimal means having the smallest l1 norm of coefficients among all such decompositions.
Abstract: The time-frequency and time-scale communities have recently developed a large number of overcomplete waveform dictionaries --- stationary wavelets, wavelet packets, cosine packets, chirplets, and warplets, to name a few. Decomposition into overcomplete systems is not unique, and several methods for decomposition have been proposed, including the method of frames (MOF), Matching pursuit (MP), and, for special dictionaries, the best orthogonal basis (BOB).
Basis Pursuit (BP) is a principle for decomposing a signal into an "optimal" superposition of dictionary elements, where optimal means having the smallest l1 norm of coefficients among all such decompositions. We give examples exhibiting several advantages over MOF, MP, and BOB, including better sparsity and superresolution. BP has interesting relations to ideas in areas as diverse as ill-posed problems, in abstract harmonic analysis, total variation denoising, and multiscale edge denoising.
BP in highly overcomplete dictionaries leads to large-scale optimization problems. With signals of length 8192 and a wavelet packet dictionary, one gets an equivalent linear program of size 8192 by 212,992. Such problems can be attacked successfully only because of recent advances in linear programming by interior-point methods. We obtain reasonable success with a primal-dual logarithmic barrier method and conjugate-gradient solver.
9,950 citations
TL;DR: The authors introduce an algorithm, called matching pursuit, that decomposes any signal into a linear expansion of waveforms that are selected from a redundant dictionary of functions, chosen in order to best match the signal structures.
Abstract: The authors introduce an algorithm, called matching pursuit, that decomposes any signal into a linear expansion of waveforms that are selected from a redundant dictionary of functions. These waveforms are chosen in order to best match the signal structures. Matching pursuits are general procedures to compute adaptive signal representations. With a dictionary of Gabor functions a matching pursuit defines an adaptive time-frequency transform. They derive a signal energy distribution in the time-frequency plane, which does not include interference terms, unlike Wigner and Cohen class distributions. A matching pursuit isolates the signal structures that are coherent with respect to a given dictionary. An application to pattern extraction from noisy signals is described. They compare a matching pursuit decomposition with a signal expansion over an optimized wavepacket orthonormal basis, selected with the algorithm of Coifman and Wickerhauser see (IEEE Trans. Informat. Theory, vol. 38, Mar. 1992). >
9,380 citations
Stanford University1, Cleveland Clinic2, University of Toronto3, Centre national de la recherche scientifique4, Université Paris-Saclay5, University of Paris-Sud6, Avaya7, Rutgers University8, RAND Corporation9, IBM10, University of Pennsylvania11, University of Western Australia12, University of Minnesota13
TL;DR: A publicly available algorithm that requires only the same order of magnitude of computational effort as ordinary least squares applied to the full set of covariates is described.
Abstract: The purpose of model selection algorithms such as All Subsets, Forward Selection and Backward Elimination is to choose a linear model on the basis of the same set of data to which the model will be applied. Typically we have available a large collection of possible covariates from which we hope to select a parsimonious set for the efficient prediction of a response variable. Least Angle Regression (LARS), a new model selection algorithm, is a useful and less greedy version of traditional forward selection methods. Three main properties are derived: (1) A simple modification of the LARS algorithm implements the Lasso, an attractive version of ordinary least squares that constrains the sum of the absolute regression coefficients; the LARS modification calculates all possible Lasso estimates for a given problem, using an order of magnitude less computer time than previous methods. (2) A different LARS modification efficiently implements Forward Stagewise linear regression, another promising new model selection method; this connection explains the similar numerical results previously observed for the Lasso and Stagewise, and helps us understand the properties of both methods, which are seen as constrained versions of the simpler LARS algorithm. (3) A simple approximation for the degrees of freedom of a LARS estimate is available, from which we derive a Cp estimate of prediction error; this allows a principled choice among the range of possible LARS estimates. LARS and its variants are computationally efficient: the paper describes a publicly available algorithm that requires only the same order of magnitude of computational effort as ordinary least squares applied to the full set of covariates.
7,828 citations