Andrew M. Fraser

Bio: Andrew M. Fraser is an academic researcher from Los Alamos National Laboratory. The author has contributed to research in topics: Scattering & Expectation–maximization algorithm. The author has an hindex of 17, co-authored 37 publications receiving 5114 citations. Previous affiliations of Andrew M. Fraser include Portland State University & Mount Sinai Hospital.

Independent coordinates for strange attractors from mutual information.

Abstract: The mutual information I is examined for a model dynamical system and for chaotic data from an experiment on the Belousov-Zhabotinskii reaction. An N logN algorithm for calculating I is presented. As proposed by Shaw, a minimum in I is found to be a good criterion for the choice of time delay in phase-portrait reconstruction from time-series data. This criterion is shown to be far superior to choosing a zero of the autocorrelation function.

Information and entropy in strange attractors

Abstract: A technique for analyzing time-series data from experiments is presented that provides estimates of four basic characteristics of a system: (1) the measure-theoretic entropy; (2) the accuracy of the measurements; (3) the number of measurements necessary to specify a system state; and (4) the best delay time T to use in order to construct phase space portraits by the method of delays. These characteristics are obtained by separating the entropy of measurements into a part due to noise and parts due to deterministic effects. For the technique to work, the noise associated with each measurement must be independent of the noise associated with all other measurements. An algorithm for implementing the analysis is presented with three examples. >

Statistical Reconstruction for Cosmic Ray Muon Tomography

Abstract: Highly penetrating cosmic ray muons constantly shower the earth at a rate of about 1 muon per cm2 per minute We have developed a technique which exploits the multiple Coulomb scattering of these particles to perform nondestructive inspection without the use of artificial radiation In prior work , we have described heuristic methods for processing muon data to create reconstructed images In this paper, we present a maximum likelihood/expectation maximization tomographic reconstruction algorithm designed for the technique This algorithm borrows much from techniques used in medical imaging, particularly emission tomography, but the statistics of muon scattering dictates differences We describe the statistical model for multiple scattering, derive the reconstruction algorithm, and present simulated examples We also propose methods to improve the robustness of the algorithm to experimental errors and events departing from the statistical model

Tomographic Imaging with Cosmic Ray Muons

Abstract: Over 120 million vehicles enter the United States each year. Many are capable of transporting hidden nuclear weapons or nuclear material. Currently deployed X-ray radiography systems are limited because they cannot be used on occupied vehicles and the energy and dose are too low to penetrate many cargos. We present a new technique that overcomes these limitations by obtaining tomographic images using the multiple scattering of cosmic radiation as it transits each vehicle. When coupled with passive radiation detection, muon interrogation could contribute to safe and robust border protection against nuclear devices or material in occupied vehicles and containers.

Machine Learning : A Probabilistic Perspective

Abstract: Today's Web-enabled deluge of electronic data calls for automated methods of data analysis. Machine learning provides these, developing methods that can automatically detect patterns in data and then use the uncovered patterns to predict future data. This textbook offers a comprehensive and self-contained introduction to the field of machine learning, based on a unified, probabilistic approach. The coverage combines breadth and depth, offering necessary background material on such topics as probability, optimization, and linear algebra as well as discussion of recent developments in the field, including conditional random fields, L1 regularization, and deep learning. The book is written in an informal, accessible style, complete with pseudo-code for the most important algorithms. All topics are copiously illustrated with color images and worked examples drawn from such application domains as biology, text processing, computer vision, and robotics. Rather than providing a cookbook of different heuristic methods, the book stresses a principled model-based approach, often using the language of graphical models to specify models in a concise and intuitive way. Almost all the models described have been implemented in a MATLAB software package--PMTK (probabilistic modeling toolkit)--that is freely available online. The book is suitable for upper-level undergraduates with an introductory-level college math background and beginning graduate students.

Pattern formation outside of equilibrium

Abstract: A comprehensive review of spatiotemporal pattern formation in systems driven away from equilibrium is presented, with emphasis on comparisons between theory and quantitative experiments. Examples include patterns in hydrodynamic systems such as thermal convection in pure fluids and binary mixtures, Taylor-Couette flow, parametric-wave instabilities, as well as patterns in solidification fronts, nonlinear optics, oscillatory chemical reactions and excitable biological media. The theoretical starting point is usually a set of deterministic equations of motion, typically in the form of nonlinear partial differential equations. These are sometimes supplemented by stochastic terms representing thermal or instrumental noise, but for macroscopic systems and carefully designed experiments the stochastic forces are often negligible. An aim of theory is to describe solutions of the deterministic equations that are likely to be reached starting from typical initial conditions and to persist at long times. A unified description is developed, based on the linear instabilities of a homogeneous state, which leads naturally to a classification of patterns in terms of the characteristic wave vector q0 and frequency ω0 of the instability. Type Is systems (ω0=0, q0≠0) are stationary in time and periodic in space; type IIIo systems (ω0≠0, q0=0) are periodic in time and uniform in space; and type Io systems (ω0≠0, q0≠0) are periodic in both space and time. Near a continuous (or supercritical) instability, the dynamics may be accurately described via "amplitude equations," whose form is universal for each type of instability. The specifics of each system enter only through the nonuniversal coefficients. Far from the instability threshold a different universal description known as the "phase equation" may be derived, but it is restricted to slow distortions of an ideal pattern. For many systems appropriate starting equations are either not known or too complicated to analyze conveniently. It is thus useful to introduce phenomenological order-parameter models, which lead to the correct amplitude equations near threshold, and which may be solved analytically or numerically in the nonlinear regime away from the instability. The above theoretical methods are useful in analyzing "real pattern effects" such as the influence of external boundaries, or the formation and dynamics of defects in ideal structures. An important element in nonequilibrium systems is the appearance of deterministic chaos. A greal deal is known about systems with a small number of degrees of freedom displaying "temporal chaos," where the structure of the phase space can be analyzed in detail. For spatially extended systems with many degrees of freedom, on the other hand, one is dealing with spatiotemporal chaos and appropriate methods of analysis need to be developed. In addition to the general features of nonequilibrium pattern formation discussed above, detailed reviews of theoretical and experimental work on many specific systems are presented. These include Rayleigh-Benard convection in a pure fluid, convection in binary-fluid mixtures, electrohydrodynamic convection in nematic liquid crystals, Taylor-Couette flow between rotating cylinders, parametric surface waves, patterns in certain open flow systems, oscillatory chemical reactions, static and dynamic patterns in biological media, crystallization fronts, and patterns in nonlinear optics. A concluding section summarizes what has and has not been accomplished, and attempts to assess the prospects for the future.

Estimating mutual information.

Abstract: We present two classes of improved estimators for mutual information M(X,Y), from samples of random points distributed according to some joint probability density mu(x,y). In contrast to conventional estimators based on binnings, they are based on entropy estimates from k -nearest neighbor distances. This means that they are data efficient (with k=1 we resolve structures down to the smallest possible scales), adaptive (the resolution is higher where data are more numerous), and have minimal bias. Indeed, the bias of the underlying entropy estimates is mainly due to nonuniformity of the density at the smallest resolved scale, giving typically systematic errors which scale as functions of k/N for N points. Numerically, we find that both families become exact for independent distributions, i.e. the estimator M(X,Y) vanishes (up to statistical fluctuations) if mu(x,y)=mu(x)mu(y). This holds for all tested marginal distributions and for all dimensions of x and y. In addition, we give estimators for redundancies between more than two random variables. We compare our algorithms in detail with existing algorithms. Finally, we demonstrate the usefulness of our estimators for assessing the actual independence of components obtained from independent component analysis (ICA), for improving ICA, and for estimating the reliability of blind source separation.