Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

to be done in this area. Face recognition is a problem that scarcely clamoured for attention before the computer age but, having surfaced, has involved a wide range of techniques and has attracted the attention of some fine minds (David Mumford was a Fields Medallist in 1974). This singular application of mathematical modelling to a messy applied problem of obvious utility and importance but with no unique solution is a pretty one to share with students: perhaps, returning to the source of our opening quotation, we may invert Duncan's earlier observation, 'There is an art to find the mind's construction in the face!'.

Linear and nonlinear waves, by G. B. Whitham. Pp.636. £50. 1999. ISBN 0 471 35942 4 (Wiley).

Initial-value ordinary differential equation solution via variable order Adams method (SIVA/DIVA) package is collection of subroutines for solution of nonstiff ordinary differential equations. There are versions for single-precision and double-precision arithmetic. Requires fewer evaluations of derivatives than other variable-order Adams predictor/ corrector methods. Option for direct integration of second-order equations makes integration of trajectory problems significantly more efficient. Written in FORTRAN 77.

Solving Ordinary Differential Equations

Real and Complex Analysis

Monte Carlo is one of the most versatile and widely used numerical methods. Its convergence rate, O(N−1/2), is independent of dimension, which shows Monte Carlo to be very robust but also slow. This article presents an introduction to Monte Carlo methods for integration problems, including convergence theory, sampling methods and variance reduction techniques. Accelerated convergence for Monte Carlo quadrature is attained using quasi-random (also called low-discrepancy) sequences, which are a deterministic alternative to random or pseudo-random sequences. The points in a quasi-random sequence are correlated to provide greater uniformity. The resulting quadrature method, called quasi-Monte Carlo, has a convergence rate of approximately O((logN)kN−1). For quasi-Monte Carlo, both theoretical error estimates and practical limitations are presented. Although the emphasis in this article is on integration, Monte Carlo simulation of rarefied gas dynamics is also discussed. In the limit of small mean free path (that is, the fluid dynamic limit), Monte Carlo loses its effectiveness because the collisional distance is much less than the fluid dynamic length scale. Computational examples are presented throughout the text to illustrate the theory. A number of open problems are described.

http://dsec.pku.edu.cn/~tieli/notes/numer_anal/MCQMC_Caflisch.pdf

Monte Carlo and quasi-Monte Carlo methods

The Luria–Delbrück mutation model is a cornerstone of evolution theory and has been mathematically formulated in a number of ways. In this paper, we illustrate how this model of mutation rates can be derived by means of classical statistical mechanics tools—in particular, by modeling the phenomenon resorting to methodologies borrowed from classical kinetic theory of rarefied gases. The aim is to construct a linear kinetic model that can reproduce the Luria–Delbrück distribution starting from the elementary interactions that qualitatively and quantitatively describe the variations in mutated cells. The kinetic description is easily adaptable to different situations and makes it possible to clearly identify the differences between the elementary variations, leading to the Luria–Delbrück, Lea–Coulson, and Kendall formulations, respectively. The kinetic approach additionally emphasizes basic principles which not only help to unify existing results but also allow for useful extensions.

/pdf/the-kinetic-theory-of-mutation-rates-2zy469e8.pdf

The Kinetic Theory of Mutation Rates

In this note, we present a general way to construct spectral methods for the collision operator of the Boltzmann equation which preserves exactly the Maxwellian steady-state of the system. We show that the resulting method is able to approximate with spectral accuracy the solution uniformly in time.

On steady-state preserving spectral methods for homogeneous Boltzmann equations

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with suitable penalization techniques is introduced for this purpose. The method relies on a reformulation of the constrained minimization problem in an unconstrained problem for a penalty function and extends to the constrained settings the class of CBO methods. Exact penalization is employed and, since the optimal penalty parameter is unknown, an iterative strategy is proposed that successively updates the parameter based on the constrained violation. Using a mean-field description of the the many particle limit of the arising CBO dynamics, we are able to show convergence of the proposed method to the minimum for general nonlinear constrained problems. Properties of the new algorithm are analyzed. Several numerical examples, also in high dimensions, illustrate the theoretical findings and the good performance of the new numerical method.

Constrained consensus-based optimization

In this note we discuss the construction of high order asymptotic preserving numerical schemes for the Boltzmann equation. The methods are based on the use of Implicit-Explicit (IMEX) Runge-Kutta methods combined with a penalization technique recently introduced in [F. Filbet, S. Jin: A class of asymptotic preserving schemes for kinetic equations and related problems with stiff sources,J. Comp. Phys. 229, (2010), pp. 7625-7648.].

High order asymptotic-preserving schemes for the Boltzmann equation

In this paper, we develop a stochastic Asymptotic-Preserving (sAP) scheme for the kinetic chemotaxis system with random inputs, which will converge to the modified Keller-Segel model with random inputs in the diffusive regime. Based on the generalized Polynomial Chaos (gPC) approach, we design a high order stochastic Galerkin method using implicit-explicit (IMEX) Runge-Kutta (RK) time discretization with a macroscopic penalty term. The new schemes improve the parabolic CFL condition to a hyperbolic type when the mean free path is small, which shows significant efficiency especially in uncertainty quantification (UQ) with multi-scale problems. The stochastic Asymptotic-Preserving property will be shown asymptotically and verified numerically in several tests. Many other numerical tests are conducted to explore the effect of the randomness in the kinetic system, in the aim of providing more intuitions for the theoretic study of the chemotaxis models.

Lorenzo Pareschi

Papers

The Kinetic Theory of Mutation Rates

On steady-state preserving spectral methods for homogeneous Boltzmann equations

Constrained consensus-based optimization

High order asymptotic-preserving schemes for the Boltzmann equation

A High Order Stochastic Asymptotic Preserving Scheme for Chemotaxis Kinetic Models with Random Inputs