Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalized) linear models, (generalized) additive models, smoothing spline models, state space models, semiparametric regression, spatial and spatiotemporal models, log-Gaussian Cox processes and geostatistical and geoadditive models. We consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models, where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form owing to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, in terms of both convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo sampling is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations is computational: where Markov chain Monte Carlo algorithms need hours or days to run, our approximations provide more precise estimates in seconds or minutes. Another advantage with our approach is its generality, which makes it possible to perform Bayesian analysis in an automatic, streamlined way, and to compute model comparison criteria and various predictive measures so that models can be compared and the model under study can be challenged.

/pdf/approximate-bayesian-inference-for-latent-gaussian-models-by-2m3x22eic2.pdf

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

A survey of recent developments in the theory and application of com- posite likelihood is provided, building on the review paper of Varin(2008). A range of application areas, including geostatistics, spatial extremes, and space-time mod- els, as well as clustered and longitudinal data and time series are considered. The important area of applications to statistical genetics is omitted, in light ofLarribe and Fearnhead(2011). Emphasis is given to the development of the theory, and the current state of knowledge on e!ciency and robustness of composite likelihood inference.

/pdf/an-overview-of-composite-likelihood-methods-2lgbmk7ee2.pdf

An overview of composite likelihood methods

This article explores the copula approach for econometric modeling of joint parametric distributions. Although theoretical foundations of copulas are complex, this paper demonstrates that practical implementation and estimation are relatively straightforward. An attractive feature of parametrically specified copulas is that estimation and inference are based on standard maximum likelihood procedures, and thus copulas can be estimated using desktop econometric software. This represents a substantial advantage of copulas over recently proposed simulationbased approaches to joint modeling.

/pdf/copula-modeling-an-introduction-for-practitioners-1fcatpzmuu.pdf

Copula Modeling: An Introduction for Practitioners

https://public.econ.duke.edu/~ap172/Patton_JMVA_survey_2012.pdf

A review of copula models for economic time series

Over the last three decades, mixed models have been frequently used in a wide range of small area applications. Such models offer great flexibilities in combining information from various sources, and thus are well suited for solving most small area estimation problems. The present article reviews major research developments in the classical inferential approach for linear and generalized linear mixed models that are relevant to different issues concerning small area estimation and related problems.

Mixed model prediction and small area estimation

This article presents and examines a new algorithm for solving a score equation for the maximum likelihood estimate in certain problems of practical interest. The method circumvents the need to compute second-order derivatives of the full likelihood function. It exploits the structure of certain models that yield a natural decomposition of a very complicated likelihood function. In this decomposition, the first part is a log-likelihood from a simply analyzed model, and the second part is used to update estimates from the first part. Convergence properties of this iterative (fixed-point) algorithm are examined, and asymptotics are derived for estimators obtained using only a finite number of iterations. Illustrative examples considered in the article include multivariate Gaussian copula models, nonnormal random-effects models, generalized linear mixed models, and state-space models. Properties of the algorithm and of estimators are evaluated in simulation studies on a bivariate copula model and a nonnormal...

/pdf/maximization-by-parts-in-likelihood-inference-1gvjnyj7pt.pdf

J. G. Liao

Papers

Maximization by Parts in Likelihood Inference