Offering a unifying theoretical perspective not readily available in any other text, this innovative guide to econometrics uses simple geometrical arguments to develop students' intuitive understanding of basic and advanced topics, emphasizing throughout the practical applications of modern theory and nonlinear techniques of estimation. One theme of the text is the use of artificial regressions for estimation, reference, and specification testing of nonlinear models, including diagnostic tests for parameter constancy, serial correlation, heteroscedasticity, and other types of mis-specification. Explaining how estimates can be obtained and tests can be carried out, the authors go beyond a mere algebraic description to one that can be easily translated into the commands of a standard econometric software package. Covering an unprecedented range of problems with a consistent emphasis on those that arise in applied work, this accessible and coherent guide to the most vital topics in econometrics today is indispensable for advanced students of econometrics and students of statistics interested in regression and related topics. It will also suit practising econometricians who want to update their skills. Flexibly designed to accommodate a variety of course levels, it offers both complete coverage of the basic material and separate chapters on areas of specialized interest.

Estimation and Inference in Econometrics

Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalized) linear models, (generalized) additive models, smoothing spline models, state space models, semiparametric regression, spatial and spatiotemporal models, log-Gaussian Cox processes and geostatistical and geoadditive models. We consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models, where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form owing to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, in terms of both convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo sampling is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations is computational: where Markov chain Monte Carlo algorithms need hours or days to run, our approximations provide more precise estimates in seconds or minutes. Another advantage with our approach is its generality, which makes it possible to perform Bayesian analysis in an automatic, streamlined way, and to compute model comparison criteria and various predictive measures so that models can be compared and the model under study can be challenged.

/pdf/approximate-bayesian-inference-for-latent-gaussian-models-by-2m3x22eic2.pdf

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

Statistical Analysis with Missing Data

Foreword Stephen P. Brooks, Andrew Gelman, Galin L. Jones, and Xiao-Li Meng Introduction to MCMC, Charles J. Geyer A short history of Markov chain Monte Carlo: Subjective recollections from in-complete data, Christian Robert and George Casella Reversible jump Markov chain Monte Carlo, Yanan Fan and Scott A. Sisson Optimal proposal distributions and adaptive MCMC, Jeffrey S. Rosenthal MCMC using Hamiltonian dynamics, Radford M. Neal Inference and Monitoring Convergence, Andrew Gelman and Kenneth Shirley Implementing MCMC: Estimating with confidence, James M. Flegal and Galin L. Jones Perfection within reach: Exact MCMC sampling, Radu V. Craiu and Xiao-Li Meng Spatial point processes, Mark Huber The data augmentation algorithm: Theory and methodology, James P. Hobert Importance sampling, simulated tempering and umbrella sampling, Charles J.Geyer Likelihood-free Markov chain Monte Carlo, Scott A. Sisson and Yanan Fan MCMC in the analysis of genetic data on related individuals, Elizabeth Thompson A Markov chain Monte Carlo based analysis of a multilevel model for functional MRI data, Brian Caffo, DuBois Bowman, Lynn Eberly, and Susan Spear Bassett Partially collapsed Gibbs sampling & path-adaptive Metropolis-Hastings in high-energy astrophysics, David van Dyk and Taeyoung Park Posterior exploration for computationally intensive forward models, Dave Higdon, C. Shane Reese, J. David Moulton, Jasper A. Vrugt and Colin Fox Statistical ecology, Ruth King Gaussian random field models for spatial data, Murali Haran Modeling preference changes via a hidden Markov item response theory model, Jong Hee Park Parallel Bayesian MCMC imputation for multiple distributed lag models: A case study in environmental epidemiology, Brian Caffo, Roger Peng, Francesca Dominici, Thomas A. Louis, and Scott Zeger MCMC for state space models, Paul Fearnhead MCMC in educational research, Roy Levy, Robert J. Mislevy, and John T. Behrens Applications of MCMC in fisheries science, Russell B. Millar Model comparison and simulation for hierarchical models: analyzing rural-urban migration in Thailand, Filiz Garip and Bruce Western

Handbook of Markov Chain Monte Carlo

A detailed review of the education sector in Australia as in the data provided by the 2006 edition of the OECD's annual publication, 'Education at a Glance' is presented. While the data has shown that in almost all OECD countries educational attainment levels are on the rise, with countries showing impressive gains in university qualifications, it also reveals that a large of share of young people still do not complete secondary school, which remains a baseline for successful entry into the labour market.

/pdf/education-at-a-glance-m5vl7o68j5.pdf

Education at a Glance

A relevant problem in applications of Item Response Theory (IRT) modelsis the presence of nonignorable missing responses. We propose a multidimensionallatent class IRT model in which the missingness mechanism is driven by a latentvariable (propensity to answer) correlated with the latent variable for the ability (orabilities) measured by the test items. These two latent variables are assumed to havea joint discrete distribution. This assumption is convenient both from the computationalpoint of view and for the decisional process, since individuals are classifiedin homogeneous latent classes which may be associated to the same treatment.Moreover, this assumption avoids parametric formulations for the distribution of thelatent variables, giving rise to a semiparametric model. The proposed approach isillustrated through an application to data coming from a Students’ Entry Test for theadmission to the courses in Economics in an Italian University.

/pdf/modeling-nonignorable-missingness-in-multidimensional-latent-351crmd00q.pdf

Modeling nonignorable missingness in multidimensional latent class IRT models

We introduce a hidden Markov model for dynamic network data where directed relations among a set of units are observed at different time occasions. The model can also be used with minor adjustments to deal with undirected networks. In the directional case, dyads referred to each pair of units are explicitly modelled conditional on the latent states of both units. Given the complexity of the model, we propose a composite likelihood method for making inference on its parameters. This method is studied in detail for the directional case by a simulation study in which different scenarios are considered.
The proposed approach is illustrated by an example based on the well-known Enron dataset about email exchange.

Composite likelihood inference for hidden Markov models for dynamic networks

We deal with the problem of latent variable prediction in the context of multilevel latent class models for categorical responses provided by individuals nested in groups. In particular, we propose a posterior assignment rule that jointly predicts the individual- and group-level latent variables. This proposal is alternative to the common maximum-a-posteriori rule, which is based on first predicting the latent variables at cluster level and, then, those at individual level. To illustrate the proposal, we show the results of two simulation studies and two applications on data related to the national and the international assessment of student skills.

Multilevel Model-Based Clustering: A New Proposal of Maximum-A-Posteriori Assignment

Comment on the paper On the memory complexity of the forward-backward algorithm, by Khreich W., Granger E., Miri A., Sabourin, R.

SUMMARY We propose a class of estimators of the Bayes factor which is based on an extension of the bridge sampling identity of Meng & Wong (1996) and makes use of the output of the reversible jump algorithm of Green ( 1995). Within this class we give the optimal estimator and also a suboptimal one which may be simply computed on the basis of the acceptance probabilities used within the reversible jump algorithm for jumping between models. The proposed estimators are very easily computed and lead to a substantial gain of efficiency in estimating the Bayes factor over the standard estimator based on the reversible jump output. This is illustrated through a series of Monte Carlo simulations involving a linear and a logistic regression model.

Francesco Bartolucci

Papers

Modeling nonignorable missingness in multidimensional latent class IRT models

Composite likelihood inference for hidden Markov models for dynamic networks

Multilevel Model-Based Clustering: A New Proposal of Maximum-A-Posteriori Assignment

Comment on the paper On the memory complexity of the forward-backward algorithm, by Khreich W., Granger E., Miri A., Sabourin, R.

Efficient Bayes factor estimation from the Reversible jump output