Open AccessPosted Content
Jeffreys-prior penalty, finiteness and shrinkage in binomial-response generalized linear models
Ioannis Kosmidis,David Firth +1 more
Reads0
Chats0
TLDR
In this paper, it was shown that penalizing the likelihood by the invariant prior can produce finite-valued maximum penalized likelihood estimates in a broad class of binomial generalized linear models.Abstract:
Penalization of the likelihood by Jeffreys' invariant prior, or by a positive power thereof, is shown to produce finite-valued maximum penalized likelihood estimates in a broad class of binomial generalized linear models. The class of models includes logistic regression, where the Jeffreys-prior penalty is known additionally to reduce the asymptotic bias of the maximum likelihood estimator; and also models with other commonly used link functions such as probit and log-log. Shrinkage towards equiprobability across observations, relative to the maximum likelihood estimator, is established theoretically and is studied through illustrative examples. Some implications of finiteness and shrinkage for inference are discussed, particularly when inference is based on Wald-type procedures. A widely applicable procedure is developed for computation of maximum penalized likelihood estimates, by using repeated maximum likelihood fits with iteratively adjusted binomial responses and totals. These theoretical results and methods underpin the increasingly widespread use of reduced-bias and similarly penalized binomial regression models in many applied fields.read more
Citations
More filters
Journal ArticleDOI
How democracies prevail: democratic resilience as a two-stage process.
Vanessa A. Boese,Amanda B. Edgell,Amanda B. Edgell,Sebastian Hellmeier,Seraphine F. Maerz,Staffan I. Lindberg +5 more
TL;DR: The results suggest that democracies are more resilient when strong judicial constraints on the executive are present and democratic institutions were strong in the past, and economic development is only associated with resilience to onset of autocratization, not to resilience against breakdown once autocrats begun.
Journal Article
A modified score function estimator for multinomial logistic regression in small samples
TL;DR: In this paper, the authors extend the approach proposed by Firth (Biometrika 80 (1993) 27) for bias reduction of MLEs in exponential family models to the multinomial logistic regression model and consider general regression covariate types.
Journal ArticleDOI
Location-adjusted Wald statistics for scalar parameters
TL;DR: A novel, algebraic adjustment to the Wald statistic is proposed, delivering significant improvements in inferential performance with only small implementation and computational overhead, predominantly due to additional matrix multiplications.
Journal ArticleDOI
Changepoint inference in the presence of missing covariates for principal surrogate evaluation in vaccine trials
Tao Yang,Ying Huang,Youyi Fong +2 more
TL;DR: A regression methodology that allows joint estimation of all model parameters as well as a two-step method that separates the estimation of the threshold parameter from the rest of the parameters is developed and the asymptotic properties of the proposed estimators are established.
References
More filters
Journal Article
R: A language and environment for statistical computing.
TL;DR: Copyright (©) 1999–2012 R Foundation for Statistical Computing; permission is granted to make and distribute verbatim copies of this manual provided the copyright notice and permission notice are preserved on all copies.
Journal Article
Scikit-learn: Machine Learning in Python
Fabian Pedregosa,Gaël Varoquaux,Alexandre Gramfort,Vincent Michel,Bertrand Thirion,Olivier Grisel,Mathieu Blondel,Peter Prettenhofer,Ron Weiss,Vincent Dubourg,Jake Vanderplas,Alexandre Passos,David Cournapeau,Matthieu Brucher,Matthieu Perrot,Edouard Duchesnay +15 more
TL;DR: Scikit-learn is a Python module integrating a wide range of state-of-the-art machine learning algorithms for medium-scale supervised and unsupervised problems, focusing on bringing machine learning to non-specialists using a general-purpose high-level language.
Journal ArticleDOI
Applied Logistic Regression.
TL;DR: Applied Logistic Regression, Third Edition provides an easily accessible introduction to the logistic regression model and highlights the power of this model by examining the relationship between a dichotomous outcome and a set of covariables.
Book
ggplot2: Elegant Graphics for Data Analysis
TL;DR: This book describes ggplot2, a new data visualization package for R that uses the insights from Leland Wilkisons Grammar of Graphics to create a powerful and flexible system for creating data graphics.
Posted Content
Scikit-learn: Machine Learning in Python
Fabian Pedregosa,Gaël Varoquaux,Alexandre Gramfort,Vincent Michel,Bertrand Thirion,Olivier Grisel,Mathieu Blondel,Andreas Müller,Joel Nothman,Gilles Louppe,Peter Prettenhofer,Ron Weiss,Vincent Dubourg,Jake Vanderplas,Alexandre Passos,David Cournapeau,Matthieu Brucher,Matthieu Perrot,Edouard Duchesnay +18 more
TL;DR: Scikit-learn as mentioned in this paper is a Python module integrating a wide range of state-of-the-art machine learning algorithms for medium-scale supervised and unsupervised problems.
Related Papers (5)
Jeffreys-prior penalty, finiteness and shrinkage in binomial-response generalized linear models
Ioannis Kosmidis,David Firth +1 more