Journal ArticleDOI
Ridge Regression in Practice
TLDR
In this paper, a review of the theory of ridge regression and its relation to generalized inverse regression is presented along with the results of a simulation experiment and three examples of the use of the ridge regression in practice.Abstract:
Summary The use of biased estimation in data analysis and model building is discussed A review of the theory of ridge regression and its relation to generalized inverse regression is presented along with the results of a simulation experiment and three examples of the use of ridge regression in practice Comments on variable selection procedures, model validation, and ridge and generalized inverse regression computation procedures are included The examples studied here show that when the predictor variables are highly correlated, ridge regression produces coefficients which predict and extrapolate better than least squares and is a safe procedure for selecting variablesread more
Citations
More filters
Journal ArticleDOI
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
TL;DR: The generalized cross-validation (GCV) method as discussed by the authors is a generalized version of Allen's PRESS, which can be used in subset selection and singular value truncation, and even to choose from among mixtures of these methods.
Journal ArticleDOI
The robust beauty of improper linear models in decision making.
TL;DR: In this article, Dawes presented evidence that even such improper linear models are superior to clinical intuition when predicting a numerical criterion from numerical predictors, and showed that unit (i.e., equal) weighting is quite robust for making such predictions.
Journal ArticleDOI
Regression modelling strategies for improved prognostic prediction.
TL;DR: A general index of predictive discrimination is used to measure the ability of a model developed on training samples of varying sizes to predict survival in an independent test sample of patients suspected of having coronary artery disease.
Journal ArticleDOI
Validation of Regression Models: Methods and Examples
TL;DR: It is concluded that data splitting is an effective method of model validation when it is not practical to collect new data to test the model.
Journal ArticleDOI
Assessment of Local Influence
TL;DR: In this paper, a method for assessing the influence of minor perturbations of a linear regression model is presented. But the method is not restricted to linear regression models, and it seems to provide a relatively simple, unified approach for handling a variety of problems.
References
More filters
Book
Applied Regression Analysis
Norman R. Draper,Harry Smith +1 more
TL;DR: In this article, the Straight Line Case is used to fit a straight line by least squares, and the Durbin-Watson Test is used for checking the straight line fit.
Journal ArticleDOI
Ridge regression: biased estimation for nonorthogonal problems
TL;DR: In this paper, an estimation procedure based on adding small positive quantities to the diagonal of X′X was proposed, which is a method for showing in two dimensions the effects of nonorthogonality.
Journal ArticleDOI
Computer Aided Design of Experiments
Robert W. Kennard,L. A. Stone +1 more
TL;DR: A computer oriented method which assists in the construction of response surface type experimental plans takes into account constraints met in practice that standard procedures do not consider explicitly.