Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation
Reads0
Chats0
TLDR
In this paper, the goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed.Abstract:
Correlation and correlation-based measures (e.g., the coefficient of determination) have been widely used to evaluate the “goodness-of-fit” of hydrologic and hydroclimatic models. These measures are oversensitive to extreme values (outliers) and are insensitive to additive and proportional differences between model predictions and observations. Because of these limitations, correlation-based measures can indicate that a model is a good predictor, even when it is not. In this paper, useful alternative goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed. Modifications to these statistics to aid in interpretation are presented. It is concluded that correlation and correlation-based measures should not be used to assess the goodness-of-fit of a hydrologic or hydroclimatic model and that additional evaluation measures (such as summary statistics and absolute error measures) should supplement model evaluation tools.read more
Citations
More filters
Journal ArticleDOI
Evaluating the impacts of climate change and crop land use change on streamflow, nitrates and phosphorus: A modeling study in Bavaria
TL;DR: In this paper, the impacts of climate change on streamflow, NO3−-N and total phosphorus (TP) in the Altmuhl River watershed were investigated using the SWAT tool.
Journal ArticleDOI
A large-sample investigation of statistical procedures for radar-based short-term quantitative precipitation forecasting
Mircea Grecu,Witold F. Krajewski +1 more
TL;DR: In this article, an extensive evaluation of radar-based quantitative precipitation forecasting techniques was performed using a large data set of radar observations from the Tulsa, Oklahoma, WSR-88D radar, including persistence, advection, and neural-network-based schemes.
Journal ArticleDOI
The hazards of split-sample validation in hydrological model calibration
TL;DR: The conclusions point to the need to use as many years as possible in the calibration step and to entirely disregard the validation aspect under certain conditions.
Journal ArticleDOI
Informal likelihood measures in model assessment: Theoretic development and investigation
TL;DR: Analytical results and a simulation indicate all of the performance criteria considered as Informal Likelihoods in this paper have one or more properties which may be considered undesirable, but may perform no less well in conditioning model parameters than formal likelihoods for which the assumptions are only mildly incorrect.
Journal ArticleDOI
Validation of satellite rainfall products over Greece
TL;DR: In this article, six widely available satellite precipitation products were extensively validated and intercompared on monthly-to-seasonal timescales and various spatial scales, for the period 1998-2006, using a dense station network over Greece.
References
More filters
Journal ArticleDOI
River flow forecasting through conceptual models part I — A discussion of principles☆
J.E. Nash,J.V. Sutcliffe +1 more
TL;DR: In this article, the principles governing the application of the conceptual model technique to river flow forecasting are discussed and the necessity for a systematic approach to the development and testing of the model is explained and some preliminary ideas suggested.
Journal ArticleDOI
On the validation of models
TL;DR: In this paper, it is suggested that the correlation coefficieness between observed and simulated variates is not as good as observed variates, and that correlation can be improved.
Journal ArticleDOI
A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation
Bradley Efron,Gail Gong +1 more
TL;DR: This paper reviewed the nonparametric estimation of statistical error, mainly the bias and standard error of an estimator, or the error rate of a prediction rule, at a relaxed mathematical level, omitting most proofs, regularity conditions and technical details.