Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation
Reads0
Chats0
TLDR
In this paper, the goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed.Abstract:
Correlation and correlation-based measures (e.g., the coefficient of determination) have been widely used to evaluate the “goodness-of-fit” of hydrologic and hydroclimatic models. These measures are oversensitive to extreme values (outliers) and are insensitive to additive and proportional differences between model predictions and observations. Because of these limitations, correlation-based measures can indicate that a model is a good predictor, even when it is not. In this paper, useful alternative goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed. Modifications to these statistics to aid in interpretation are presented. It is concluded that correlation and correlation-based measures should not be used to assess the goodness-of-fit of a hydrologic or hydroclimatic model and that additional evaluation measures (such as summary statistics and absolute error measures) should supplement model evaluation tools.read more
Citations
More filters
Journal ArticleDOI
Introductory overview: Error metrics for hydrologic modelling – A review of common practices and an open source library to facilitate use and adoption
Elise K. Jackson,Wade Roberts,Benjamin Nelsen,Gustavious P. Williams,E. James Nelson,Daniel P. Ames +5 more
TL;DR: The open source HydroErr library is presented, implemented in Python and MATLAB®, which contains the error metric functions reported here to facilitate greater use of these metrics and encourage metric exploration related to relative metric strengths and weaknesses.
Journal ArticleDOI
Software tools for weed seed germination modeling.
Kurt A. Spokas,Frank Forcella +1 more
TL;DR: A suite of individual tools (models) that can be used in conjunction with the next generation of weed seed germination models are developed, and each model was compared with several sets of observed data from worldwide locations.
Journal ArticleDOI
Comparison of drought indicators derived from multiple data sets over Africa
Gustavo Naumann,Emanuel Dutra,Paulo Barbosa,Florian Pappenberger,Fredrik Wetterhall,Jürgen Vogt +5 more
TL;DR: In this paper, the authors investigated different data sets and drought indicators on their capability to improve drought monitoring in Africa and concluded that the main source of differences in the computation of the drought indicators is the uncertainty in the precipitation data sets rather than the estimation of the distribution parameters of the different drought indicators.
Journal ArticleDOI
A spatio-temporal hybrid neural network-Kriging model for groundwater level simulation
TL;DR: This algorithm was implemented and applied for predicting, spatially and temporally, the hydraulic head in an area located in Bavaria, Germany and can be characterized as favorable, since the RMSE of the method is in the order of magnitude of 10−2 m.
Journal ArticleDOI
Weekly soil moisture forecasting with multivariate sequential, ensemble empirical mode decomposition and Boruta-random forest hybridizer algorithm approach
TL;DR: The study ascertains that the EEMD-Boruta-ELM hybrid model can be explored as a pertinent data-driven tool for relatively short-term soil moisture forecasts, thus advocating its practical use in near real-time hydrological and pedological applications.
References
More filters
Journal ArticleDOI
River flow forecasting through conceptual models part I — A discussion of principles☆
J.E. Nash,J.V. Sutcliffe +1 more
TL;DR: In this article, the principles governing the application of the conceptual model technique to river flow forecasting are discussed and the necessity for a systematic approach to the development and testing of the model is explained and some preliminary ideas suggested.
Journal ArticleDOI
On the validation of models
TL;DR: In this paper, it is suggested that the correlation coefficieness between observed and simulated variates is not as good as observed variates, and that correlation can be improved.
Journal ArticleDOI
A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation
Bradley Efron,Gail Gong +1 more
TL;DR: This paper reviewed the nonparametric estimation of statistical error, mainly the bias and standard error of an estimator, or the error rate of a prediction rule, at a relaxed mathematical level, omitting most proofs, regularity conditions and technical details.