Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation
Reads0
Chats0
TLDR
In this paper, the goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed.Abstract:
Correlation and correlation-based measures (e.g., the coefficient of determination) have been widely used to evaluate the “goodness-of-fit” of hydrologic and hydroclimatic models. These measures are oversensitive to extreme values (outliers) and are insensitive to additive and proportional differences between model predictions and observations. Because of these limitations, correlation-based measures can indicate that a model is a good predictor, even when it is not. In this paper, useful alternative goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed. Modifications to these statistics to aid in interpretation are presented. It is concluded that correlation and correlation-based measures should not be used to assess the goodness-of-fit of a hydrologic or hydroclimatic model and that additional evaluation measures (such as summary statistics and absolute error measures) should supplement model evaluation tools.read more
Citations
More filters
Journal ArticleDOI
Predicting compressive strength of lightweight foamed concrete using extreme learning machine model
Zaher Mundher Yaseen,Ravinesh C. Deo,Ameer A. Hilal,Abbas M. Abd,Laura Cornejo Bueno,Sancho Salcedo-Sanz,Moncef L. Nehdi +6 more
TL;DR: The results showed that the proposed ELM model achieved an adequate level of prediction accuracy, improving MARS, M5 Tree and SVR models, and could be employed as a reliable and accurate data intelligent approach for predicting the compressive strength of foamed concrete.
Journal ArticleDOI
Do Nash values have value? Discussion and alternate proposals
Robert E. Criss,W. E. Winston +1 more
TL;DR: Schaefli and Gupta as mentioned in this paper pointed out that the NSE overemphasizes large flows relative to other measurements because the various deviations are squared, and they proposed a more general formulation of efficiency based on absolute values.
Journal ArticleDOI
Forecasting daily streamflow using hybrid ANN models
TL;DR: Overall, among the three variations of hybrid ANNs tested, the PANN model performed best, compared with the MLP–ANN fitted to the deseasonalized data, but the advantage vanishes for longer lead times.
Journal ArticleDOI
Analyzing the ENVI-met microclimate model’s performance and assessing cool materials and urban vegetation applications–A review
TL;DR: In this article, the authors performed a meta-analysis of the reported evaluation results, reflecting the capability of the model to accurately calculate the diurnal profile of microclimatic variables.
Journal ArticleDOI
Large-sample hydrology: a need to balance depth with breadth
Hoshin V. Gupta,Charles Perrin,Günter Blöschl,Alberto Montanari,Rohini Kumar,Martyn P. Clark,Vazken Andréassian +6 more
TL;DR: The need to actively promote and pursue the use of a "large catchment sample" approach to modeling the rainfall–runoff process, thereby balancing depth with breadth is discussed.
References
More filters
Journal ArticleDOI
River flow forecasting through conceptual models part I — A discussion of principles☆
J.E. Nash,J.V. Sutcliffe +1 more
TL;DR: In this article, the principles governing the application of the conceptual model technique to river flow forecasting are discussed and the necessity for a systematic approach to the development and testing of the model is explained and some preliminary ideas suggested.
Journal ArticleDOI
On the validation of models
TL;DR: In this paper, it is suggested that the correlation coefficieness between observed and simulated variates is not as good as observed variates, and that correlation can be improved.
Journal ArticleDOI
A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation
Bradley Efron,Gail Gong +1 more
TL;DR: This paper reviewed the nonparametric estimation of statistical error, mainly the bias and standard error of an estimator, or the error rate of a prediction rule, at a relaxed mathematical level, omitting most proofs, regularity conditions and technical details.