Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation
Reads0
Chats0
TLDR
In this paper, the goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed.Abstract:
Correlation and correlation-based measures (e.g., the coefficient of determination) have been widely used to evaluate the “goodness-of-fit” of hydrologic and hydroclimatic models. These measures are oversensitive to extreme values (outliers) and are insensitive to additive and proportional differences between model predictions and observations. Because of these limitations, correlation-based measures can indicate that a model is a good predictor, even when it is not. In this paper, useful alternative goodness-of-fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation-based measures are discussed. Modifications to these statistics to aid in interpretation are presented. It is concluded that correlation and correlation-based measures should not be used to assess the goodness-of-fit of a hydrologic or hydroclimatic model and that additional evaluation measures (such as summary statistics and absolute error measures) should supplement model evaluation tools.read more
Citations
More filters
Journal ArticleDOI
Superposition of three sources of uncertainties in operational flood forecasting chains
TL;DR: In this paper, an experimental framework for investigating the relative contribution of meteorological forcing uncertainties, initial conditions uncertainties and hydrological model parameter uncertainties in the realization of hydrologogical ensemble forecasts is presented.
Journal ArticleDOI
Wavelet-entropy data pre-processing approach for ANN-based groundwater level modeling
TL;DR: A Self-Organizing-Map (SOM)-based clustering technique was used to identify spatially homogeneous clusters of groundwater level (GWL) data for a feed-forward neural network (FFNN) to model one and multi-step-ahead GWLs, indicating that the proposed FFNN model coupled with the SOM- based clustering method decreased the dimensionality of the input variables and consequently the complexity of the FFNN models.
Journal ArticleDOI
Spatial and temporal trends in estimates of nutrient and suspended sediment loads in the Ishikari River, Japan, 1985 to 2010.
TL;DR: Estimating loads of nutrients and suspended sediment in surface water play important roles in aquatic ecosystems and contribute strongly to water quality with implication for drinking water resources, human and environmental health and the methods described here provide essential information for effectively managing water resources.
Journal ArticleDOI
Multi-step ahead modelling of river water quality parameters using ensemble artificial intelligence-based approach
TL;DR: In this paper, three single Artificial Intelligence (AI) based models (BPNN, Adaptive Neuro Fuzzy Inference System (ANFIS), Support Vector Machine (SVM), and a linear Auto Regressive Integrated Moving Average (ARIMA) model as well as three different ensemble techniques (SAE, weighted average ensemble (WAE), and neural network ensemble (NNE) are applied for single and multi-step ahead modeling of dissolve oxygen (DO) in the Yamuna River, India In this context, DO, Biological Oxygen Demand (BOD), Chemical
Journal ArticleDOI
Wavelet and ANN combination model for prediction of daily suspended sediment load in rivers.
TL;DR: Results presented that the WANN model could satisfactorily simulate hysteresis phenomenon, acceptably estimate cumulative SSL, and reasonably predict high SSL values.
References
More filters
Journal ArticleDOI
River flow forecasting through conceptual models part I — A discussion of principles☆
J.E. Nash,J.V. Sutcliffe +1 more
TL;DR: In this article, the principles governing the application of the conceptual model technique to river flow forecasting are discussed and the necessity for a systematic approach to the development and testing of the model is explained and some preliminary ideas suggested.
Journal ArticleDOI
On the validation of models
TL;DR: In this paper, it is suggested that the correlation coefficieness between observed and simulated variates is not as good as observed variates, and that correlation can be improved.
Journal ArticleDOI
A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation
Bradley Efron,Gail Gong +1 more
TL;DR: This paper reviewed the nonparametric estimation of statistical error, mainly the bias and standard error of an estimator, or the error rate of a prediction rule, at a relaxed mathematical level, omitting most proofs, regularity conditions and technical details.