Nash–Sutcliffe model efficiency coefficient

The Nash–Sutcliffe model efficiency coefficient (NSE) is used to assess the predictive power of hydrological models. It is defined as:

where Qo is the mean of observed discharges, and Qm is modeled discharge. Qot is observed discharge at time t.[1]

Nash–Sutcliffe efficiency can range from −∞ to 1. An efficiency of 1 (NSE = 1) corresponds to a perfect match of modeled discharge to the observed data. An efficiency of 0 (NSE = 0) indicates that the model predictions are as accurate as the mean of the observed data, whereas an efficiency less than zero (NSE < 0) occurs when the observed mean is a better predictor than the model or, in other words, when the residual variance (described by the numerator in the expression above), is larger than the data variance (described by the denominator). Essentially, the closer the model efficiency is to 1, the more accurate the model is. Threshold values to indicate a model of sufficient quality have been suggested between 0.5 < NSE < 0.65[2][3]. For the case of regression procedures (i.e. when the total sum of squares can be partitioned into error and regression components), the Nash–Sutcliffe efficiency is equivalent to the Coefficient of determination (R2), thus ranging between 0 and 1.

The efficiency coefficient is sensitive to extreme values and might yield sub-optimal results when the dataset contains large outliers in it. To address this a modified version of NSE has been suggested where the sum of squares in the denominator of NSE is raised to 1 instead of 2 and the resulting modified NSE values compared to the original NSE values to assess the potential effect of extreme values[4]. A test significance for NSE to assess its robustness has been proposed whereby the model can be objectively accepted or rejected based on the probability value of obtaining NSE > threshold (0.65 or other selected by the user)[2].

Nash–Sutcliffe efficiency can be used to quantitatively describe the accuracy of model outputs other than discharge. This indicator can be used to describe the predictive accuracy of other models as long as there is observed data to compare the model results to. For example, Nash–Sutcliffe efficiency has been reported in scientific literature for model simulations of discharge; water quality constituents such as sediment, nitrogen, and phosphorus loading.[3] Other applications are the use of Nash–Sutcliffe coefficients to optimize parameter values of geophysical models, such as models to simulate the coupling between isotope behavior and soil evolution [5].


See also

References

  1. ↑ Nash, J. E.; Sutcliffe, J. V. (1970). "River flow forecasting through conceptual models part I — A discussion of principles". Journal of Hydrology. 10 (3): 282–290. doi:10.1016/0022-1694(70)90255-6.
  2. 1 2 Ritter, A.; Muñoz-Carpena, R. (2013). "Performance evaluation of hydrological models: statistical significance for reducing subjectivity in goodness-of-fit assessments". Journal of Hydrology. 480(1): 33–45. doi:10.1016/j.jhydrol.2012.12.004 – via Elsevier Science Direct.
  3. 1 2 Moriasi, D. N.; Arnold, J. G.; Van Liew, M. W.; Bingner, R. L.; Harmel, R. D.; Veith, T. L. (2007). "Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations" (PDF). Transactions of the ASABE. 50 (3): 885–900.
  4. ↑ Legates, D.R.; McCabe, G.J. (1999). "Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation". Water Resour. Res. 35: 233–241. doi:10.1029/1998WR900018.
  5. ↑ Campforts, Benjamin; Vanacker, Veerle; Vanderborght, Jan; Baken, Stijn; Smolders, Erik; Govers, Gerard (2016). "Simulating the mobility of meteoric 10 Be in the landscape through a coupled soil-hillslope model (Be2D)". Earth and Planetary Science Letters. 439: 143–157. doi:10.1016/j.epsl.2016.01.017. ISSN 0012-821X.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.