Skip to Main content Skip to Navigation
Journal articles

Data-based comparison of frequency analysis methods: A general framework

Abstract : An abundance of methods have been developed over the years to perform the frequency analysis (FA) of extreme environmental variables. Although numerous comparisons between these methods have been implemented, no general comparison framework has been agreed upon so far. The objective of this paper is to build the foundation of a data-based comparison framework, which aims at complementing more standard comparison schemes based on Monte Carlo simulations or statistical testing. This framework is based on the following general principles: (i) emphasis is put on the predictive ability of competing FA implementations, rather than their sole descriptive ability measured by some goodness-of-fit criterion; (ii) predictive ability is quantified by means of reliability indices, describing the consistency between validation data (not used for calibration) and FA predictions; (iii) stability is also quantified, i.e., the ability of a FA implementation to yield similar estimates when calibration data change; and (iv) the necessity to subject uncertainty estimates to the same scrutiny as point estimates is recognized, and a practical approach based on the use of the predictive distribution is proposed for this purpose. This framework is then applied to a case study involving 364 gauging stations in France, where 10 FA implementations are compared. These implementations correspond to the local, regional, and local-regional estimation of Gumbel and generalized extreme value distributions. Results show that reliability and stability indices are able to reveal marked differences between FA implementations. Moreover, the case study also confirms that using the predictive distribution to indirectly scrutinize uncertainty estimates is a viable approach, with distinct FA implementations showing marked differences in the reliability of their uncertainty estimates. The proposed comparison framework therefore constitutes a valuable tool to compare the predictive reliability of competing FA implementations, along with the reliability of their uncertainty estimates.
Document type :
Journal articles
Complete list of metadata

Cited literature [91 references]  Display  Hide  Download
Contributor : Import Ws Irstea Connect in order to contact the contributor
Submitted on : Wednesday, April 10, 2013 - 11:04:09 AM
Last modification on : Tuesday, July 5, 2022 - 9:18:30 AM
Long-term archiving on: : Thursday, July 11, 2013 - 4:12:15 AM


Files produced by the author(s)



Benjamin Renard, K. Kochanek, M. Lang, F. Garavaglia, E. Paquet, et al.. Data-based comparison of frequency analysis methods: A general framework. Water Resources Research, American Geophysical Union, 2013, 49, p. 1 - p. 19. ⟨10.1002/wrcr.20087⟩. ⟨hal-00811184⟩



Record views


Files downloads