Looking beyond general metrics for model evaluation - lessons from an international model intercomparison study - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Looking beyond general metrics for model evaluation - lessons from an international model intercomparison study

Résumé

International collaboration between institutes and universities is a promising way to reach consensus on hydrological model development. Education, experience and expert knowledge of the hydrological community have resulted in the development of a great variety of model concepts, calibration methods and analysis techniques. Although comparison studies are very valuable for international cooperation, they do often not lead to very clear new insights regarding the relevance of the modelled processes.We hypothesise that this is partly caused by model complexity and the used comparison methods, which focus on a good overall performance instead of focusing on specific events. We propose an approach that focuses on the evaluation of specific events. Eight international research groups calibrated their model for the Ourthe catchment in Belgium (1607 km2) and carried out a validation in time for the Ourthe (i.e. on two different periods, one of them on a blind mode for the modellers) and a validation in space for nested and neighbouring catchments of the Meuse in a completely blind mode. For each model, the same protocol was followed and an ensemble of best performing parameter sets was selected. Signatures were first used to assess model performances in the different catchments during validation. Comparison of the models was then followed by evaluation of selected events, which include: low flows, high flows and the transition from low to high flows. While the models show rather similar performances based on general metrics (i.e. Nash-Sutcliffe Efficiency), clear differences can be observed for specific events. While most models are able to simulate high flows well, large differences are observed during low flows and in the ability to capture the first peaks after drier months. The transferability of model parameters to neighbouring and nested catchments is assessed as an additional measure in the model evaluation. This suggested approach helps to select, among competing model alternatives, the most suitable model for a specific purpose.
Fichier non déposé

Dates et versions

hal-02603438 , version 1 (16-05-2020)

Identifiants

Citer

L. Bouaziz, T. de Boer-Euser, C. Brauer, G. Drogue, F. Fenicia, et al.. Looking beyond general metrics for model evaluation - lessons from an international model intercomparison study. EGU General Assembly 2016, Apr 2016, Vienna, Austria. pp.1. ⟨hal-02603438⟩
18 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More