On the visual detection of non-natural records in streamflow time series : challenges and impacts - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Access content directly
Journal Articles Hydrology and Earth System Sciences Year : 2023

On the visual detection of non-natural records in streamflow time series : challenges and impacts

Eric Sauquet
Flora Branger
Maïté Fournier
  • Function : Author
Claire Magand
  • Function : Author
  • PersonId : 950964
Max Mentha
  • Function : Author
Simon Munier
Tristan Podechard
  • Function : Author
Yves Tramblay

Abstract

Large datasets of long-term streamflow measurements are widely used to infer and model hydrological processes. However, streamflow measurements may suffer from what users can consider anomalies, i.e. non-natural records that may be erroneous streamflow values or anthropogenic influences that can lead to misinterpretation of actual hydrological processes. Since identifying anomalies is time consuming for humans, no study has investigated their proportion, temporal distribution, and influence on hydrological indicators over large datasets. This study summarizes the results of a large visual inspection campaign of 674 streamflow time series in France made by 43 evaluators, who were asked to identify anomalies falling under five categories, namely, linear interpolation, drops, noise, point anomalies, and other. We examined the evaluators' individual behaviour in terms of severity and agreement with other evaluators, as well as the temporal distributions of the anomalies and their influence on commonly used hydrological indicators. We found that inter-evaluator agreement was surprisingly low, with an average of 12 % of overlapping periods reported as anomalies. These anomalies were mostly identified as linear interpolation and noise, and they were more frequently reported during the low-flow periods in summer. The impact of cleaning data from the identified anomaly values was higher on low-flow indicators than on high-flow indicators, with change rates lower than 5 % most of the time. We conclude that the identification of anomalies in streamflow time series is highly dependent on the aims and skills of each evaluator, which raises questions about the best practices to adopt for data cleaning.

Domains

Hydrology
Fichier principal
Vignette du fichier
hess-27-3375-2023.pdf (3.09 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive
Licence : CC BY - Attribution

Dates and versions

hal-04214908 , version 1 (22-09-2023)

Licence

Attribution

Identifiers

Cite

Laurent Strohmenger, Eric Sauquet, Claire Bernard, Jérémie Bonneau, Flora Branger, et al.. On the visual detection of non-natural records in streamflow time series : challenges and impacts. Hydrology and Earth System Sciences, 2023, 27 (18), pp.3375-3391. ⟨10.5194/hess-27-3375-2023⟩. ⟨hal-04214908⟩
119 View
22 Download

Altmetric

Share

Gmail Facebook X LinkedIn More