An analysis of entity normalization evaluation biases in specialized domains - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Access content directly
Journal Articles BMC Bioinformatics Year : 2023

An analysis of entity normalization evaluation biases in specialized domains

Abstract

Abstract Background Entity normalization is an important information extraction task which has recently gained attention, particularly in the clinical/biomedical and life science domains. On several datasets, state-of-the-art methods perform rather well on popular benchmarks. Yet, we argue that the task is far from resolved. Results We have selected two gold standard corpora and two state-of-the-art methods to highlight some evaluation biases. We present non-exhaustive initial findings on the existence of evaluation problems of the entity normalization task. Conclusions Our analysis suggests better evaluation practices to support the methodological research in this field.
Fichier principal
Vignette du fichier
s12859-023-05350-9.pdf (1.49 Mo) Télécharger le fichier
Origin Publisher files allowed on an open archive
Licence

Dates and versions

hal-04115633 , version 1 (28-02-2024)

Licence

Identifiers

Cite

Arnaud Ferré, Philippe Langlais. An analysis of entity normalization evaluation biases in specialized domains. BMC Bioinformatics, 2023, 24 (1), pp.227. ⟨10.1186/s12859-023-05350-9⟩. ⟨hal-04115633⟩
32 View
3 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More