Animal disease surveillance: How to represent textual data for classifying epidemiological information - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Accéder directement au contenu
Article Dans Une Revue Preventive Veterinary Medicine Année : 2023

Animal disease surveillance: How to represent textual data for classifying epidemiological information

Résumé

The value of informal sources in increasing the timeliness of disease outbreak detection and providing detailed epidemiological information in the early warning and preparedness context is recognized. This study evaluates machine learning methods for classifying information from animal disease-related news at a fine-grained level (i. e., epidemiological topic). We compare two textual representations, the bag-of-words method and a distributional approach, i.e., word embeddings. Both representations performed well for binary relevance classification (F-measure of 0.839 and 0.871, respectively). Bag-of-words representation was outperformed by word embedding representation for classifying sentences into fine-grained epidemiological topics (F-measure of 0.745). Our results suggest that the word embedding approach is of interest in the context of low-frequency classes in a specialized domain. However, this representation did not bring significant performance improvements for binary relevance classification, indicating that the textual representation should be adapted to each classification task.
Fichier principal
Vignette du fichier
1-s2.0-S016758772300096X-main.pdf (2.73 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Licence : CC BY - Paternité

Dates et versions

hal-04122054 , version 1 (08-06-2023)

Licence

Paternité

Identifiants

Citer

Sarah Valentin, Rémy Decoupes, Renaud Lancelot, Mathieu Roche. Animal disease surveillance: How to represent textual data for classifying epidemiological information. Preventive Veterinary Medicine, 2023, 216, pp.116467. ⟨10.1016/j.prevetmed.2023.105932⟩. ⟨hal-04122054⟩
51 Consultations
12 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More