Harnessing artificial intelligence for efficient systematic reviews: A case study in ecosystem condition indicators - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement
Article Dans Une Revue Ecological Informatics Année : 2024

Harnessing artificial intelligence for efficient systematic reviews: A case study in ecosystem condition indicators

Résumé

Effective evidence synthesis is important for the integration of scientific research into decision-making. However, fully depicting the vast mosaic of concepts and applications in environmental sciences and ecology often entails a substantial workload. New Artificial Intelligence (AI) tools present an attractive option for addressing this challenge but require sufficient validation to match the vigorous standards of a systematic review. This article demonstrates the use of generative AI in the selection of relevant literature as part of a systematic review on indicators of ecosystem condition. We highlight, through the development of an optimal prompt to communicate inclusion and exclusion criteria, the need to describe ecosystem condition as a multidimensional concept whilst also maintaining clarity on what does not meet the criteria of comprehensiveness. We show that, although not completely infallible, the GPT-3.5 model significantly outperforms traditional literature screening processes in terms of speed and efficiency whilst correctly selecting 83 % of relevant literature for review. Our study highlights the importance of precision in prompt design and the setting of query parameters for the AI model and opens the perspective for future work using language models to contextualize complex concepts in the environmental sciences. Future development of this methodology in tandem with the continued evolution of the accessibility and capacity of AI tools presents a great potential to improve evidence synthesis through gains in efficiency and possible scope.

Fichier principal
Vignette du fichier
2024_Thomas_Ecological_Infor.pdf (1002.12 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04806630 , version 1 (27-11-2024)

Licence

Identifiants

Citer

Isabel Nicholson Thomas, Philip Roche, Adrienne Grêt-Regamey. Harnessing artificial intelligence for efficient systematic reviews: A case study in ecosystem condition indicators. Ecological Informatics, 2024, 83, ⟨10.1016/j.ecoinf.2024.102819⟩. ⟨hal-04806630⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More