Combining experts’ judgments: comparison of algorithmic methods using synthetic data - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement
Article Dans Une Revue Risk Analysis Année : 2013

Combining experts’ judgments: comparison of algorithmic methods using synthetic data

Résumé

Expert judgment (or expert elicitation) is a formal process for eliciting judgments from subject-matter experts about the value of a decision-relevant quantity. Judgments in the form of subjective probability distributions are obtained from several experts, raising the question how best to combine information from multiple experts.Anumber of algorithmic approaches have been proposed, of which the most commonly employed is the equal-weight combination (the average of the experts’ distributions). We evaluate the properties of five combination methods (equal-weight, best-expert, performance, frequentist, and copula) using simulated expert-judgment data for which we know the process generating the experts’ distributions. We examine cases in which two well-calibrated experts are of equal or unequal quality and their judgments are independent, positively or negatively dependent. In this setting, the copula, frequentist, and best-expert approaches perform better and the equal-weight combination method performs worse than the alternative approaches.

Dates et versions

hal-02647855 , version 1 (29-05-2020)

Identifiants

Citer

James K Hammitt, Yifan Zhang. Combining experts’ judgments: comparison of algorithmic methods using synthetic data. Risk Analysis, 2013, 33 (1), pp.109-120. ⟨10.1111/j.1539-6924.2012.01833.x⟩. ⟨hal-02647855⟩
11 Consultations
0 Téléchargements

Altmetric

Partager

More