Skip to Main content Skip to Navigation
Conference papers

Towards Optimal Naive Bayes Nearest Neighbor

Régis Behmo 1 Paul Marcombes 1, 2, 3 Arnak S. Dalalyan 2, 3 Veronique Prinet 1
2 imagine [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, CSTB - Centre Scientifique et Technique du Bâtiment, ENPC - École des Ponts ParisTech
Abstract : Naive Bayes Nearest Neighbor (NBNN) is a feature-based image classifier that achieves impressive degree of accuracy by exploiting 'Image-to-Class' distances and by avoiding quantization of local image descriptors. It is based on the hypothesis that each local descriptor is drawn from a class-dependent probability measure. The density of the latter is estimated by the non-parametric kernel estimator, which is further simplified under the assumption that the normalization factor is class-independent. While leading to significant simplification, the assumption underlying the original NBNN is too restrictive and considerably degrades its generalization ability. The goal of this paper is to address this issue. As we relax the incriminated assumption we are faced with a parameter selection problem that we solve by hinge-loss minimization. We also show that our modified formulation naturally generalizes to optimal combinations of feature types. Experiments conducted on several datasets show that the gain over the original NBNN may attain up to 20 percentage points. We also take advantage of the linearity of optimal NBNN to perform classification by detection through efficient sub-window search, with yet another performance gain. As a result, our classifier outperforms -- in terms of misclassification error -- methods based on support vector machine and bags of quantized features on some datasets.
Document type :
Conference papers
Complete list of metadata
Contributor : Arnak Dalalyan <>
Submitted on : Wednesday, December 21, 2011 - 6:00:52 PM
Last modification on : Friday, February 5, 2021 - 4:02:34 AM

Links full text



Régis Behmo, Paul Marcombes, Arnak S. Dalalyan, Veronique Prinet. Towards Optimal Naive Bayes Nearest Neighbor. ECCV 2010 - 11th European Conference on Computer Vision, Sep 2010, Heraklion, Crete, Greece. pp.171-184, ⟨10.1007/978-3-642-15561-1_13⟩. ⟨hal-00654399⟩



Record views