On the Efficiency and Informativeness of Deep Conformal Classifiers using the Penalised Inverse Probability Nonconformity Function
Paul Melki  1, 2, *@  , Lionel Bombrun  1, 3@  , Boubacar Diallo  2@  , Jérôme Dias  2@  , Jean-Pierre Da Costa  1, 3@  
1 : Laboratoire de l'intégration, du matériau au système
Institut polytechnique de Bordeaux, Centre National de la Recherche Scientifique, Université de Bordeaux (Bordeaux, France)
2 : EXXACT Robotics
EXXACT Robotics
3 : Bordeaux Sciences Agro [Gradignan]
Ecole Nationale Supérieure des Sciences Agronomiques de Bordeaux-Aquitaine
* : Auteur correspondant

The conformal prediction framework transforms any point predictor into a set predictor with formal guarantees on the coverage of the true value at a chosen level of confidence. An important component of the conformal pipeline is the nonconformity score function which assigns to each observation a measure of "strangeness" in comparison to the previously seen data points. Multiple conformal models are often compared based on their efficiency, usually measured by the average size of the predicted sets, and their informativeness, the number of predicted singletons. As shown in the literature, these two criteria are influenced by the dataset, the performance of the base model and the nonconformity score function. The joint maximisation of these criteria using a well-behaved nonconformity function is desirable. The current work presents the "Penalised Inverse Probability" (PIP) nonconformity function inspired from classical score functions (Hinge Loss and Margin Score). Using some illustrative examples and experimental results on the task of crop and weed image classification in precision agriculture, we show that PIP exhibits precisely the desired behaviour, striking a good balance between informativeness and efficiency.



  • Poster
Personnes connectées : 4 Vie privée
Chargement...