Description

You can use Nucleus to obtain class confusions in the form of confusion matrix to easily understand class based performance of the model and to get to the visual samples of a specific confusion easily.

Pre-reqs: Dataset, Annotations, Predictions (evaluated)

Steps

1. Open dataset with annotations & predictions both uploaded
2. Use the top navigation to go to the “Charts” page
3. Use the drop down to select model of interest
4. Scroll down to “Confusion Matrix” chart
5. Hover on any cell to get a normalized number for any block
6. See distribution over a specific subset by running a query e.g. metadata.weather=rain
7. Click on any block to query the underlying data items in the grid view

Confusion matrix makes it very easy to get to error instances (FP, FN) in Nucleus. This unlocks powerful use cases e.g. verifying annotations, debugging models etc.