Description

Nucleus allows ML teams to easily QA their annotations to decide what items to redo. This is particularly helpful for teams having QA ops people who are dedicated to check annotation quality.

Pre-reqs: Private Dataset, Annotations

Steps:

Navigate to your dataset containing annotations
Type a query to limit grid view to items of interest e.g. timeofday = night
Click on a specific item to open the detail view
Turn on annotations by clicking on the “Ground Truth” view icon in the sidebar
Hovering over each entry in the sidebar will also highlight the relevant annotation
Choose to limit the visualization to specific classes using the class view icon
Visually review the annotation, use zoom & pan controls to dive deeper
Click “Review Ground Truth” button on the top left
Click a thumbs up or thumbs down icon (or use y / n keys) to record the review
Continue to the next item & repeat. Continue until all items are reviewed
Use the “metadata.review_status = rejected” query to retrieve rejected items
Add these items to a slice and send to annotation for fixing!