We're thrilled to introduce Immediate Job Feedback—a powerful new feature in CVAT that takes annotation quality to the next level. Immediate Job Feedback provides annotators with real-time quality insights right after completing a job, helping ensure every annotation meets your project quality standards.
This new update streamlines workflows, boosts annotation accuracy, and gives you confidence that your labeling meets the expected quality—every single time.
What Is Immediate Job Feedback?
Immediate Job Feedback is a smart CVAT capability that delivers instant feedback on annotation quality after a job is completed. While annotators work, CVAT automatically evaluates their performance using its built-in quality control tools – specifically the Ground Truth and Honeypots (explained here).
Once the task is finished, CVAT compares the results against a predefined quality threshold and immediately displays a pop-up summary to the annotator: the message clearly states whether the quality meets the required standard or needs improvement.
How to Set It Up
Note: Immediate Job Feedback is available with a paid subscription to CVAT Online and with the Enterprise edition of CVAT On‑Premises.
To enable it:
- Go to Actions → Quality Control → Settings
- Define the following parameters:
- Target metric
- Target metric threshold (your quality bar)
- Max validations per job (the maximum number of job validations per assignee)
Once configured, annotators will automatically receive a quality summary window after every completed job.
Instant Rework for Better Results
If the annotation quality falls below your predefined threshold, annotators can immediately re-annotate the job to meet the necessary standards – no delays, no guesswork.
Detailed instructions on setting up Immediate Job Feedback can be found in our documentation.
Drive Accuracy, Speed, and Insight – Right Now
Immediate Job Feedback brings CVAT one step closer to a smarter, more responsive annotation environment.
Ready to integrate Immediate Job Feedback into your pipeline? Sign up or log in to your CVAT Online account to try Immediate Job Feedback today, or contact us to enable it on your self-hosted Enterprise instance.
.png)
.svg)
