Start Labeling

Depending on whether you're an attempter or a reviewer, you may be shown different types of tasks.

Attempt Tasks

If you are assigned as an Attempter on a project, your job is to complete the task from scratch. Upon submission, the task either goes to a Reviewer or gets completed, depending on whether or not your project has review layers.

For most task types, you can change your labeling tool using the toolbar on the left. At any time, if you’re unsure how to label your task, you can read the task instructions again by pressing the Instructions button on the bottom left.

Once you’ve familiarized yourself with a new task type, you can use keyboard shortcuts to improve your labeling speed and decrease labeling fatigue. You can see all of the keyboard shortcuts by pressing the Shortcuts button on the bottom left.

Review Tasks

If you are assigned as a Reviewer on a project, your job is to review the work of a task that was already attempted by an Attempter. As a reviewer, you have three options for each task:

1. Approve:
If the task was done correctly, approve the tasks. This will either complete the task, or send it to another reviewer depending on how many layers of review are in this project.

2. Make Changes:
If the task was done incorrectly, or needs slight adjustments, you can fix the annotations to correct the task. Additionally, you can provide feedback to the Attempter that did this task. This will help the labeler learn and improve in the future. This will either complete the task, or send it to another reviewer depending on how many layers of review are in this project.

3. Send back to queue:
This will send the task back to the queue to be attempted again by an Attempter. Only choose this option if the task was incorrectly labeled, and it would be too time consuming to fix.

Calibration Tasks

If your project manager created a Calibration Batch, you may see Calibration Tasks. For these tasks, your job is to provide feedback on the taxonomy and instructions, to help the project manager improve them to make it easier for you and your team to label.

A feedback popup will appear in the bottom right of each calibration task. Complete the questions after you’ve attempted to complete the task.

📘

New Tool: Auto-Annote

For 2D Image Annotation, Video Annotation, and Semantic Segmentation task types, we have a new tool to help speed up labeling time! If you have polygons or segmentation masks you need to create, you can now use our auto-annotate too to speed up your labeling process.

See our docs for it!