For high-volume projects, batches can optionally be used to further divide work inside a project. Batches can tie to specific datasets you use internally, or can be used to note which tasks were part of a weekly submission for example.
Scale Enterprise Workflow
- Batch is created (status =
in_progress
) - Tasks are added to the batch by specifying the
batch
field on the task to be the name of yourbatch
- The final task is completed, the batch is completed (status
completed
) and the callback is fired with the example to the right.
Scale Rapid Workflow
If you are using Scale Rapid, batches take on another purpose, where they are deeply linked to the task delivery model.
There are two types of batches, production batches, and calibration batches. Calibration batches help ensure your project is ready for humans to start working on your production data (with "normal" batches).
- Batch is created (status =
staging
) - Tasks are added to the batch by specifying the
batch
field on the task to be the name of yourbatch
- Batches need to be finalized (status =
in_progress
) - Once a batch is finalized, tasks will be submitted to our taskers to begin labeling. No tasks may be added to a batch once it has been finalized.
- The final task is completed, the batch is completed (status
completed
) and the callback is fired with the example to the right.
Scale Studio Workflow
- Batch is created (status =
staging
) - Tasks are added to the batch by specifying the
batch
field on the task to be the name of yourbatch
- Batches need to be finalized (status =
in_progress
) - Once a batch is finalized, tasks will be submitted to your team workers to begin labeling. No tasks may be added to a batch once it has been finalized.
- The final task is completed, the batch is completed (status
completed
) and the callback is fired with the example to the right.
Live vs. Testing Mode
The API key you use to create batches/projects/tasks with must all match: test projects can only be used with test batches, and test tasks; likewise with live projects, live batches, and live tasks.
{
"batch": "kitten_labeling_2021-07", // the name of the batch that was just completed
"status": "completed", // the status of the batch
"stats": { // counts of the tasks of this batch, grouped by their status
"completed": 20,
"canceled": 3,
"error": 5,
}
}