Our distributed labelling workforce has been vetted and trained to label tasks on our platform. However, keep in mind that they may lack your domain knowledge. Additionally, English may not be their first language. To help labellers understand your project needs,
- Use simple English terms as opposed to industry-specific terminology or acronyms.
- Be specific and provide everything necessary for someone unfamiliar with your use case.
- Use the template provided to help labellers easily locate key information in your instructions.
Our users have reported improved annotation quality when using the templates below to create instructions. However, you’re free to adapt the template contents to suit the needs of your project.
How to use the sections of the template effectively:
- Objectives provides a concise overview of the task to provide context.
- General Rules covers general guidelines for how you want your labels to be drawn.
- Label Overview allows our labellers to review your labels quickly.
- Labels specifies how you expect each label to be labelled in detail.
- Edge Cases clarifies ambiguous scenarios which may crop up in your tasks.
- Common Mistakes helps our labellers understand common errors and avoid them.
Tips for writing instructions
- Add as many images and examples as possible.
- Include examples of what doesn't need be annotated.
- Clarify the differences between labels that are similar.
- Be patient. It often takes several iterations to create good instructions, as every ML project is different.
- Adjust your instructions based on where labellers make mistakes.
Updated 9 months ago