Self-Service
Crowdsourcing at your fingertips
Categorization
Categorization projects typically ask contributors to provide a category for an object (e.g., product categorization, website categorization, image categorization, video categorization, etc.)
Best practices:
- Use Gold Standard Data to ensure quality - Gold tests contributors as they progress through the job, removing anyone who can't perform up to your standards.
- Make sure your Gold units account for all potentially correct responses. Otherwise, you may punish quality contributors.
- Use Gold to train contributors around edge cases as well as your more common cases. Try and make your Gold as evenly distributed across all options as possible.
- For the technically savvy, we recommend using our Taxonomy widget.
- When considering which geographic locations to run your jobs, think about cultural barriers that could cause conflicts.
- For Product categorization, the most helpful attributes are typically the title, description, and image.
- Choose your form language carefully - Clarity is important, even if your job is simple. Examples are highly recommended.
- Make sure your job is yielding adequate results before running a large job. Tests are highly recommended.
- Be sure to skim through the options available to you in the Advanced Options on the Edit page before running.
- For long term projects - Look for areas in your taxonomy where you are seeing a lot of disagreement among trusted contributors. It may be reveal weak points in your taxonomy/job.
More to come.
