Self-Service
Crowdsourcing at your fingertips
Find/Verify
Find/Very projectst typically ask contributors to verify or capture attributes for an object (e.g., finding and/or verifying business attributes, points of interest, people (contacts, product attributes, websites, etc.)
Best practices:
- Use Gold Standard Data to ensure quality - Gold tests contributors as they progress through the job, removing anyone who can't perform up to your standards.
- Make sure your Gold units account for all potentially correct responses. Otherwise, you may punish quality contributors.
- Use gold to train contributors around edge cases as well as your more common cases. Try and make your Gold as evenly distributed as possible across options as possible.
- When considering which geographic locations to run your jobs, think about cultural barriers that could cause conflicts.
- Choose your form language carefully - Clarity is important, even if your job is simple. Examples are highly recommended.
- Make sure that the data you are trying to obtain or verify is available online.
- Direct contributors to the correct sources (URLs, pre-populated searches, etc.).
- Validate input whenever possible using one of CF's validators, or a custom regex validator.
- Try not to collect too much information at once.
- Pursue like-attributes or one attribute at a time.
- Sometimes it is best to collect a source URL first and then have contributors visit the same url in subsequent jobs.
- Provide good Gold Standard Data that is not too hard and addresses all of the available correct options.
- Yield increases with web "popularity" of an item, as well as "specificity". It's easier to find a John Smith who graduated from Stanford in 2010 than it is to find a John Smith who lives in Arkansas.
- Make sure your job is yielding adequate results before running a large job. Tests are highly recommended.
- Be sure to skim through the options available to you in the Advanced Options on the Edit page before running.
More to come.
