Self-Service
Crowdsourcing at your fingertips
Content Moderation
Content Moderation projects typically involve contributors screening objects for pre-determined content (e.g., image moderation, text moderation, audio moderation, video moderation, etc.)
Best practices:
- Use Gold Standard Data to ensure quality - Gold tests contributors as they progress through the job, removing anyone who can't perform up to your standards.
- Choose your form language carefully - Clarity is important, even if your job is simple. Examples are highly recommended.
- When considering which geographic locations to run your jobs, think about cultural barriers that could cause conflicts.
- Make sure your job is yielding adequate results before running a large job. Tests are highly recommended.
- Be sure to skim through the options available to you in the Advanced Options on the Edit page before running.
- Further automate the process with our Image Moderation API.
An example job:

The code:
CML:
<img src="{{ url }}" />
<cml:radios label="flag" validates="required" gold="true">
<cml:radio label="Yes"></cml:radio>
<cml:radio label="No" checked="true"></cml:radio>
</cml:radios>
CSS:
.jsawesome {
clear:none;
display:inline;
float:left;
padding:0px;
}
.mobmerge img {
width:256px;
height:192px;
display:inline;
margin:5px;
cursor:pointer;
border: 8px solid white;
}
.mobmerge img.chosen {
border: 8px solid green;
opacity:0.8
}
p.keyword{
margin:0px;
text-align:center;
}
.cml {
margin:0px;
}
.radios {
display:none
}
Javascript:
$$(".mobmerge img").addEvent("click", function(){
var inputs = this.getNext().getElements("input")
if(this.hasClass("chosen")) {
this.removeClass("chosen")
inputs[0].checked = false
inputs[1].checked = true
} else {
this.addClass("chosen")
inputs[1].checked = false
inputs[0].checked = true
}
})
if(document.location.href.test(/raw/)){
$$(".units").addClass("raw")
}
$$(".check_this_box_if_the_image_above_matches").addEvent("click", function() {
var images = $("images");
if (this.checked) {
images.style.display = "none";
} else {
images.style.display = "";
}
});
More to come.