Distributing Judgement Problems

This post is about the problem of how to distribute human judgement problems to the crowd using Amazon's Mechanical Turk program. I have been examining these kinds of problems, and this an interesting take. See Dolores Lab's blog where they are tracking some illustrative examples.