1. How to Measure Quality with Disagreement? or the Three Sides of CrowdTruth Lora Aroyo & Chris Welty 2. CrowdTruth Annotator disagreement is signal, not noise. It is…