1. Design and Implementation of Relevance Assessments Using Crowdsourcing Omar Alonso 1and Ricardo Baeza-Yates 2 1 Microsoft Corp., Mountain View, California, US 2 Yahoo!…