EndorTrust: An Endorsement-Based Reputation System for Trustworthy and Heterogeneous Crowdsourcing
Crowdsourcing is a new distributed computing paradigm that leverages the wisdom of crowd and the voluntary human effort to solve problems or collect data. In this context, trustworthiness of user contributions is of crucial importance to the viability of crowdsourcing. Prior mechanisms either do not consider the trustworthiness or quality of contributions or have to assess it only after workers' submission of contributions, which results in irreversible effort expenditure and negative player utilities. In this paper, we propose a reputation system, EndorTrust, to not only assess but also predict the trustworthiness of contributions without wasting workers' effort. The key approach is to explore an inter-worker relationship called endorsement to improve trustworthiness prediction using machine learning methods, while also taking into account the heterogeneity of both workers and tasks.
C. Wu et al., "EndorTrust: An Endorsement-Based Reputation System for Trustworthy and Heterogeneous Crowdsourcing," Proceedings of the 58th IEEE Global Communications Conference (2015, San Diego, CA), Institute of Electrical and Electronics Engineers (IEEE), Dec 2015.
The definitive version is available at https://doi.org/10.1109/GLOCOM.2014.7417352
58th IEEE Global Communications Conference, GLOBECOM 2015 (2015: Dec. 6-10, San Diego, CA)
Keywords and Phrases
Artificial intelligence; Distributed computer systems; Learning systems, Machine learning methods; Reputation systems; Wisdom of crowds; Workers', Crowdsourcing
International Standard Book Number (ISBN)
Article - Conference proceedings
© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.