University of Oulu

Jorge Goncalves, Michael Feldman, Subingqian Hu, Vassilis Kostakos, and Abraham Bernstein. 2017. Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities. In Proceedings of the 26th International Conference on World Wide Web Companion (WWW '17 Companion). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 1023-1031. DOI:

Task routing and assignment in crowdsourcing based on cognitive abilities

Saved in:
Author: Goncalves, Jorge1,2; Feldman, Michael3; Hu, Subingqian2;
Organizations: 1School of Computing and Information Systems, The University of Melbourne, Australia
2Center for Ubiquitous Computing, University of Oulu, Finland
3Dynamic and Distributed Information Systems Group, University of Zurich, Switzerland
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 1.6 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2017
Publish Date: 2018-05-25


Appropriate task routing and assignment is an important, but often overlooked, element in crowdsourcing research and practice. In this paper, we explore and evaluate a mechanism that can enable matching crowdsourcing tasks to suitable crowd-workers based on their cognitive abilities. We measure participants’ visual and fluency cognitive abilities with the well-established Kit of Factor-Referenced Cognitive Test, and measure crowdsourcing performance with our own set of developed tasks. Our results indicate that participants’ cognitive abilities correlate well with their crowdsourcing performance. We also built two predictive models (beta and linear regression) for crowdsourcing task performance based on the performance on cognitive tests as explanatory variables. The model results suggest that it is feasible to predict crowdsourcing performance based on cognitive abilities. Finally, we discuss the benefits and challenges of leveraging workers’ cognitive abilities to improve task routing and assignment in crowdsourcing environments.

see all

ISBN Print: 978-1-4503-4914-7
Pages: 1023 - 1031
DOI: 10.1145/3041021.3055128
Host publication: WWW '17 Companion Proceedings of the 26th International Conference on World Wide Web Companion
Conference: International World Wide Web Conference
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Funding: This work is partially funded by the Academy of Finland (Grants 276786-AWARE, 286386-CPDSS, 285459-iSCIENCE, 304925-CARE), and the European Commission (Grants PCIG11-GA-2012-322138, 645706-GRAGE, and 6AIKA-A71143-AKAI).
EU Grant Number: (322138) URBANMOB - Modelling Urban Mobility in City-Scale Ubiquitous Systems
(645706) GRAGE - Grey and green in Europe: elderly living in urban areas
Academy of Finland Grant Number: 276786
Detailed Information: 276786 (Academy of Finland Funding decision)
286386 (Academy of Finland Funding decision)
285459 (Academy of Finland Funding decision)
304925 (Academy of Finland Funding decision)
Copyright information: © 2017 International World Wide Web Conference Committee (IW3C2), published under Creative Commons CC BY 4.0 License.