University of Oulu

Jorge Goncalves, Simo Hosio, Niels van Berkel, Furqan Ahmed, and Vassilis Kostakos. 2017. CrowdPickUp: Crowdsourcing Task Pickup in the Wild. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 51 (September 2017), 22 pages. DOI:

CrowdPickUp : crowdsourcing task pickup in the wild

Saved in:
Author: Goncalves, Jorge1; Hosio, Simo2; van Berkel, Niels1;
Organizations: 1The University of Melbourne
2University of Oulu
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 2.1 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2017
Publish Date: 2019-01-21


We develop and evaluate a new ubiquitous crowdsourcing platform called CrowdPickUp, that combines the advantages of mobile and situated crowdsourcing to overcome their respective limitations. In a 19-day long field study with 70 participants, we evaluate the quality of work that CrowdPickUp produces. In particular, we measure quality in terms of worker performance in a variety of tasks (requiring local knowledge, location-based, general) while using a number of different quality control mechanisms, and also capture workers’ perceptions of the platform. Our findings show that workers of CrowdPickUp contributed data of comparable quality to previously presented crowdsourcing deployments while at the same time allowing for a wide breadth of tasks to be deployed. Finally, we offer insights towards the continued exploration of this research agenda.

see all

Series: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies
ISSN: 2474-9567
ISSN-E: 2474-9567
ISSN-L: 2474-9567
Volume: 1
Issue: 3
Article number: 51
DOI: 10.1145/3130916
Type of Publication: A1 Journal article – refereed
Field of Science: 213 Electronic, automation and communications engineering, electronics
Funding: This work is partially funded by the Academy of Finland (Grants 286386-CPDSS, 285459-iSCIENCE), the European Commission (Grant, 6AIKA-A71143-AKAI), and Marie Skłodowska-Curie Actions (645706-GRAGE).
EU Grant Number: (645706) GRAGE - Grey and green in Europe: elderly living in urban areas
Academy of Finland Grant Number: 286386
Detailed Information: 286386 (Academy of Finland Funding decision)
285459 (Academy of Finland Funding decision)
Copyright information: © Copyright is held by the owner/author(s). Publication rights licensed to ACM. 2017. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.,