University of Oulu

Jonas Oppenlaender, Thanassis Tiropanis, and Simo Hosio. 2020. CrowdUI: Supporting Web Design with the Crowd. Proc. ACM Hum.-Comput. Interact. 4, EICS, Article 76 (June 2020), 28 pages. DOI:

CrowdUI : supporting web design with the crowd

Saved in:
Author: Oppenlaender, Jonas1; Tiropanis, Thanassis2; Hosio, Simo1
Organizations: 1University of Oulu, Finland
2University of Southampton, United Kingdom
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 1.1 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2020
Publish Date: 2020-07-01


Web design is a complex and challenging task. It involves making many design decisions that materialise preconceived notions of user needs that may or may not be true. In this paper, we investigate supporting the co-design of a website with visual feedback elicited from the website’s community of users. Website users can express their needs by re-arranging and modifying the website’s layout and design. To explore and validate this idea, we present CrowdUI, a web-based tool that enables members of the community of a website to visually express their design improvement ideas, frustrations and needs, and to send this feedback to the person in charge of designing or maintaining the website.

CrowdUI is validated in a study with 45 users of a popular social media and networking website. Second, our qualitative evaluation with 60 experienced web developers shows that CrowdUI is able to elicit diverse and meaningful feedback. Put together, our results suggest that CrowdUI’s approach constitutes a productive setting for eliciting visual feedback from the user community as a complement to traditional ways of eliciting feedback and participatory design. Finally, based on our experiences, we discuss a design space for crowdsourced web design and provide design recommendations for similar future tools.

see all

Series: Proceedings of the ACM on human-computer interaction
ISSN: 2573-0142
ISSN-E: 2573-0142
ISSN-L: 2573-0142
Pages: 1 - 28
Article number: 76
DOI: 10.1145/3394978
Host publication: Proceedings of the ACM on Human-Computer Interaction (PACMHCI)
Conference: ACM on Human-Computer Interaction
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Funding: We thank the anonymous reviewers for their helpful and generous comments on the manuscript. This work was in part funded by the Academy of Finland (Grants 313224-STOP, 320089-SENSATE, 316253-SENSATE and 318927-6Genesis Flagship).
Academy of Finland Grant Number: 313224
Detailed Information: 313224 (Academy of Finland Funding decision)
320089 (Academy of Finland Funding decision)
316253 (Academy of Finland Funding decision)
318927 (Academy of Finland Funding decision)
Copyright information: © 2020 Copyright held by the owner/author(s). Publication rights licensed to ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proceedings of the ACM on Human-Computer Interaction (PACMHCI),