University of Oulu

J. M. Ferreira, F. D. Rodríguez, A. Santos, O. Dieste, S. T. Acuña and N. Juristo, "Impact of Usability Mechanisms: A Family of Experiments on Efficiency, Effectiveness and User Satisfaction," in IEEE Transactions on Software Engineering, vol. 49, no. 1, pp. 251-267, 1 Jan. 2023, doi: 10.1109/TSE.2022.3149586.

Impact of usability mechanisms : a family of experiments on efficiency, effectiveness and user satisfaction

Saved in:
Author: Ferreira, Juan M.1; Rodríguez, Francy D.2; Santos, Adrián3;
Organizations: 1Facultad Politécnica, Universidad Nacional de Asunción, San Lorenzo, Paraguay
2Universidad Católica de Ávila, Ávila, Spain
3M3S (M-Group), ITEE University of Oulu, Oulu, Finland
4Universidad Politécnica de Madrid, Boadilla del Monte, Spain
5Universidad Autónoma de Madrid, Madrid, Spain
6Escuela Técnica Superior de Ingenieros Informáticos, Universidad Politécnica de Madrid, Boadilla del Monte, Spain
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 1.5 MB)
Persistent link:
Language: English
Published: Institute of Electrical and Electronics Engineers, 2023
Publish Date: 2023-10-13


Context: The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to depend on the usability feature and suggest priorities with respect to their implementation depending on how they promote user performance.

Objectives: We use a family of three experiments to increase the precision and generalization of the results in the baseline experiment and provide findings regarding the impact on user performance of the Abort Operation, Progress Feedback and Preferences usability mechanisms.

Method: We conduct two replications of the baseline experiment in academic settings. We analyse the data of 366 experimental subjects and apply aggregation (meta-analysis) procedures.

Results: We find that the Abort Operation and Preferences usability mechanisms appear to improve system usability a great deal with respect to efficiency, effectiveness and user satisfaction.

Conclusions: We find that the family of experiments further corroborates the results of the baseline experiment. Most of the results are statistically significant, and, because of the large number of experimental subjects, the evidence that we gathered in the replications is sufficient to outweigh other experiments.

see all

Series: IEEE transactions on software engineering
ISSN: 0098-5589
ISSN-E: 1939-3520
ISSN-L: 0098-5589
Volume: 49
Issue: 1
Pages: 251 - 267
DOI: 10.1109/TSE.2022.3149586
Type of Publication: A1 Journal article – refereed
Field of Science: 213 Electronic, automation and communications engineering, electronics
Copyright information: © The Author(s) 2022. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see