University of Oulu

López, L., Burgués, X., Martínez-Fernández, S., Vollmer, A. M., Behutiye, W., Karhapää, P., Franch, X., Rodríguez, P., & Oivo, M. (2022). Quality measurement in agile and rapid software development: A systematic mapping. Journal of Systems and Software, 186, 111187.

Quality measurement in agile and rapid software development : a systematic mapping

Saved in:
Author: López, Lidia1,2; Burgués, Xavier1; Martínez-Fernández, Silverio1;
Organizations: 1Universitat Politècnica de Catalunya, Spain
2Barcelona Supercomputing Center, Spain
3Fraunhofer Institute for Experimental Software Engineering, Germany
4University of Oulu, Finland
5Universidad Politécnica de Madrid, Spain
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 4.4 MB)
Persistent link:
Language: English
Published: Elsevier, 2022
Publish Date: 2022-08-15


Context: In despite of agile and rapid software development (ARSD) being researched and applied extensively, managing quality requirements (QRs) are still challenging. As ARSD processes produce a large amount of data, measurement has become a strategy to facilitate QR management.

Objective: This study aims to survey the literature related to QR management through metrics in ARSD, focusing on: bibliometrics, QR metrics, and quality-related indicators used in quality management.

Methods: The study design includes the definition of research questions, selection criteria, and snowballing as search strategy.

Results: We selected 61 primary studies (2001–2019). Despite a large body of knowledge and standards, there is no consensus regarding QR measurement. Terminology is varying as are the measuring models. However, seemingly different measurement models do contain similarities.

Conclusions: The industrial relevance of the primary studies shows that practitioners have a need to improve quality measurement. Our collection of measures and data sources can serve as a starting point for practitioners to include quality measurement into their decision-making processes. Researchers could benefit from the identified similarities to start building a common framework for quality measurement. In addition, this could help researchers identify what quality aspects need more focus, e.g., security and usability that have surprisingly few metrics reported.

see all

Series: Journal of systems and software
ISSN: 0164-1212
ISSN-E: 1873-1228
ISSN-L: 0164-1212
Volume: 186
Article number: 111187
DOI: 10.1016/j.jss.2021.111187
Type of Publication: A1 Journal article – refereed
Field of Science: 113 Computer and information sciences
Funding: This work has been funded by the European Union’s Horizon 2020 research and innovation program through the Q-Rapids project (grant no. 732253). This research was also partially supported by the Spanish Ministerio de Economía, Industria y Competitividad through the DOGO4ML project (grant PID2020-117191RB-I00). Silverio Martínez-Fernández worked in Fraunhofer IESE before January 2020.
EU Grant Number: (732253) Q-RAPIDS - Quality-Aware Rapid Software Development
Copyright information: © 2021 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (