University of Oulu

P. Ram, P. Rodriguez, M. Oivo and S. Martínez-Fernández, "Success Factors for Effective Process Metrics Operationalization in Agile Software Development: A Multiple Case Study," 2019 IEEE/ACM International Conference on Software and System Processes (ICSSP), Montreal, QC, Canada, 2019, pp. 14-23. doi: 10.1109/ICSSP.2019.00013

Success factors for effective process metrics operationalization in agile software development : a multiple case study

Saved in:
Author: Ram, Prabhat1; Rodriguez, Pilar1; Oivo, Markku1;
Organizations: 1M3S, Faculty of Information Technology and Electrical Engineering, University of Oulu, Oulu, Finland
2Fraunhofer IESE, Kaiserslautern, Germany
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 0.8 MB)
Persistent link:
Language: English
Published: Institute of Electrical and Electronics Engineers, 2019
Publish Date: 2019-10-31


Existing literature proposes success factors for establishing metrics programs. However, very few studies focus on factors that could ensure long-term use of metrics, and even fewer studies investigate such factors in the context of Agile Software Development (ASD). Motivated by this knowledge gap, we aim to identify success factors for operationalizing metrics in ASD, particularly, factors that could help in the long-term use of metrics. We conducted a multiple case study, where we operationalized process metrics at two software-intensive companies using ASD. We learned that data availability and development process are the two fundamental success factors for process metrics operationalization, albeit less prominent in literature. Companies prefer iterative and incremental operationalization of stable and functional process metrics, which is analogous to the agile way of working. Metrics trustworthiness plays a key role in successful operationalization of process metrics, and is potentially vital to ensuring their long-term use. By comparing the identified success factors with the existing literature, we conclude that success factors concerning data availability, development process, and metrics trustworthiness warrant greater attention, especially to maximize the chances of long-term use of process metrics.

see all

ISBN: 978-1-7281-3393-5
ISBN Print: 978-1-7281-3394-2
Pages: 14 - 23
DOI: 10.1109/ICSSP.2019.00013
Host publication: 2019 IEEE/ACM International Conference on Software and System Processes, ICSSP 2019, Montreal, Canada, 25 May 2019 : proceedings
Conference: IEEE/ACM International Conference on Software and System Processes
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Funding: This work is a result of the Q-Rapids Project, funded by the European Union’s Horizon 2020 research and innovation program, under grant agreement No. 732253
EU Grant Number: (732253) Q-RAPIDS - Quality-Aware Rapid Software Development
Copyright information: © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.