University of Oulu

Iflaah Salman and Burak Turhan. 2018. Effect of time-pressure on perceived and actual performance in functional software testing. In Proceedings of the 2018 International Conference on Software and System Process (ICSSP '18). ACM, New York, NY, USA, 130-139. DOI: https://doi.org/10.1145/3202710.3203148

Effect of time-pressure on perceived and actual performance in functional software testing

Saved in:
Author: Salman, Iflaah1; Turhan, Burak2
Organizations: 1M3S Group, University of Oulu, Oulu, Finland
2Department of Computer Science, Brunel University London, UK
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 0.8 MB)
Persistent link: http://urn.fi/urn:nbn:fi-fe201901152162
Language: English
Published: Association for Computing Machinery, 2018
Publish Date: 2019-01-15
Description:

Abstract

Background: Time-pressure is an inevitable reality of software industry that influences the performance of software engineers. It may result in adverse effects on software quality or distort the perception of performance on executed tasks to differ from actual performance.

Objective: We aim to investigate the effect of time-pressure on perceived and actual performance of software testers in the context of functional software testing.

Method: We performed two controlled experiments with 87 graduate students in two academic terms. We assessed actual performance in terms of coverage (i.e. percentage of test cases correctly identified) and perceived performance using NASA-TLX. We have an independent factorial design for our experimental study.

Results: The results reveal a significant effect of time-pressure on actual performance. However, we could not observe a significant effect of time-pressure on the perceived performance of the participants for the task undertaken. We also observed a significant negative correlation between actual and perceived performance when controlled for time-pressure and experimental session factors.

Conclusions: Time-pressure affects the actual performance in a testing task but the perception of accomplishment by the testers is sustained irrespective of time-pressure, indicating an over-estimation issue. Perception of performance should be adjusted to align with reality to account for the effect of time pressure. This will lead to better self estimates of performance.

see all

ISBN: 978-1-4503-6459-1
Pages: 130 - 139
DOI: 10.1145/3202710.3203148
OADOI: https://oadoi.org/10.1145/3202710.3203148
Host publication: ICSSP '18 Proceedings of the 2018 International Conference on Software and System Process. 26-27 May 2018, Gothenburg, Sweden
Host publication editor: O'Connor, R.V.
Houston, D.
Hebig, R.
Kuhrmann, M.
Conference: International Conference on Software and System Process
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Subjects:
Funding: This research is supported in part by the Academy of Finland Project #278354.
Academy of Finland Grant Number: 278354
Detailed Information: 278354 (Academy of Finland Funding decision)
Copyright information: © ACM 2018. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proceedings of the 2018 International Conference on Software and System Process (ICSSP '18), http://dx.doi.org/10.1145/3202710.3203148.