University of Oulu

Elgendy, N., Elragal, A., Ohenoja, M., Päivärinta, T. (2022). Ex-Post Evaluation of Data-Driven Decisions: Conceptualizing Design Objectives. In: Nazaruka, Ē., Sandkuhl, K., Seigerroth, U. (eds) Perspectives in Business Informatics Research. BIR 2022. Lecture Notes in Business Information Processing, vol 462. Springer, Cham.

Ex-post evaluation of data-driven decisions : conceptualizing design objectives

Saved in:
Author: Elgendy, Nada1; Elragal, Ahmed2; Ohenoja, Markku3;
Organizations: 1M3S, Faculty of Information Technology and Electrical Engineering, University of Oulu, Oulu, Finland
2Department of Computer Science, Electrical and Space Engineering, Lulea University of Technology, Lulea, Sweden
3Environmental and Chemical Engineering, Faculty of Technology, University of Oulu, Oulu, Finland
Format: article
Version: accepted version
Access: embargoed
Persistent link:
Language: English
Published: Springer Nature, 2022
Publish Date: 2023-09-16


This paper addresses a need for developing ex-post evaluation for data-driven decisions resulting from collaboration between humans and machines. As a first step of a design science project, we propose four design objectives for an ex-post evaluation solution, from the perspectives of both theory (concepts from the literature) and practice (through a case of industrial production planning): (1) incorporate multi-faceted decision evaluation criteria across the levels of environment, organization, and decision itself and (2) acknowledge temporal requirements of the decision contexts at hand, (3) define applicable mode(s) of collaboration between humans and machines to pursue collaborative rationality, and (4) enable a (potentially automated) feedback loop for learning from the (discrete or continuous) evaluations of past decisions. The design objectives contribute by supporting the development of solutions for the observed lack of ex-post methods for evaluating data-driven decisions to enhance human-machine collaboration in decision making. Our future research involves design and implementation efforts through on-going industry-academia cooperation.

see all

Series: Lecture notes in business information processing
ISSN: 1865-1348
ISSN-E: 1865-1356
ISSN-L: 1865-1348
ISBN: 978-3-031-16947-2
ISBN Print: 978-3-031-16946-5
Issue: 462
Pages: 18 - 34
DOI: 10.1007/978-3-031-16947-2_2
Host publication: Perspectives in business informatics research : 21st International Conference on Business Informatics Research, BIR 2022, Rostock, Germany, September 21–23, 2022, Proceedings
Host publication editor: Nazaruka, Ērika
Sandkuhl, Kurt
Seigerroth, Ulf
Conference: 21st International Conference on Business Informatics Research, BIR 2022
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Funding: This research has been partially funded by the ITEA3 project Oxilate (https://
Copyright information: © The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2022. This version of the article has been accepted for publication, after peer review (when applicable) but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: Use of this Accepted Version is subject to the publisher’s Accepted Manuscript terms of use