Crisis, What Crisis: Does Reproducibility in Modeling & Simulation Really Matter?

Taylor, Simon J. E. and Eldabi, Tillal and Monks, Tom and Rabe, Markus and Uhrmacher, Adelinde M. (2018) Crisis, What Crisis: Does Reproducibility in Modeling & Simulation Really Matter? In: Winter Simulation Conference (WSC 2018), 09-12 Dec 2018, Gothenburg, Sweden. Proceedings, published by IEEE, pp. 749-762.

Full text not available from this repository.
Official URL: https://ieeexplore.ieee.org/document/8632232

Abstract

How important it is to our discipline that we can reproduce the results of Modeling & Simulation (M&S) research? How important is it to be able to (re)use the models, data and methods described in simulation publications to reproduce published results? Is it really that important or are the lessons and experiences described in a paper enough for us to build on the work of others? At the 2016 Winter Simulation Conference a panel considered opinions on reproducibility in discrete-event simulation. This article builds on these and asks if there really is a reproducibility crisis in M&S? A diverse range of views on the subject are presented including reflections on the reproducibility in terms of the art and science of simulation, the frustrations of poor reproducibility, perspectives from the industrial production & logistics community, the wider context of open science and artefact sharing, and the role of provenance beyond reproducibility.

Item Type: Conference or Workshop Item (Paper)
Additional Information: DOI: 10.1109/WSC.2018.8632232
Projects: GrEASE