Valid and Reproducible Simulation Studies—Making It Explicit

Reinhardt, Oliver and Warnke, Tom and Ruscheinski, Andreas and Uhrmacher, Adelinde M. (2019) Valid and Reproducible Simulation Studies—Making It Explicit. In: Computer Simulation Validation. Fundamental Concepts, Methodological Frameworks, Philosophical Perspectives. Springer International Publishing, Cham, pp. 607-672. ISBN 978-3-319-70765-5.

Preview

Text main.pdf - Submitted Version Download (549kB) | Preview

Abstract

The validation of complex simulation models is a challenging task.To increase the trust into the model, diverse simulation experiments are executed to explore the behavior of the model and to check its plausibility. Thus, these simulation experiments present an important information about the validity of the model, similarly as the data used for calibration, as input for the model, and for testing its predictiveness. Simulation models are rarely developed from scratch but by reusing existing models, e.g., by extending or composing them, or for cross-validation. These models and their validity provide further details about the validity of a model. Thus, a multitude of artifacts contribute intricately related to the final multi-level model and our "gut feelings" about it. To make these artifacts and their relations explicit and accessible, we will apply a declarative formal modeling language, a declarative language for specifying and executing diverse simulation experiments, and a provenance model to relate the diverse artifacts in telling the validation tale of an agent-based migration model.