Towards an Open Repository for Reproducible Performance Comparison of Parallel and Distributed Discrete-Event Simulators

Köster, Till and Uhrmacher, Adelinde M. and Andelfinger, Philipp (2022) Towards an Open Repository for Reproducible Performance Comparison of Parallel and Distributed Discrete-Event Simulators. In: ACM Conference SIGSIM Principles of Advanced Discrete Simulation (PADS 2022), 08-10 Jun 2022, Atlanta, GA, USA (Virtuell). Proceedings, published by ACM, New York, NY, USA, pp. 31-32.

Full text not available from this repository.
Official URL: https://doi.org/10.1145/3518997.3534989

Abstract

Among the parallel and distributed simulation field’s main subjects are the performance benefits of new methods and optimizations. However, performance evaluations of the various simulators often rely on custom models, parametrizations, and baseline implementations, which complicates direct comparisons. We present our vision and initial steps towards COMPADS, a benchmark model and repository for reproducibly comparing the performance of parallel and distributed simulators and their respective algorithms. COMPADS is short for COMparing Parallel And Distributed Simulators. The first results include a novel deterministic-by-design synthetic benchmark model inspired by PHOLD and La-pdes. The benchmark output is a checksum that attests to the correctness of an implementation and its execution. So far, implementations exist for the simulators ROOT-Sim and ROSS.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Best PhD Colloqium Award!
Projects: ESCeMMo