Reinforcement Learning for Digital Twins

Francis, Deena and Friederich, Jonas and Uhrmacher, Adelinde and Lazarova-Molnar, Sanja (2024) Reinforcement Learning for Digital Twins. In: Digital Twins, Simulation, and the Metaverse. Springer Nature Switzerland, Cham, pp. 51-68. ISBN 978-3-031-69107-2.

Full text not available from this repository.
Official URL: https://doi.org/10.1007/978-3-031-69107-2_3

Abstract

Digital TwinsDigital twin (DTs) aim to ongoingly replicate complex systems through data acquisition, simulation, and analysis to monitor, optimize, and/or experiment to achieve systems' goals. Typically, systems adapt and evolve during their lifetimes, which requires updating simulation modelsSimulation models and analysis as new data arrives or conditions change. The dynamics of environments under which DTs commonly operate necessitate using a paradigm that can deal with the uncertainties and unprecedented scenarios that may arise throughout its operation. Reinforcement LearningReinforcement learning (RL) is a learning paradigm that provides tools to do precisely this. It is concerned with sequential decision-making in dynamic, uncertain environments. In this work, we discuss the current and potential role of RL in the context of DTs, motivate its usage through a concrete case studyCase study, and finally discuss the opportunities and challenges.

Item Type: Book Section