Path integral control problems and Multilevel Monte Carlo Method

• Autores: Menchón, Silvia Adriana; Kappen, H. J.
• Año de publicación: 2017
• Idioma: inglés
• Tipo de recurso: documento de conferencia
• Materia: Multilevel Monte Carlo; Importance Sampling; Path integral control; Cross entropy method
• Institución: Universidad Nacional de Córdoba

Ponencia presentada en el VI MACI 2017, Comodoro Rivadavia, Argentina, 2 al 5 de mayo de 2017 (Matemática Aplicada, Computacional e Industrial).
Fil: Menchón, Silvia Adriana. Universidad Nacional de Córdoba. Facultad de Matemática, Astronomía, Física y Computación; Argentina.
Fil: Menchón, Silvia Adriana. Consejo Nacional de Investigaciones Científicas y Técnicas - Universidad Nacional de Córdoba. Instituto de Física Enrique Gaviola; Argentina.
Fil: Kappen, H. J. Radboud University, Nijmegen. Donders Institute Brain Cognition and Behavior. Machine Learning Group; The Netherlands.
The main aim of stochastic optimal control theory is to compute an optimal sequence of actions to attain a future goal. When the system dynamics is subject to white Gaussian noise, it is possible to define a class of non-linear stochastic control problems that can be efficiently solved. Path integral control problems represent a restricted class of non-linear control problems with arbitrary dynamics and state cost, but with a linear dependence of the control on the dynamics and quadratic control cost. Since the path integral involves an expectation value with respect to a dynamical system, the optimal control can be estimated by implementing Monte Carlo sampling. Although importance sampling is used to improve numerical computations, the effective sample size may still be low. Here, we propose a way of implementing importance sampling with multilevel Monte Carlo and test it in a finite horizon control problem based on Lorenz-96 model.
Fil: Menchón, Silvia Adriana. Universidad Nacional de Córdoba. Facultad de Matemática, Astronomía, Física y Computación; Argentina.
Fil: Menchón, Silvia Adriana. Consejo Nacional de Investigaciones Científicas y Técnicas - Universidad Nacional de Córdoba. Instituto de Física Enrique Gaviola; Argentina.
Fil: Kappen, H. J. Radboud University, Nijmegen. Donders Institute Brain Cognition and Behavior. Machine Learning Group; The Netherlands.
Otras Ciencias Físicas