Kernel embedding of maps for Bayesian inference: the variational mapping particle filter

Autores
Pulido, Manuel Arturo; van Leeuwen, Peter Jan
Año de publicación
2018
Idioma
inglés
Tipo de recurso
documento de conferencia
Estado
versión publicada
Descripción
Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.
Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino Unido
Fil: van Leeuwen, Peter Jan. University of Reading; Reino Unido
EGU General Assembly
Vienna
Austria
European Geosciences Union
Materia
STEIN GRADIENT
MONTE CARLO SEQUENTIAL
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/156122

id CONICETDig_18c6ee609dd652925f48f78bf5c40a23
oai_identifier_str oai:ri.conicet.gov.ar:11336/156122
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Kernel embedding of maps for Bayesian inference: the variational mapping particle filterPulido, Manuel Arturovan Leeuwen, Peter JanSTEIN GRADIENTMONTE CARLO SEQUENTIALhttps://purl.org/becyt/ford/1.5https://purl.org/becyt/ford/1Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino UnidoFil: van Leeuwen, Peter Jan. University of Reading; Reino UnidoEGU General AssemblyViennaAustriaEuropean Geosciences UnionCopernicus Publications2018info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectConferenciaJournalhttp://purl.org/coar/resource_type/c_5794info:ar-repo/semantics/documentoDeConferenciaapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/156122Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-11029-7006CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://meetingorganizer.copernicus.org/EGU2018/EGU2018-3750.pdfinfo:eu-repo/semantics/altIdentifier/url/https://www.geophysical-research-abstracts.net/egu2018.htmlInternacionalinfo:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2026-06-17T10:30:11Zoai:ri.conicet.gov.ar:11336/156122instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982026-06-17 10:30:11.897CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
title Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
spellingShingle Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
Pulido, Manuel Arturo
STEIN GRADIENT
MONTE CARLO SEQUENTIAL
title_short Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
title_full Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
title_fullStr Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
title_full_unstemmed Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
title_sort Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
dc.creator.none.fl_str_mv Pulido, Manuel Arturo
van Leeuwen, Peter Jan
author Pulido, Manuel Arturo
author_facet Pulido, Manuel Arturo
van Leeuwen, Peter Jan
author_role author
author2 van Leeuwen, Peter Jan
author2_role author
dc.subject.none.fl_str_mv STEIN GRADIENT
MONTE CARLO SEQUENTIAL
topic STEIN GRADIENT
MONTE CARLO SEQUENTIAL
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.5
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.
Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino Unido
Fil: van Leeuwen, Peter Jan. University of Reading; Reino Unido
EGU General Assembly
Vienna
Austria
European Geosciences Union
description Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.
publishDate 2018
dc.date.none.fl_str_mv 2018
dc.type.none.fl_str_mv info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/conferenceObject
Conferencia
Journal
http://purl.org/coar/resource_type/c_5794
info:ar-repo/semantics/documentoDeConferencia
status_str publishedVersion
format conferenceObject
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/156122
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-1
1029-7006
CONICET Digital
CONICET
url http://hdl.handle.net/11336/156122
identifier_str_mv Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-1
1029-7006
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://meetingorganizer.copernicus.org/EGU2018/EGU2018-3750.pdf
info:eu-repo/semantics/altIdentifier/url/https://www.geophysical-research-abstracts.net/egu2018.html
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.coverage.none.fl_str_mv Internacional
dc.publisher.none.fl_str_mv Copernicus Publications
publisher.none.fl_str_mv Copernicus Publications
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1868340204864012288
score 13.040872