Kernel embedding of maps for Bayesian inference: the variational mapping particle filter
- Autores
- Pulido, Manuel Arturo; van Leeuwen, Peter Jan
- Año de publicación
- 2018
- Idioma
- inglés
- Tipo de recurso
- documento de conferencia
- Estado
- versión publicada
- Descripción
- Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.
Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino Unido
Fil: van Leeuwen, Peter Jan. University of Reading; Reino Unido
EGU General Assembly
Vienna
Austria
European Geosciences Union - Materia
-
STEIN GRADIENT
MONTE CARLO SEQUENTIAL - Nivel de accesibilidad
- acceso abierto
- Condiciones de uso
- https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
- Repositorio
.jpg)
- Institución
- Consejo Nacional de Investigaciones Científicas y Técnicas
- OAI Identificador
- oai:ri.conicet.gov.ar:11336/156122
Ver los metadatos del registro completo
| id |
CONICETDig_18c6ee609dd652925f48f78bf5c40a23 |
|---|---|
| oai_identifier_str |
oai:ri.conicet.gov.ar:11336/156122 |
| network_acronym_str |
CONICETDig |
| repository_id_str |
3498 |
| network_name_str |
CONICET Digital (CONICET) |
| spelling |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filterPulido, Manuel Arturovan Leeuwen, Peter JanSTEIN GRADIENTMONTE CARLO SEQUENTIALhttps://purl.org/becyt/ford/1.5https://purl.org/becyt/ford/1Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed.Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino UnidoFil: van Leeuwen, Peter Jan. University of Reading; Reino UnidoEGU General AssemblyViennaAustriaEuropean Geosciences UnionCopernicus Publications2018info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectConferenciaJournalhttp://purl.org/coar/resource_type/c_5794info:ar-repo/semantics/documentoDeConferenciaapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/156122Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-11029-7006CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://meetingorganizer.copernicus.org/EGU2018/EGU2018-3750.pdfinfo:eu-repo/semantics/altIdentifier/url/https://www.geophysical-research-abstracts.net/egu2018.htmlInternacionalinfo:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2026-06-17T10:30:11Zoai:ri.conicet.gov.ar:11336/156122instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982026-06-17 10:30:11.897CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse |
| dc.title.none.fl_str_mv |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| title |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| spellingShingle |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter Pulido, Manuel Arturo STEIN GRADIENT MONTE CARLO SEQUENTIAL |
| title_short |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| title_full |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| title_fullStr |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| title_full_unstemmed |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| title_sort |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter |
| dc.creator.none.fl_str_mv |
Pulido, Manuel Arturo van Leeuwen, Peter Jan |
| author |
Pulido, Manuel Arturo |
| author_facet |
Pulido, Manuel Arturo van Leeuwen, Peter Jan |
| author_role |
author |
| author2 |
van Leeuwen, Peter Jan |
| author2_role |
author |
| dc.subject.none.fl_str_mv |
STEIN GRADIENT MONTE CARLO SEQUENTIAL |
| topic |
STEIN GRADIENT MONTE CARLO SEQUENTIAL |
| purl_subject.fl_str_mv |
https://purl.org/becyt/ford/1.5 https://purl.org/becyt/ford/1 |
| dc.description.none.fl_txt_mv |
Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed. Fil: Pulido, Manuel Arturo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones En Biodiversidad y Biotecnología. Grupo de Investigación en Química Analítica y Modelado Molecular; Argentina. University of Reading; Reino Unido Fil: van Leeuwen, Peter Jan. University of Reading; Reino Unido EGU General Assembly Vienna Austria European Geosciences Union |
| description |
Data assimilation for high-dimensional highly nonlinear systems is becoming crucial for several geosciences applications. In this work, a novel particle filter is introduced which aims to an efficient sampling of the posterior pdf in high-dimensional state spaces considering a limited number of particles. Particles are mapped from the proposal to the posterior density using the principles of optimal transport. The Kullback-Leibler divergence between the posterior density and the proposal divergence is minimised using variational principles, leading to an iterative gradient-descent like algorithm. A key ingredient of the mapping is that the transformations are embedded in a reproducing kernel Hilbert space which constrains the dimensions of the space for the optimal transport to the number of particles. Gradient information of the Kullback-Leibler divergence allows a quick convergence using well known gradient-based optimization algorithms from machine learning, adadelta and adam, which do not require cost function calculations. Evaluation of the method and comparison with a SIR filter is conducted as a proof-of-concept in the Lorenz-63 system, where the exact solution is known. No resampling is required even for long recursive implementations. The number of effective particles remains close to the total number of particles in all the recursions. Hence, the mapping particle filter does not suffer from sample impoverishment, even in highly nonlinear settings. Finally, results from experiments on a high-dimensional turbulent geophysical system will be presented, and the performance of the new method compared to other existing method will be discussed. |
| publishDate |
2018 |
| dc.date.none.fl_str_mv |
2018 |
| dc.type.none.fl_str_mv |
info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/conferenceObject Conferencia Journal http://purl.org/coar/resource_type/c_5794 info:ar-repo/semantics/documentoDeConferencia |
| status_str |
publishedVersion |
| format |
conferenceObject |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/11336/156122 Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-1 1029-7006 CONICET Digital CONICET |
| url |
http://hdl.handle.net/11336/156122 |
| identifier_str_mv |
Kernel embedding of maps for Bayesian inference: the variational mapping particle filter; EGU General Assembly; Vienna; Austria; 2018; 1-1 1029-7006 CONICET Digital CONICET |
| dc.language.none.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
info:eu-repo/semantics/altIdentifier/url/https://meetingorganizer.copernicus.org/EGU2018/EGU2018-3750.pdf info:eu-repo/semantics/altIdentifier/url/https://www.geophysical-research-abstracts.net/egu2018.html |
| dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
| eu_rights_str_mv |
openAccess |
| rights_invalid_str_mv |
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
| dc.format.none.fl_str_mv |
application/pdf application/pdf |
| dc.coverage.none.fl_str_mv |
Internacional |
| dc.publisher.none.fl_str_mv |
Copernicus Publications |
| publisher.none.fl_str_mv |
Copernicus Publications |
| dc.source.none.fl_str_mv |
reponame:CONICET Digital (CONICET) instname:Consejo Nacional de Investigaciones Científicas y Técnicas |
| reponame_str |
CONICET Digital (CONICET) |
| collection |
CONICET Digital (CONICET) |
| instname_str |
Consejo Nacional de Investigaciones Científicas y Técnicas |
| repository.name.fl_str_mv |
CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas |
| repository.mail.fl_str_mv |
dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar |
| _version_ |
1868340204864012288 |
| score |
13.040872 |