DESCQA: an automated validation framework for Synthetic Sky Catalogs
- Autores
- Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; Uram, Thomas D.; Benson, Andrew J.; Campbell, Duncan; Cora, Sofia Alejandra; Derose, Joseph; Matteo, Tiziana Di; Habib, Salman; Hearin, Andrew P.; Kalmbach, J. Bryce; Krughoff, K. Simon; Lanusse, François; Lukic, Zarija; Mandelbaum, Rachel; Newman, Jeffrey A.; Padilla, Nelson; Paillas, Enrique; Pope, Adrian; Ricker, Paul M.; Ruiz, Andrés N.; Tenneti, Ananth; Vega Martínez, Cristian Antonio; Wechsler, Risa H.; Zhou, Rongpu; Zu, Ying
- Año de publicación
- 2018
- Idioma
- inglés
- Tipo de recurso
- artículo
- Estado
- versión publicada
- Descripción
- The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.
Fil: Mao, Yao-Yuan. Astrophysics And Cosmology Center; Estados Unidos
Fil: Kovacs, Eve. Argonne National Laboratory; Estados Unidos
Fil: Heitmann, Katrin. Argonne National Laboratory; Estados Unidos
Fil: Uram, Thomas D.. Argonne National Laboratory; Estados Unidos
Fil: Benson, Andrew J.. Carnegie Observatories; Chile
Fil: Campbell, Duncan. Mcwilliams Center For Cosmology; Estados Unidos
Fil: Cora, Sofia Alejandra. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; Argentina
Fil: Derose, Joseph. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos
Fil: Matteo, Tiziana Di. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos
Fil: Habib, Salman. Mcwilliams Center For Cosmology; Estados Unidos
Fil: Hearin, Andrew P.. Argonne National Laboratory; Estados Unidos
Fil: Kalmbach, J. Bryce. Argonne National Laboratory; Estados Unidos
Fil: Krughoff, K. Simon. Department Of Physics; Estados Unidos
Fil: Lanusse, François. Large Synoptic Survey Telescope; Estados Unidos
Fil: Lukic, Zarija. Mcwilliams Center For Cosmology; Estados Unidos
Fil: Mandelbaum, Rachel. Lawrence Berkeley National Laboratory; Estados Unidos
Fil: Newman, Jeffrey A.. Mcwilliams Center For Cosmology; Estados Unidos
Fil: Padilla, Nelson. Astrophysics And Cosmology Center; Estados Unidos
Fil: Paillas, Enrique. Instituto de Astrofísica; Chile
Fil: Pope, Adrian. Instituto de Astrofísica; Chile
Fil: Ricker, Paul M.. Argonne National Laboratory; Estados Unidos
Fil: Ruiz, Andrés N.. Department Of Astronomy; Estados Unidos
Fil: Tenneti, Ananth. University of Carnegie Mellon; Estados Unidos
Fil: Vega Martínez, Cristian Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; Argentina
Fil: Wechsler, Risa H.. Mcwilliams Center For Cosmology; Estados Unidos
Fil: Zhou, Rongpu. University of Pittsburgh; Estados Unidos
Fil: Zu, Ying. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos - Materia
-
LARGE-SCALE STRUCTURE OF UNIVERSE
METHODS: NUMERICAL - Nivel de accesibilidad
- acceso abierto
- Condiciones de uso
- https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
- Repositorio
.jpg)
- Institución
- Consejo Nacional de Investigaciones Científicas y Técnicas
- OAI Identificador
- oai:ri.conicet.gov.ar:11336/82726
Ver los metadatos del registro completo
| id |
CONICETDig_f941a765d9657479e37eb39d3a63e92e |
|---|---|
| oai_identifier_str |
oai:ri.conicet.gov.ar:11336/82726 |
| network_acronym_str |
CONICETDig |
| repository_id_str |
3498 |
| network_name_str |
CONICET Digital (CONICET) |
| spelling |
DESCQA: an automated validation framework for Synthetic Sky CatalogsMao, Yao-YuanKovacs, EveHeitmann, KatrinUram, Thomas D.Benson, Andrew J.Campbell, DuncanCora, Sofia AlejandraDerose, JosephMatteo, Tiziana DiHabib, SalmanHearin, Andrew P.Kalmbach, J. BryceKrughoff, K. SimonLanusse, FrançoisLukic, ZarijaMandelbaum, RachelNewman, Jeffrey A.Padilla, NelsonPaillas, EnriquePope, AdrianRicker, Paul M.Ruiz, Andrés N.Tenneti, AnanthVega Martínez, Cristian AntonioWechsler, Risa H.Zhou, RongpuZu, YingLARGE-SCALE STRUCTURE OF UNIVERSEMETHODS: NUMERICALhttps://purl.org/becyt/ford/1.3https://purl.org/becyt/ford/1The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.Fil: Mao, Yao-Yuan. Astrophysics And Cosmology Center; Estados UnidosFil: Kovacs, Eve. Argonne National Laboratory; Estados UnidosFil: Heitmann, Katrin. Argonne National Laboratory; Estados UnidosFil: Uram, Thomas D.. Argonne National Laboratory; Estados UnidosFil: Benson, Andrew J.. Carnegie Observatories; ChileFil: Campbell, Duncan. Mcwilliams Center For Cosmology; Estados UnidosFil: Cora, Sofia Alejandra. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; ArgentinaFil: Derose, Joseph. Kavli Institute For Particle Astrophysics And Cosmology; Estados UnidosFil: Matteo, Tiziana Di. Kavli Institute For Particle Astrophysics And Cosmology; Estados UnidosFil: Habib, Salman. Mcwilliams Center For Cosmology; Estados UnidosFil: Hearin, Andrew P.. Argonne National Laboratory; Estados UnidosFil: Kalmbach, J. Bryce. Argonne National Laboratory; Estados UnidosFil: Krughoff, K. Simon. Department Of Physics; Estados UnidosFil: Lanusse, François. Large Synoptic Survey Telescope; Estados UnidosFil: Lukic, Zarija. Mcwilliams Center For Cosmology; Estados UnidosFil: Mandelbaum, Rachel. Lawrence Berkeley National Laboratory; Estados UnidosFil: Newman, Jeffrey A.. Mcwilliams Center For Cosmology; Estados UnidosFil: Padilla, Nelson. Astrophysics And Cosmology Center; Estados UnidosFil: Paillas, Enrique. Instituto de Astrofísica; ChileFil: Pope, Adrian. Instituto de Astrofísica; ChileFil: Ricker, Paul M.. Argonne National Laboratory; Estados UnidosFil: Ruiz, Andrés N.. Department Of Astronomy; Estados UnidosFil: Tenneti, Ananth. University of Carnegie Mellon; Estados UnidosFil: Vega Martínez, Cristian Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; ArgentinaFil: Wechsler, Risa H.. Mcwilliams Center For Cosmology; Estados UnidosFil: Zhou, Rongpu. University of Pittsburgh; Estados UnidosFil: Zu, Ying. Kavli Institute For Particle Astrophysics And Cosmology; Estados UnidosIOP Publishing2018-02info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/82726Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; Uram, Thomas D.; Benson, Andrew J.; et al.; DESCQA: an automated validation framework for Synthetic Sky Catalogs; IOP Publishing; Astrophysical Journal Supplement Series; 234; 2; 2-2018; 36-520067-0049CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.3847/1538-4365/aaa6c3info:eu-repo/semantics/altIdentifier/url/https://iopscience.iop.org/article/10.3847/1538-4365/aaa6c3info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:13:22Zoai:ri.conicet.gov.ar:11336/82726instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:13:22.979CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse |
| dc.title.none.fl_str_mv |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| title |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| spellingShingle |
DESCQA: an automated validation framework for Synthetic Sky Catalogs Mao, Yao-Yuan LARGE-SCALE STRUCTURE OF UNIVERSE METHODS: NUMERICAL |
| title_short |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| title_full |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| title_fullStr |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| title_full_unstemmed |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| title_sort |
DESCQA: an automated validation framework for Synthetic Sky Catalogs |
| dc.creator.none.fl_str_mv |
Mao, Yao-Yuan Kovacs, Eve Heitmann, Katrin Uram, Thomas D. Benson, Andrew J. Campbell, Duncan Cora, Sofia Alejandra Derose, Joseph Matteo, Tiziana Di Habib, Salman Hearin, Andrew P. Kalmbach, J. Bryce Krughoff, K. Simon Lanusse, François Lukic, Zarija Mandelbaum, Rachel Newman, Jeffrey A. Padilla, Nelson Paillas, Enrique Pope, Adrian Ricker, Paul M. Ruiz, Andrés N. Tenneti, Ananth Vega Martínez, Cristian Antonio Wechsler, Risa H. Zhou, Rongpu Zu, Ying |
| author |
Mao, Yao-Yuan |
| author_facet |
Mao, Yao-Yuan Kovacs, Eve Heitmann, Katrin Uram, Thomas D. Benson, Andrew J. Campbell, Duncan Cora, Sofia Alejandra Derose, Joseph Matteo, Tiziana Di Habib, Salman Hearin, Andrew P. Kalmbach, J. Bryce Krughoff, K. Simon Lanusse, François Lukic, Zarija Mandelbaum, Rachel Newman, Jeffrey A. Padilla, Nelson Paillas, Enrique Pope, Adrian Ricker, Paul M. Ruiz, Andrés N. Tenneti, Ananth Vega Martínez, Cristian Antonio Wechsler, Risa H. Zhou, Rongpu Zu, Ying |
| author_role |
author |
| author2 |
Kovacs, Eve Heitmann, Katrin Uram, Thomas D. Benson, Andrew J. Campbell, Duncan Cora, Sofia Alejandra Derose, Joseph Matteo, Tiziana Di Habib, Salman Hearin, Andrew P. Kalmbach, J. Bryce Krughoff, K. Simon Lanusse, François Lukic, Zarija Mandelbaum, Rachel Newman, Jeffrey A. Padilla, Nelson Paillas, Enrique Pope, Adrian Ricker, Paul M. Ruiz, Andrés N. Tenneti, Ananth Vega Martínez, Cristian Antonio Wechsler, Risa H. Zhou, Rongpu Zu, Ying |
| author2_role |
author author author author author author author author author author author author author author author author author author author author author author author author author author |
| dc.subject.none.fl_str_mv |
LARGE-SCALE STRUCTURE OF UNIVERSE METHODS: NUMERICAL |
| topic |
LARGE-SCALE STRUCTURE OF UNIVERSE METHODS: NUMERICAL |
| purl_subject.fl_str_mv |
https://purl.org/becyt/ford/1.3 https://purl.org/becyt/ford/1 |
| dc.description.none.fl_txt_mv |
The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs. Fil: Mao, Yao-Yuan. Astrophysics And Cosmology Center; Estados Unidos Fil: Kovacs, Eve. Argonne National Laboratory; Estados Unidos Fil: Heitmann, Katrin. Argonne National Laboratory; Estados Unidos Fil: Uram, Thomas D.. Argonne National Laboratory; Estados Unidos Fil: Benson, Andrew J.. Carnegie Observatories; Chile Fil: Campbell, Duncan. Mcwilliams Center For Cosmology; Estados Unidos Fil: Cora, Sofia Alejandra. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; Argentina Fil: Derose, Joseph. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos Fil: Matteo, Tiziana Di. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos Fil: Habib, Salman. Mcwilliams Center For Cosmology; Estados Unidos Fil: Hearin, Andrew P.. Argonne National Laboratory; Estados Unidos Fil: Kalmbach, J. Bryce. Argonne National Laboratory; Estados Unidos Fil: Krughoff, K. Simon. Department Of Physics; Estados Unidos Fil: Lanusse, François. Large Synoptic Survey Telescope; Estados Unidos Fil: Lukic, Zarija. Mcwilliams Center For Cosmology; Estados Unidos Fil: Mandelbaum, Rachel. Lawrence Berkeley National Laboratory; Estados Unidos Fil: Newman, Jeffrey A.. Mcwilliams Center For Cosmology; Estados Unidos Fil: Padilla, Nelson. Astrophysics And Cosmology Center; Estados Unidos Fil: Paillas, Enrique. Instituto de Astrofísica; Chile Fil: Pope, Adrian. Instituto de Astrofísica; Chile Fil: Ricker, Paul M.. Argonne National Laboratory; Estados Unidos Fil: Ruiz, Andrés N.. Department Of Astronomy; Estados Unidos Fil: Tenneti, Ananth. University of Carnegie Mellon; Estados Unidos Fil: Vega Martínez, Cristian Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Astrofísica La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Astronómicas y Geofísicas. Instituto de Astrofísica La Plata; Argentina Fil: Wechsler, Risa H.. Mcwilliams Center For Cosmology; Estados Unidos Fil: Zhou, Rongpu. University of Pittsburgh; Estados Unidos Fil: Zu, Ying. Kavli Institute For Particle Astrophysics And Cosmology; Estados Unidos |
| description |
The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs. |
| publishDate |
2018 |
| dc.date.none.fl_str_mv |
2018-02 |
| dc.type.none.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion http://purl.org/coar/resource_type/c_6501 info:ar-repo/semantics/articulo |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/11336/82726 Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; Uram, Thomas D.; Benson, Andrew J.; et al.; DESCQA: an automated validation framework for Synthetic Sky Catalogs; IOP Publishing; Astrophysical Journal Supplement Series; 234; 2; 2-2018; 36-52 0067-0049 CONICET Digital CONICET |
| url |
http://hdl.handle.net/11336/82726 |
| identifier_str_mv |
Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; Uram, Thomas D.; Benson, Andrew J.; et al.; DESCQA: an automated validation framework for Synthetic Sky Catalogs; IOP Publishing; Astrophysical Journal Supplement Series; 234; 2; 2-2018; 36-52 0067-0049 CONICET Digital CONICET |
| dc.language.none.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
info:eu-repo/semantics/altIdentifier/doi/10.3847/1538-4365/aaa6c3 info:eu-repo/semantics/altIdentifier/url/https://iopscience.iop.org/article/10.3847/1538-4365/aaa6c3 |
| dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
| eu_rights_str_mv |
openAccess |
| rights_invalid_str_mv |
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
| dc.format.none.fl_str_mv |
application/pdf application/pdf application/pdf application/pdf |
| dc.publisher.none.fl_str_mv |
IOP Publishing |
| publisher.none.fl_str_mv |
IOP Publishing |
| dc.source.none.fl_str_mv |
reponame:CONICET Digital (CONICET) instname:Consejo Nacional de Investigaciones Científicas y Técnicas |
| reponame_str |
CONICET Digital (CONICET) |
| collection |
CONICET Digital (CONICET) |
| instname_str |
Consejo Nacional de Investigaciones Científicas y Técnicas |
| repository.name.fl_str_mv |
CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas |
| repository.mail.fl_str_mv |
dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar |
| _version_ |
1844614050080620544 |
| score |
13.070432 |