DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

Autores
Cora, Sofía Alejandra; Vega Martínez, Cristian Antonio; The LSST Dark Energy Science Collaboration
Año de publicación
2018
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.
La lista completa de autores se encuentra en el documento.
Instituto de Astrofísica de La Plata
Facultad de Ciencias Astronómicas y Geofísicas
Materia
Ciencias Astronómicas
Large-scale structure of universe
Numerical analysis
Nivel de accesibilidad
acceso abierto
Condiciones de uso
http://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
SEDICI (UNLP)
Institución
Universidad Nacional de La Plata
OAI Identificador
oai:sedici.unlp.edu.ar:10915/93586

id SEDICI_e13af23e2c7efe6560a18318c8ccc69c
oai_identifier_str oai:sedici.unlp.edu.ar:10915/93586
network_acronym_str SEDICI
repository_id_str 1329
network_name_str SEDICI (UNLP)
spelling DESCQA: An Automated Validation Framework for Synthetic Sky CatalogsCora, Sofía AlejandraVega Martínez, Cristian AntonioThe LSST Dark Energy Science CollaborationCiencias AstronómicasLarge-scale structure of universeNumerical analysisThe use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.La lista completa de autores se encuentra en el documento.Instituto de Astrofísica de La PlataFacultad de Ciencias Astronómicas y Geofísicas2018-02info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionArticulohttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdf1-17http://sedici.unlp.edu.ar/handle/10915/93586enginfo:eu-repo/semantics/altIdentifier/url/https://ri.conicet.gov.ar/handle/11336/82726info:eu-repo/semantics/altIdentifier/url/https://iopscience.iop.org/article/10.3847/1538-4365/aaa6c3info:eu-repo/semantics/altIdentifier/issn/0067-0049info:eu-repo/semantics/altIdentifier/doi/10.3847/1538-4365/aaa6c3info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by-nc-sa/2.5/ar/Creative Commons Attribution-NonCommercial-ShareAlike 2.5 Argentina (CC BY-NC-SA 2.5)reponame:SEDICI (UNLP)instname:Universidad Nacional de La Platainstacron:UNLP2025-09-29T11:19:27Zoai:sedici.unlp.edu.ar:10915/93586Institucionalhttp://sedici.unlp.edu.ar/Universidad públicaNo correspondehttp://sedici.unlp.edu.ar/oai/snrdalira@sedici.unlp.edu.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:13292025-09-29 11:19:27.996SEDICI (UNLP) - Universidad Nacional de La Platafalse
dc.title.none.fl_str_mv DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
title DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
spellingShingle DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
Cora, Sofía Alejandra
Ciencias Astronómicas
Large-scale structure of universe
Numerical analysis
title_short DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
title_full DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
title_fullStr DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
title_full_unstemmed DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
title_sort DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
dc.creator.none.fl_str_mv Cora, Sofía Alejandra
Vega Martínez, Cristian Antonio
The LSST Dark Energy Science Collaboration
author Cora, Sofía Alejandra
author_facet Cora, Sofía Alejandra
Vega Martínez, Cristian Antonio
The LSST Dark Energy Science Collaboration
author_role author
author2 Vega Martínez, Cristian Antonio
The LSST Dark Energy Science Collaboration
author2_role author
author
dc.subject.none.fl_str_mv Ciencias Astronómicas
Large-scale structure of universe
Numerical analysis
topic Ciencias Astronómicas
Large-scale structure of universe
Numerical analysis
dc.description.none.fl_txt_mv The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.
La lista completa de autores se encuentra en el documento.
Instituto de Astrofísica de La Plata
Facultad de Ciencias Astronómicas y Geofísicas
description The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.
publishDate 2018
dc.date.none.fl_str_mv 2018-02
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
Articulo
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://sedici.unlp.edu.ar/handle/10915/93586
url http://sedici.unlp.edu.ar/handle/10915/93586
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://ri.conicet.gov.ar/handle/11336/82726
info:eu-repo/semantics/altIdentifier/url/https://iopscience.iop.org/article/10.3847/1538-4365/aaa6c3
info:eu-repo/semantics/altIdentifier/issn/0067-0049
info:eu-repo/semantics/altIdentifier/doi/10.3847/1538-4365/aaa6c3
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Creative Commons Attribution-NonCommercial-ShareAlike 2.5 Argentina (CC BY-NC-SA 2.5)
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Creative Commons Attribution-NonCommercial-ShareAlike 2.5 Argentina (CC BY-NC-SA 2.5)
dc.format.none.fl_str_mv application/pdf
1-17
dc.source.none.fl_str_mv reponame:SEDICI (UNLP)
instname:Universidad Nacional de La Plata
instacron:UNLP
reponame_str SEDICI (UNLP)
collection SEDICI (UNLP)
instname_str Universidad Nacional de La Plata
instacron_str UNLP
institution UNLP
repository.name.fl_str_mv SEDICI (UNLP) - Universidad Nacional de La Plata
repository.mail.fl_str_mv alira@sedici.unlp.edu.ar
_version_ 1844616068593614848
score 13.070432