Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS

Autores
Barisits, Martin; Beermann, Thomas; Bogado García, Joaquín Ignacio; Garonne, Vincent; Javurek, Tomas; Lassnig, Mario; Manzi, Andrea; Martelli, Edoardo; Serfon, Cedric; Wegner, Tobias; Zhao, Xin; The ATLAS Collaboration
Año de publicación
2019
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.
Facultad de Informática
Materia
Ciencias Informáticas
Física
Rucio
Dstributed data management
Nivel de accesibilidad
acceso abierto
Condiciones de uso
http://creativecommons.org/licenses/by/4.0/
Repositorio
SEDICI (UNLP)
Institución
Universidad Nacional de La Plata
OAI Identificador
oai:sedici.unlp.edu.ar:10915/123675
Acceder
id SEDICI_9d58b93b510801d4e2a83dee45df6c58
oai_identifier_str oai:sedici.unlp.edu.ar:10915/123675
network_acronym_str SEDICI
repository_id_str 1329
network_name_str SEDICI (UNLP)
spelling Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLASBarisits, MartinBeermann, ThomasBogado García, Joaquín IgnacioGaronne, VincentJavurek, TomasLassnig, MarioManzi, AndreaMartelli, EdoardoSerfon, CedricWegner, TobiasZhao, XinThe ATLAS CollaborationCiencias InformáticasFísicaRucioDstributed data managementRucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.Facultad de Informática2019-09-17info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionArticulohttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfhttp://sedici.unlp.edu.ar/handle/10915/123675enginfo:eu-repo/semantics/altIdentifier/issn/2100-014Xinfo:eu-repo/semantics/altIdentifier/doi/10.1051/epjconf/201921404054info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by/4.0/Creative Commons Attribution 4.0 International (CC BY 4.0)reponame:SEDICI (UNLP)instname:Universidad Nacional de La Platainstacron:UNLP2025-09-29T11:29:29Zoai:sedici.unlp.edu.ar:10915/123675Institucionalhttp://sedici.unlp.edu.ar/Universidad públicaNo correspondehttp://sedici.unlp.edu.ar/oai/snrdalira@sedici.unlp.edu.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:13292025-09-29 11:29:29.837SEDICI (UNLP) - Universidad Nacional de La Platafalse
dc.title.none.fl_str_mv Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
spellingShingle Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
Barisits, Martin
Ciencias Informáticas
Física
Rucio
Dstributed data management
title_short Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_fullStr Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full_unstemmed Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_sort Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
dc.creator.none.fl_str_mv Barisits, Martin
Beermann, Thomas
Bogado García, Joaquín Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias
Zhao, Xin
The ATLAS Collaboration
author Barisits, Martin
author_facet Barisits, Martin
Beermann, Thomas
Bogado García, Joaquín Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias
Zhao, Xin
The ATLAS Collaboration
author_role author
author2 Beermann, Thomas
Bogado García, Joaquín Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias
Zhao, Xin
The ATLAS Collaboration
author2_role author
author
author
author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv Ciencias Informáticas
Física
Rucio
Dstributed data management
topic Ciencias Informáticas
Física
Rucio
Dstributed data management
dc.description.none.fl_txt_mv Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.
Facultad de Informática
description Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.
publishDate 2019
dc.date.none.fl_str_mv 2019-09-17
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
Articulo
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://sedici.unlp.edu.ar/handle/10915/123675
url http://sedici.unlp.edu.ar/handle/10915/123675
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/issn/2100-014X
info:eu-repo/semantics/altIdentifier/doi/10.1051/epjconf/201921404054
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by/4.0/
Creative Commons Attribution 4.0 International (CC BY 4.0)
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0/
Creative Commons Attribution 4.0 International (CC BY 4.0)
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:SEDICI (UNLP)
instname:Universidad Nacional de La Plata
instacron:UNLP
reponame_str SEDICI (UNLP)
collection SEDICI (UNLP)
instname_str Universidad Nacional de La Plata
instacron_str UNLP
institution UNLP
repository.name.fl_str_mv SEDICI (UNLP) - Universidad Nacional de La Plata
repository.mail.fl_str_mv alira@sedici.unlp.edu.ar
_version_ 1844616174194655232
score 13.070432

Publicaciones similares