Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications

Autores
Gómez Sánchez, María del Pilar; Encinas, Diego Omar; Panadero, Javier; Bezerra, Aprigio; Mendez, Sandra; Naiouf, Ricardo Marcelo; de Giusti, Armando Eduardo; Rexachs, Dolores; Luque, Emilio
Año de publicación
2016
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
From recent years, the use of public cloud platforms as infrastructure have been gaining popularity in many scientific areas and High Performance Computing (HPC) is not an exception. These kind of platforms can be used for system administrators as Test-Bed systems, to evaluate and detect performanceinefficiencies in the I/O subsystem, and take decisions about the configuration parameters that have influence in the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as test system. Our experimental validation indicates that virtual clusters are an easy and quick solution for system administrators, to analyze the impact of the I/O system on the I/O kernel of the parallel application and take performance decisions in a controlled environment.
Fil: Gómez Sánchez, María del Pilar. Universitat Autònoma de Barcelona; España
Fil: Encinas, Diego Omar. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina
Fil: Panadero, Javier. Universitat Autònoma de Barcelona; España
Fil: Bezerra, Aprigio. Universidade Estadual de Santa Cruz; Brasil
Fil: Mendez, Sandra. Leibniz Supercomputing Centre; Alemania
Fil: Naiouf, Ricardo Marcelo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; Argentina
Fil: de Giusti, Armando Eduardo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; Argentina
Fil: Rexachs, Dolores. Universitat Autònoma de Barcelona; España
Fil: Luque, Emilio. Universitat Autònoma de Barcelona; España
Materia
CLOUD COMPUTING
PARALLEL FILE SYSTEM
PVFS2
MPI APPLICATIONS
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/101633
Acceder
id CONICETDig_1e0fae79554fbcac420529f1c72d5137
oai_identifier_str oai:ri.conicet.gov.ar:11336/101633
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applicationsGómez Sánchez, María del PilarEncinas, Diego OmarPanadero, JavierBezerra, AprigioMendez, SandraNaiouf, Ricardo Marcelode Giusti, Armando EduardoRexachs, DoloresLuque, EmilioCLOUD COMPUTINGPARALLEL FILE SYSTEMPVFS2MPI APPLICATIONShttps://purl.org/becyt/ford/1.2https://purl.org/becyt/ford/1From recent years, the use of public cloud platforms as infrastructure have been gaining popularity in many scientific areas and High Performance Computing (HPC) is not an exception. These kind of platforms can be used for system administrators as Test-Bed systems, to evaluate and detect performanceinefficiencies in the I/O subsystem, and take decisions about the configuration parameters that have influence in the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as test system. Our experimental validation indicates that virtual clusters are an easy and quick solution for system administrators, to analyze the impact of the I/O system on the I/O kernel of the parallel application and take performance decisions in a controlled environment.Fil: Gómez Sánchez, María del Pilar. Universitat Autònoma de Barcelona; EspañaFil: Encinas, Diego Omar. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; ArgentinaFil: Panadero, Javier. Universitat Autònoma de Barcelona; EspañaFil: Bezerra, Aprigio. Universidade Estadual de Santa Cruz; BrasilFil: Mendez, Sandra. Leibniz Supercomputing Centre; AlemaniaFil: Naiouf, Ricardo Marcelo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; ArgentinaFil: de Giusti, Armando Eduardo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; ArgentinaFil: Rexachs, Dolores. Universitat Autònoma de Barcelona; EspañaFil: Luque, Emilio. Universitat Autònoma de Barcelona; EspañaUniversidad Nacional de La Plata. Facultad de Informática2016-11info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/101633Gómez Sánchez, María del Pilar; Encinas, Diego Omar; Panadero, Javier; Bezerra, Aprigio; Mendez, Sandra; et al.; Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications; Universidad Nacional de La Plata. Facultad de Informática; Journal of Computer Science and Technology; 16; 2; 11-2016; 65-751666-6046CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://journal.info.unlp.edu.ar/JCST/article/view/499info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-10-15T15:08:49Zoai:ri.conicet.gov.ar:11336/101633instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-10-15 15:08:49.624CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
spellingShingle Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
Gómez Sánchez, María del Pilar
CLOUD COMPUTING
PARALLEL FILE SYSTEM
PVFS2
MPI APPLICATIONS
title_short Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_full Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_fullStr Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_full_unstemmed Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_sort Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
dc.creator.none.fl_str_mv Gómez Sánchez, María del Pilar
Encinas, Diego Omar
Panadero, Javier
Bezerra, Aprigio
Mendez, Sandra
Naiouf, Ricardo Marcelo
de Giusti, Armando Eduardo
Rexachs, Dolores
Luque, Emilio
author Gómez Sánchez, María del Pilar
author_facet Gómez Sánchez, María del Pilar
Encinas, Diego Omar
Panadero, Javier
Bezerra, Aprigio
Mendez, Sandra
Naiouf, Ricardo Marcelo
de Giusti, Armando Eduardo
Rexachs, Dolores
Luque, Emilio
author_role author
author2 Encinas, Diego Omar
Panadero, Javier
Bezerra, Aprigio
Mendez, Sandra
Naiouf, Ricardo Marcelo
de Giusti, Armando Eduardo
Rexachs, Dolores
Luque, Emilio
author2_role author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv CLOUD COMPUTING
PARALLEL FILE SYSTEM
PVFS2
MPI APPLICATIONS
topic CLOUD COMPUTING
PARALLEL FILE SYSTEM
PVFS2
MPI APPLICATIONS
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.2
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv From recent years, the use of public cloud platforms as infrastructure have been gaining popularity in many scientific areas and High Performance Computing (HPC) is not an exception. These kind of platforms can be used for system administrators as Test-Bed systems, to evaluate and detect performanceinefficiencies in the I/O subsystem, and take decisions about the configuration parameters that have influence in the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as test system. Our experimental validation indicates that virtual clusters are an easy and quick solution for system administrators, to analyze the impact of the I/O system on the I/O kernel of the parallel application and take performance decisions in a controlled environment.
Fil: Gómez Sánchez, María del Pilar. Universitat Autònoma de Barcelona; España
Fil: Encinas, Diego Omar. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina
Fil: Panadero, Javier. Universitat Autònoma de Barcelona; España
Fil: Bezerra, Aprigio. Universidade Estadual de Santa Cruz; Brasil
Fil: Mendez, Sandra. Leibniz Supercomputing Centre; Alemania
Fil: Naiouf, Ricardo Marcelo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; Argentina
Fil: de Giusti, Armando Eduardo. Universidad Nacional de la Plata. Facultad de Informatica. Instituto de Investigación En Informatica Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; Argentina
Fil: Rexachs, Dolores. Universitat Autònoma de Barcelona; España
Fil: Luque, Emilio. Universitat Autònoma de Barcelona; España
description From recent years, the use of public cloud platforms as infrastructure have been gaining popularity in many scientific areas and High Performance Computing (HPC) is not an exception. These kind of platforms can be used for system administrators as Test-Bed systems, to evaluate and detect performanceinefficiencies in the I/O subsystem, and take decisions about the configuration parameters that have influence in the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as test system. Our experimental validation indicates that virtual clusters are an easy and quick solution for system administrators, to analyze the impact of the I/O system on the I/O kernel of the parallel application and take performance decisions in a controlled environment.
publishDate 2016
dc.date.none.fl_str_mv 2016-11
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/101633
Gómez Sánchez, María del Pilar; Encinas, Diego Omar; Panadero, Javier; Bezerra, Aprigio; Mendez, Sandra; et al.; Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications; Universidad Nacional de La Plata. Facultad de Informática; Journal of Computer Science and Technology; 16; 2; 11-2016; 65-75
1666-6046
CONICET Digital
CONICET
url http://hdl.handle.net/11336/101633
identifier_str_mv Gómez Sánchez, María del Pilar; Encinas, Diego Omar; Panadero, Javier; Bezerra, Aprigio; Mendez, Sandra; et al.; Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications; Universidad Nacional de La Plata. Facultad de Informática; Journal of Computer Science and Technology; 16; 2; 11-2016; 65-75
1666-6046
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://journal.info.unlp.edu.ar/JCST/article/view/499
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Universidad Nacional de La Plata. Facultad de Informática
publisher.none.fl_str_mv Universidad Nacional de La Plata. Facultad de Informática
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1846083235321217024
score 12.891075

Publicaciones similares