Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications

Autores
Gómez Sánchez, Pilar; Encinas, Diego; Panadero, Javier; Bezerra, Aprigio; Méndez, Sandra; Naiouf, Marcelo; De Giusti, Armando Eduardo; Rexachs del Rosario, Dolores; Luque, e
Año de publicación
2016
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
In recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance inefficiencies in the I/O subsystem, and for taking decisions about the configuration parameters that have influence on the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as a test system. Our experimental validation indicates that virtual clusters are a quick and easy solution for system administrators, for analyzing the impact of the I/O system on the I/O kernels of the parallel applications and for taking performance decisions in a controlled environment.
Facultad de Informática
Materia
Ciencias Informáticas
cloud computing
parallel file system
PVFS2
MPI applications
Nivel de accesibilidad
acceso abierto
Condiciones de uso
http://creativecommons.org/licenses/by/3.0/
Repositorio
SEDICI (UNLP)
Institución
Universidad Nacional de La Plata
OAI Identificador
oai:sedici.unlp.edu.ar:10915/57264

id SEDICI_ad1762168e7decc693cf5c5427309e9b
oai_identifier_str oai:sedici.unlp.edu.ar:10915/57264
network_acronym_str SEDICI
repository_id_str 1329
network_name_str SEDICI (UNLP)
spelling Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applicationsGómez Sánchez, PilarEncinas, DiegoPanadero, JavierBezerra, AprigioMéndez, SandraNaiouf, MarceloDe Giusti, Armando EduardoRexachs del Rosario, DoloresLuque, eCiencias Informáticascloud computingparallel file systemPVFS2MPI applicationsIn recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance inefficiencies in the I/O subsystem, and for taking decisions about the configuration parameters that have influence on the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as a test system. Our experimental validation indicates that virtual clusters are a quick and easy solution for system administrators, for analyzing the impact of the I/O system on the I/O kernels of the parallel applications and for taking performance decisions in a controlled environment.Facultad de Informática2016-11info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionArticulohttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdf65-75http://sedici.unlp.edu.ar/handle/10915/57264enginfo:eu-repo/semantics/altIdentifier/url/http://journal.info.unlp.edu.ar/wp-content/uploads/2016/12/JCST-43-Paper-1.pdfinfo:eu-repo/semantics/altIdentifier/issn/1666-6038info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by/3.0/Creative Commons Attribution 3.0 Unported (CC BY 3.0)reponame:SEDICI (UNLP)instname:Universidad Nacional de La Platainstacron:UNLP2025-10-15T10:58:47Zoai:sedici.unlp.edu.ar:10915/57264Institucionalhttp://sedici.unlp.edu.ar/Universidad públicaNo correspondehttp://sedici.unlp.edu.ar/oai/snrdalira@sedici.unlp.edu.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:13292025-10-15 10:58:48.169SEDICI (UNLP) - Universidad Nacional de La Platafalse
dc.title.none.fl_str_mv Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
spellingShingle Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
Gómez Sánchez, Pilar
Ciencias Informáticas
cloud computing
parallel file system
PVFS2
MPI applications
title_short Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_full Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_fullStr Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_full_unstemmed Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
title_sort Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications
dc.creator.none.fl_str_mv Gómez Sánchez, Pilar
Encinas, Diego
Panadero, Javier
Bezerra, Aprigio
Méndez, Sandra
Naiouf, Marcelo
De Giusti, Armando Eduardo
Rexachs del Rosario, Dolores
Luque, e
author Gómez Sánchez, Pilar
author_facet Gómez Sánchez, Pilar
Encinas, Diego
Panadero, Javier
Bezerra, Aprigio
Méndez, Sandra
Naiouf, Marcelo
De Giusti, Armando Eduardo
Rexachs del Rosario, Dolores
Luque, e
author_role author
author2 Encinas, Diego
Panadero, Javier
Bezerra, Aprigio
Méndez, Sandra
Naiouf, Marcelo
De Giusti, Armando Eduardo
Rexachs del Rosario, Dolores
Luque, e
author2_role author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv Ciencias Informáticas
cloud computing
parallel file system
PVFS2
MPI applications
topic Ciencias Informáticas
cloud computing
parallel file system
PVFS2
MPI applications
dc.description.none.fl_txt_mv In recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance inefficiencies in the I/O subsystem, and for taking decisions about the configuration parameters that have influence on the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as a test system. Our experimental validation indicates that virtual clusters are a quick and easy solution for system administrators, for analyzing the impact of the I/O system on the I/O kernels of the parallel applications and for taking performance decisions in a controlled environment.
Facultad de Informática
description In recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance inefficiencies in the I/O subsystem, and for taking decisions about the configuration parameters that have influence on the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as a test system. Our experimental validation indicates that virtual clusters are a quick and easy solution for system administrators, for analyzing the impact of the I/O system on the I/O kernels of the parallel applications and for taking performance decisions in a controlled environment.
publishDate 2016
dc.date.none.fl_str_mv 2016-11
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
Articulo
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://sedici.unlp.edu.ar/handle/10915/57264
url http://sedici.unlp.edu.ar/handle/10915/57264
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/http://journal.info.unlp.edu.ar/wp-content/uploads/2016/12/JCST-43-Paper-1.pdf
info:eu-repo/semantics/altIdentifier/issn/1666-6038
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by/3.0/
Creative Commons Attribution 3.0 Unported (CC BY 3.0)
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/3.0/
Creative Commons Attribution 3.0 Unported (CC BY 3.0)
dc.format.none.fl_str_mv application/pdf
65-75
dc.source.none.fl_str_mv reponame:SEDICI (UNLP)
instname:Universidad Nacional de La Plata
instacron:UNLP
reponame_str SEDICI (UNLP)
collection SEDICI (UNLP)
instname_str Universidad Nacional de La Plata
instacron_str UNLP
institution UNLP
repository.name.fl_str_mv SEDICI (UNLP) - Universidad Nacional de La Plata
repository.mail.fl_str_mv alira@sedici.unlp.edu.ar
_version_ 1846064035879976960
score 12.891075