Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool

Autores
Monge, David A.; García Garino, Carlos
Año de publicación
2010
Idioma
inglés
Tipo de recurso
documento de conferencia
Estado
versión publicada
Descripción
In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach.
Sociedad Argentina de Informática e Investigación Operativa
Materia
Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
Nivel de accesibilidad
acceso abierto
Condiciones de uso
http://creativecommons.org/licenses/by-nc-sa/4.0/
Repositorio
SEDICI (UNLP)
Institución
Universidad Nacional de La Plata
OAI Identificador
oai:sedici.unlp.edu.ar:10915/152727

id SEDICI_c5bb17136429cf4f93f7382143b01534
oai_identifier_str oai:sedici.unlp.edu.ar:10915/152727
network_acronym_str SEDICI
repository_id_str 1329
network_name_str SEDICI (UNLP)
spelling Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling ToolMonge, David A.García Garino, CarlosCiencias InformáticasWorkflowSchedulingDAGManPerformanceOptimizationIn several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach.Sociedad Argentina de Informática e Investigación Operativa2010info:eu-repo/semantics/conferenceObjectinfo:eu-repo/semantics/publishedVersionObjeto de conferenciahttp://purl.org/coar/resource_type/c_5794info:ar-repo/semantics/documentoDeConferenciaapplication/pdf3271-3285http://sedici.unlp.edu.ar/handle/10915/152727enginfo:eu-repo/semantics/altIdentifier/url/http://39jaiio.sadio.org.ar/sites/default/files/39jaiio-hpc-09.pdfinfo:eu-repo/semantics/altIdentifier/issn/1851-9326info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by-nc-sa/4.0/Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)reponame:SEDICI (UNLP)instname:Universidad Nacional de La Platainstacron:UNLP2025-09-17T10:22:03Zoai:sedici.unlp.edu.ar:10915/152727Institucionalhttp://sedici.unlp.edu.ar/Universidad públicaNo correspondehttp://sedici.unlp.edu.ar/oai/snrdalira@sedici.unlp.edu.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:13292025-09-17 10:22:03.867SEDICI (UNLP) - Universidad Nacional de La Platafalse
dc.title.none.fl_str_mv Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
spellingShingle Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
Monge, David A.
Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
title_short Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_full Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_fullStr Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_full_unstemmed Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_sort Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
dc.creator.none.fl_str_mv Monge, David A.
García Garino, Carlos
author Monge, David A.
author_facet Monge, David A.
García Garino, Carlos
author_role author
author2 García Garino, Carlos
author2_role author
dc.subject.none.fl_str_mv Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
topic Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
dc.description.none.fl_txt_mv In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach.
Sociedad Argentina de Informática e Investigación Operativa
description In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach.
publishDate 2010
dc.date.none.fl_str_mv 2010
dc.type.none.fl_str_mv info:eu-repo/semantics/conferenceObject
info:eu-repo/semantics/publishedVersion
Objeto de conferencia
http://purl.org/coar/resource_type/c_5794
info:ar-repo/semantics/documentoDeConferencia
format conferenceObject
status_str publishedVersion
dc.identifier.none.fl_str_mv http://sedici.unlp.edu.ar/handle/10915/152727
url http://sedici.unlp.edu.ar/handle/10915/152727
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/http://39jaiio.sadio.org.ar/sites/default/files/39jaiio-hpc-09.pdf
info:eu-repo/semantics/altIdentifier/issn/1851-9326
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by-nc-sa/4.0/
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by-nc-sa/4.0/
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)
dc.format.none.fl_str_mv application/pdf
3271-3285
dc.source.none.fl_str_mv reponame:SEDICI (UNLP)
instname:Universidad Nacional de La Plata
instacron:UNLP
reponame_str SEDICI (UNLP)
collection SEDICI (UNLP)
instname_str Universidad Nacional de La Plata
instacron_str UNLP
institution UNLP
repository.name.fl_str_mv SEDICI (UNLP) - Universidad Nacional de La Plata
repository.mail.fl_str_mv alira@sedici.unlp.edu.ar
_version_ 1843532930834497536
score 13.001348