Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems

Autores
Bert, Federico Esteban; Rovere, Santiago L.; Macal, Charles M.; North, Michael J.; Podestá, Guillermo P.
Año de publicación
2014
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM’s. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model’s ability to reproduce observed results.
Fil: Bert, Federico Esteban. Universidad de Buenos Aires. Facultad de Agronomia; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Rovere, Santiago L.. Universidad de Buenos Aires. Facultad de Ingeniería; Argentina
Fil: Macal, Charles M.. Argonne National Laboratory; Estados Unidos
Fil: North, Michael J.. Argonne National Laboratory; Estados Unidos
Fil: Podestá, Guillermo P.. University of Miami; Estados Unidos
Materia
Agent-Based Model
Validation
Agriculture
Land Use
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/16231

id CONICETDig_689f80524e5cc0b4cfb0b00e2782ee07
oai_identifier_str oai:ri.conicet.gov.ar:11336/16231
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systemsBert, Federico EstebanRovere, Santiago L.Macal, Charles M.North, Michael J.Podestá, Guillermo P.Agent-Based ModelValidationAgricultureLand Usehttps://purl.org/becyt/ford/1.2https://purl.org/becyt/ford/1There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM’s. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model’s ability to reproduce observed results.Fil: Bert, Federico Esteban. Universidad de Buenos Aires. Facultad de Agronomia; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Rovere, Santiago L.. Universidad de Buenos Aires. Facultad de Ingeniería; ArgentinaFil: Macal, Charles M.. Argonne National Laboratory; Estados UnidosFil: North, Michael J.. Argonne National Laboratory; Estados UnidosFil: Podestá, Guillermo P.. University of Miami; Estados UnidosElsevier Science2014-02info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/16231Bert, Federico Esteban; Rovere, Santiago L.; Macal, Charles M.; North, Michael J.; Podestá, Guillermo P.; Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems; Elsevier Science; Ecological Modelling; 273; 2-2014; 284-2980304-3800enginfo:eu-repo/semantics/altIdentifier/doi/10.1016/j.ecolmodel.2013.11.024info:eu-repo/semantics/altIdentifier/url/http://www.sciencedirect.com/science/article/pii/S0304380013005723info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-nd/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-17T11:53:38Zoai:ri.conicet.gov.ar:11336/16231instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-17 11:53:39.04CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
title Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
spellingShingle Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
Bert, Federico Esteban
Agent-Based Model
Validation
Agriculture
Land Use
title_short Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
title_full Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
title_fullStr Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
title_full_unstemmed Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
title_sort Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems
dc.creator.none.fl_str_mv Bert, Federico Esteban
Rovere, Santiago L.
Macal, Charles M.
North, Michael J.
Podestá, Guillermo P.
author Bert, Federico Esteban
author_facet Bert, Federico Esteban
Rovere, Santiago L.
Macal, Charles M.
North, Michael J.
Podestá, Guillermo P.
author_role author
author2 Rovere, Santiago L.
Macal, Charles M.
North, Michael J.
Podestá, Guillermo P.
author2_role author
author
author
author
dc.subject.none.fl_str_mv Agent-Based Model
Validation
Agriculture
Land Use
topic Agent-Based Model
Validation
Agriculture
Land Use
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.2
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM’s. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model’s ability to reproduce observed results.
Fil: Bert, Federico Esteban. Universidad de Buenos Aires. Facultad de Agronomia; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Rovere, Santiago L.. Universidad de Buenos Aires. Facultad de Ingeniería; Argentina
Fil: Macal, Charles M.. Argonne National Laboratory; Estados Unidos
Fil: North, Michael J.. Argonne National Laboratory; Estados Unidos
Fil: Podestá, Guillermo P.. University of Miami; Estados Unidos
description There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM’s. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model’s ability to reproduce observed results.
publishDate 2014
dc.date.none.fl_str_mv 2014-02
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/16231
Bert, Federico Esteban; Rovere, Santiago L.; Macal, Charles M.; North, Michael J.; Podestá, Guillermo P.; Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems; Elsevier Science; Ecological Modelling; 273; 2-2014; 284-298
0304-3800
url http://hdl.handle.net/11336/16231
identifier_str_mv Bert, Federico Esteban; Rovere, Santiago L.; Macal, Charles M.; North, Michael J.; Podestá, Guillermo P.; Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems; Elsevier Science; Ecological Modelling; 273; 2-2014; 284-298
0304-3800
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/doi/10.1016/j.ecolmodel.2013.11.024
info:eu-repo/semantics/altIdentifier/url/http://www.sciencedirect.com/science/article/pii/S0304380013005723
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier Science
publisher.none.fl_str_mv Elsevier Science
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1843606880764559360
score 13.001348