Unpacking the black box of improvement

Autores
Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; Sax, Sylvia; Houleymata, Diarra; Kimble, Leighann; Parry, Gareth
Año de publicación
2018
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.
Fil: Ramaswamy, Rohit. University of North Carolina; Estados Unidos
Fil: Reed, Julie. Nihr Clarch Northwest London; Estados Unidos
Fil: Livesley, Nigel. Institute for Healthcare Improvement; Estados Unidos
Fil: Boguslavsky, Victor. University Research Co; Estados Unidos
Fil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; Argentina
Fil: Sax, Sylvia. University of Heidelberg; Alemania
Fil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; Malí
Fil: Kimble, Leighann. University Research Co; Estados Unidos
Fil: Parry, Gareth. Institute of Healthcare Improvement; Estados Unidos
Materia
CYNEFIN FRAMEWORK
EVALUATION COMPLEX SYSTEMS
IMPROVEMENT
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/99498

id CONICETDig_812116deeed36d85ab573cd85d6e5c77
oai_identifier_str oai:ri.conicet.gov.ar:11336/99498
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Unpacking the black box of improvementRamaswamy, RohitReed, JulieLivesley, NigelBoguslavsky, VictorGarcia Elorrio, EzequielSax, SylviaHouleymata, DiarraKimble, LeighannParry, GarethCYNEFIN FRAMEWORKEVALUATION COMPLEX SYSTEMSIMPROVEMENThttps://purl.org/becyt/ford/3.3https://purl.org/becyt/ford/3During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.Fil: Ramaswamy, Rohit. University of North Carolina; Estados UnidosFil: Reed, Julie. Nihr Clarch Northwest London; Estados UnidosFil: Livesley, Nigel. Institute for Healthcare Improvement; Estados UnidosFil: Boguslavsky, Victor. University Research Co; Estados UnidosFil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; ArgentinaFil: Sax, Sylvia. University of Heidelberg; AlemaniaFil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; MalíFil: Kimble, Leighann. University Research Co; Estados UnidosFil: Parry, Gareth. Institute of Healthcare Improvement; Estados UnidosOxford University Press2018-04info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/99498Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-191353-4505CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://academic.oup.com/intqhc/article/30/suppl_1/15/4860379info:eu-repo/semantics/altIdentifier/doi/10.1093/intqhc/mzy009info:eu-repo/semantics/altIdentifier/url/https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5909642info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:26:06Zoai:ri.conicet.gov.ar:11336/99498instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:26:06.435CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Unpacking the black box of improvement
title Unpacking the black box of improvement
spellingShingle Unpacking the black box of improvement
Ramaswamy, Rohit
CYNEFIN FRAMEWORK
EVALUATION COMPLEX SYSTEMS
IMPROVEMENT
title_short Unpacking the black box of improvement
title_full Unpacking the black box of improvement
title_fullStr Unpacking the black box of improvement
title_full_unstemmed Unpacking the black box of improvement
title_sort Unpacking the black box of improvement
dc.creator.none.fl_str_mv Ramaswamy, Rohit
Reed, Julie
Livesley, Nigel
Boguslavsky, Victor
Garcia Elorrio, Ezequiel
Sax, Sylvia
Houleymata, Diarra
Kimble, Leighann
Parry, Gareth
author Ramaswamy, Rohit
author_facet Ramaswamy, Rohit
Reed, Julie
Livesley, Nigel
Boguslavsky, Victor
Garcia Elorrio, Ezequiel
Sax, Sylvia
Houleymata, Diarra
Kimble, Leighann
Parry, Gareth
author_role author
author2 Reed, Julie
Livesley, Nigel
Boguslavsky, Victor
Garcia Elorrio, Ezequiel
Sax, Sylvia
Houleymata, Diarra
Kimble, Leighann
Parry, Gareth
author2_role author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv CYNEFIN FRAMEWORK
EVALUATION COMPLEX SYSTEMS
IMPROVEMENT
topic CYNEFIN FRAMEWORK
EVALUATION COMPLEX SYSTEMS
IMPROVEMENT
purl_subject.fl_str_mv https://purl.org/becyt/ford/3.3
https://purl.org/becyt/ford/3
dc.description.none.fl_txt_mv During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.
Fil: Ramaswamy, Rohit. University of North Carolina; Estados Unidos
Fil: Reed, Julie. Nihr Clarch Northwest London; Estados Unidos
Fil: Livesley, Nigel. Institute for Healthcare Improvement; Estados Unidos
Fil: Boguslavsky, Victor. University Research Co; Estados Unidos
Fil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; Argentina
Fil: Sax, Sylvia. University of Heidelberg; Alemania
Fil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; Malí
Fil: Kimble, Leighann. University Research Co; Estados Unidos
Fil: Parry, Gareth. Institute of Healthcare Improvement; Estados Unidos
description During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.
publishDate 2018
dc.date.none.fl_str_mv 2018-04
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/99498
Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-19
1353-4505
CONICET Digital
CONICET
url http://hdl.handle.net/11336/99498
identifier_str_mv Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-19
1353-4505
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://academic.oup.com/intqhc/article/30/suppl_1/15/4860379
info:eu-repo/semantics/altIdentifier/doi/10.1093/intqhc/mzy009
info:eu-repo/semantics/altIdentifier/url/https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5909642
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Oxford University Press
publisher.none.fl_str_mv Oxford University Press
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844614261319401472
score 13.070432