Unpacking the black box of improvement
- Autores
- Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; Sax, Sylvia; Houleymata, Diarra; Kimble, Leighann; Parry, Gareth
- Año de publicación
- 2018
- Idioma
- inglés
- Tipo de recurso
- artículo
- Estado
- versión publicada
- Descripción
- During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.
Fil: Ramaswamy, Rohit. University of North Carolina; Estados Unidos
Fil: Reed, Julie. Nihr Clarch Northwest London; Estados Unidos
Fil: Livesley, Nigel. Institute for Healthcare Improvement; Estados Unidos
Fil: Boguslavsky, Victor. University Research Co; Estados Unidos
Fil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; Argentina
Fil: Sax, Sylvia. University of Heidelberg; Alemania
Fil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; Malí
Fil: Kimble, Leighann. University Research Co; Estados Unidos
Fil: Parry, Gareth. Institute of Healthcare Improvement; Estados Unidos - Materia
-
CYNEFIN FRAMEWORK
EVALUATION COMPLEX SYSTEMS
IMPROVEMENT - Nivel de accesibilidad
- acceso abierto
- Condiciones de uso
- https://creativecommons.org/licenses/by-nc/2.5/ar/
- Repositorio
- Institución
- Consejo Nacional de Investigaciones Científicas y Técnicas
- OAI Identificador
- oai:ri.conicet.gov.ar:11336/99498
Ver los metadatos del registro completo
id |
CONICETDig_812116deeed36d85ab573cd85d6e5c77 |
---|---|
oai_identifier_str |
oai:ri.conicet.gov.ar:11336/99498 |
network_acronym_str |
CONICETDig |
repository_id_str |
3498 |
network_name_str |
CONICET Digital (CONICET) |
spelling |
Unpacking the black box of improvementRamaswamy, RohitReed, JulieLivesley, NigelBoguslavsky, VictorGarcia Elorrio, EzequielSax, SylviaHouleymata, DiarraKimble, LeighannParry, GarethCYNEFIN FRAMEWORKEVALUATION COMPLEX SYSTEMSIMPROVEMENThttps://purl.org/becyt/ford/3.3https://purl.org/becyt/ford/3During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions.Fil: Ramaswamy, Rohit. University of North Carolina; Estados UnidosFil: Reed, Julie. Nihr Clarch Northwest London; Estados UnidosFil: Livesley, Nigel. Institute for Healthcare Improvement; Estados UnidosFil: Boguslavsky, Victor. University Research Co; Estados UnidosFil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; ArgentinaFil: Sax, Sylvia. University of Heidelberg; AlemaniaFil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; MalíFil: Kimble, Leighann. University Research Co; Estados UnidosFil: Parry, Gareth. Institute of Healthcare Improvement; Estados UnidosOxford University Press2018-04info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/99498Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-191353-4505CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://academic.oup.com/intqhc/article/30/suppl_1/15/4860379info:eu-repo/semantics/altIdentifier/doi/10.1093/intqhc/mzy009info:eu-repo/semantics/altIdentifier/url/https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5909642info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:26:06Zoai:ri.conicet.gov.ar:11336/99498instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:26:06.435CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse |
dc.title.none.fl_str_mv |
Unpacking the black box of improvement |
title |
Unpacking the black box of improvement |
spellingShingle |
Unpacking the black box of improvement Ramaswamy, Rohit CYNEFIN FRAMEWORK EVALUATION COMPLEX SYSTEMS IMPROVEMENT |
title_short |
Unpacking the black box of improvement |
title_full |
Unpacking the black box of improvement |
title_fullStr |
Unpacking the black box of improvement |
title_full_unstemmed |
Unpacking the black box of improvement |
title_sort |
Unpacking the black box of improvement |
dc.creator.none.fl_str_mv |
Ramaswamy, Rohit Reed, Julie Livesley, Nigel Boguslavsky, Victor Garcia Elorrio, Ezequiel Sax, Sylvia Houleymata, Diarra Kimble, Leighann Parry, Gareth |
author |
Ramaswamy, Rohit |
author_facet |
Ramaswamy, Rohit Reed, Julie Livesley, Nigel Boguslavsky, Victor Garcia Elorrio, Ezequiel Sax, Sylvia Houleymata, Diarra Kimble, Leighann Parry, Gareth |
author_role |
author |
author2 |
Reed, Julie Livesley, Nigel Boguslavsky, Victor Garcia Elorrio, Ezequiel Sax, Sylvia Houleymata, Diarra Kimble, Leighann Parry, Gareth |
author2_role |
author author author author author author author author |
dc.subject.none.fl_str_mv |
CYNEFIN FRAMEWORK EVALUATION COMPLEX SYSTEMS IMPROVEMENT |
topic |
CYNEFIN FRAMEWORK EVALUATION COMPLEX SYSTEMS IMPROVEMENT |
purl_subject.fl_str_mv |
https://purl.org/becyt/ford/3.3 https://purl.org/becyt/ford/3 |
dc.description.none.fl_txt_mv |
During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions. Fil: Ramaswamy, Rohit. University of North Carolina; Estados Unidos Fil: Reed, Julie. Nihr Clarch Northwest London; Estados Unidos Fil: Livesley, Nigel. Institute for Healthcare Improvement; Estados Unidos Fil: Boguslavsky, Victor. University Research Co; Estados Unidos Fil: Garcia Elorrio, Ezequiel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto de Efectividad Clínica y Sanitaria; Argentina Fil: Sax, Sylvia. University of Heidelberg; Alemania Fil: Houleymata, Diarra. Applying Science to Strengthen and Improve Systems Project,; Malí Fil: Kimble, Leighann. University Research Co; Estados Unidos Fil: Parry, Gareth. Institute of Healthcare Improvement; Estados Unidos |
description |
During the Salzburg Global Seminar Session 565-Better Health Care: How do we learn about improvement, participants discussed the need to unpack the black box of improvement. The black box refers to the fact that when quality improvement interventions are described or evaluated, there is a tendency to assume a simple, linear path between the intervention and the outcomes it yields. It is also assumed that it is enough to evaluate the results without understanding the process of by which the improvement took place. However, quality improvement interventions are complex, nonlinear and evolve in response to local settings. To accurately assess the effectiveness of quality improvement and disseminate the learning, there must be a greater understanding of the complexity of quality improvement work. To remain consistent with the language used in Salzburg, we refer to this as unpacking the black box of improvement. To illustrate the complexity of improvement, this article introduces four quality improvement case studies. In unpacking the black box, we present and demonstrate how Cynefin framework from complexity theory can be used to categorize and evaluate quality improvement interventions. Many quality improvement projects are implemented in complex contexts, necessitating an approach defined as probesense- respond. In this approach, teams experiment, learn and adapt their changes to their local setting. Quality improvement professionals intuitively use the probe-sense-respond approach in their work but document and evaluate their projects using language for simple or complicated' contexts, rather than the complex contexts in which they work. As a result, evaluations tend to ask 'How can we attribute outcomes to the intervention, rather than 'What were the adaptations that took place. By unpacking the black box of improvement, improvers can more accurately document and describe their interventions, allowing evaluators to ask the right questions and more adequately evaluate quality improvement interventions. |
publishDate |
2018 |
dc.date.none.fl_str_mv |
2018-04 |
dc.type.none.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion http://purl.org/coar/resource_type/c_6501 info:ar-repo/semantics/articulo |
format |
article |
status_str |
publishedVersion |
dc.identifier.none.fl_str_mv |
http://hdl.handle.net/11336/99498 Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-19 1353-4505 CONICET Digital CONICET |
url |
http://hdl.handle.net/11336/99498 |
identifier_str_mv |
Ramaswamy, Rohit; Reed, Julie; Livesley, Nigel; Boguslavsky, Victor; Garcia Elorrio, Ezequiel; et al.; Unpacking the black box of improvement; Oxford University Press; International Journal For Quality In Health Care; 30; 4-2018; 15-19 1353-4505 CONICET Digital CONICET |
dc.language.none.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
info:eu-repo/semantics/altIdentifier/url/https://academic.oup.com/intqhc/article/30/suppl_1/15/4860379 info:eu-repo/semantics/altIdentifier/doi/10.1093/intqhc/mzy009 info:eu-repo/semantics/altIdentifier/url/https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5909642 |
dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess https://creativecommons.org/licenses/by-nc/2.5/ar/ |
eu_rights_str_mv |
openAccess |
rights_invalid_str_mv |
https://creativecommons.org/licenses/by-nc/2.5/ar/ |
dc.format.none.fl_str_mv |
application/pdf application/pdf |
dc.publisher.none.fl_str_mv |
Oxford University Press |
publisher.none.fl_str_mv |
Oxford University Press |
dc.source.none.fl_str_mv |
reponame:CONICET Digital (CONICET) instname:Consejo Nacional de Investigaciones Científicas y Técnicas |
reponame_str |
CONICET Digital (CONICET) |
collection |
CONICET Digital (CONICET) |
instname_str |
Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.name.fl_str_mv |
CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.mail.fl_str_mv |
dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar |
_version_ |
1844614261319401472 |
score |
13.070432 |