Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey

Autores
Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald
Año de publicación
2017
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.
Fil: Wagner, Gernot. Danube University Krems; Alemania
Fil: Nussbaumer Streit, Barbara. Danube University Krems; Alemania
Fil: Greimel, Judith. Universidad de Hohenheim; Alemania
Fil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Gartlehner, Gerald. Danube University Krems; Alemania
Materia
DECISION-MAKING
DECISIONMAKER
GUIDELINE DEVELOPER
RAPID REVIEW
SYSTEMATIC REVIEW
UNCERTAINTY
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/57602

id CONICETDig_d33b71cdbfc9b952d9bc71fe59533155
oai_identifier_str oai:ri.conicet.gov.ar:11336/57602
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international surveyWagner, GernotNussbaumer Streit, BarbaraGreimel, JudithCiapponi, AgustínGartlehner, GeraldDECISION-MAKINGDECISIONMAKERGUIDELINE DEVELOPERRAPID REVIEWSYSTEMATIC REVIEWUNCERTAINTYhttps://purl.org/becyt/ford/3.3https://purl.org/becyt/ford/3Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.Fil: Wagner, Gernot. Danube University Krems; AlemaniaFil: Nussbaumer Streit, Barbara. Danube University Krems; AlemaniaFil: Greimel, Judith. Universidad de Hohenheim; AlemaniaFil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Gartlehner, Gerald. Danube University Krems; AlemaniaBioMed Central2017-08info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/57602Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-81471-2288CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.1186/s12874-017-0406-5info:eu-repo/semantics/altIdentifier/url/https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-017-0406-5info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-03T09:47:04Zoai:ri.conicet.gov.ar:11336/57602instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-03 09:47:04.837CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
title Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
spellingShingle Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
Wagner, Gernot
DECISION-MAKING
DECISIONMAKER
GUIDELINE DEVELOPER
RAPID REVIEW
SYSTEMATIC REVIEW
UNCERTAINTY
title_short Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
title_full Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
title_fullStr Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
title_full_unstemmed Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
title_sort Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
dc.creator.none.fl_str_mv Wagner, Gernot
Nussbaumer Streit, Barbara
Greimel, Judith
Ciapponi, Agustín
Gartlehner, Gerald
author Wagner, Gernot
author_facet Wagner, Gernot
Nussbaumer Streit, Barbara
Greimel, Judith
Ciapponi, Agustín
Gartlehner, Gerald
author_role author
author2 Nussbaumer Streit, Barbara
Greimel, Judith
Ciapponi, Agustín
Gartlehner, Gerald
author2_role author
author
author
author
dc.subject.none.fl_str_mv DECISION-MAKING
DECISIONMAKER
GUIDELINE DEVELOPER
RAPID REVIEW
SYSTEMATIC REVIEW
UNCERTAINTY
topic DECISION-MAKING
DECISIONMAKER
GUIDELINE DEVELOPER
RAPID REVIEW
SYSTEMATIC REVIEW
UNCERTAINTY
purl_subject.fl_str_mv https://purl.org/becyt/ford/3.3
https://purl.org/becyt/ford/3
dc.description.none.fl_txt_mv Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.
Fil: Wagner, Gernot. Danube University Krems; Alemania
Fil: Nussbaumer Streit, Barbara. Danube University Krems; Alemania
Fil: Greimel, Judith. Universidad de Hohenheim; Alemania
Fil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Gartlehner, Gerald. Danube University Krems; Alemania
description Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.
publishDate 2017
dc.date.none.fl_str_mv 2017-08
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/57602
Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-8
1471-2288
CONICET Digital
CONICET
url http://hdl.handle.net/11336/57602
identifier_str_mv Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-8
1471-2288
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/doi/10.1186/s12874-017-0406-5
info:eu-repo/semantics/altIdentifier/url/https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-017-0406-5
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv BioMed Central
publisher.none.fl_str_mv BioMed Central
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1842268835079520256
score 13.13397