Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey
- Autores
- Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald
- Año de publicación
- 2017
- Idioma
- inglés
- Tipo de recurso
- artículo
- Estado
- versión publicada
- Descripción
- Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.
Fil: Wagner, Gernot. Danube University Krems; Alemania
Fil: Nussbaumer Streit, Barbara. Danube University Krems; Alemania
Fil: Greimel, Judith. Universidad de Hohenheim; Alemania
Fil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Gartlehner, Gerald. Danube University Krems; Alemania - Materia
-
DECISION-MAKING
DECISIONMAKER
GUIDELINE DEVELOPER
RAPID REVIEW
SYSTEMATIC REVIEW
UNCERTAINTY - Nivel de accesibilidad
- acceso abierto
- Condiciones de uso
- https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
- Repositorio
- Institución
- Consejo Nacional de Investigaciones Científicas y Técnicas
- OAI Identificador
- oai:ri.conicet.gov.ar:11336/57602
Ver los metadatos del registro completo
id |
CONICETDig_d33b71cdbfc9b952d9bc71fe59533155 |
---|---|
oai_identifier_str |
oai:ri.conicet.gov.ar:11336/57602 |
network_acronym_str |
CONICETDig |
repository_id_str |
3498 |
network_name_str |
CONICET Digital (CONICET) |
spelling |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international surveyWagner, GernotNussbaumer Streit, BarbaraGreimel, JudithCiapponi, AgustínGartlehner, GeraldDECISION-MAKINGDECISIONMAKERGUIDELINE DEVELOPERRAPID REVIEWSYSTEMATIC REVIEWUNCERTAINTYhttps://purl.org/becyt/ford/3.3https://purl.org/becyt/ford/3Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews.Fil: Wagner, Gernot. Danube University Krems; AlemaniaFil: Nussbaumer Streit, Barbara. Danube University Krems; AlemaniaFil: Greimel, Judith. Universidad de Hohenheim; AlemaniaFil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Gartlehner, Gerald. Danube University Krems; AlemaniaBioMed Central2017-08info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/57602Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-81471-2288CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.1186/s12874-017-0406-5info:eu-repo/semantics/altIdentifier/url/https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-017-0406-5info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-03T09:47:04Zoai:ri.conicet.gov.ar:11336/57602instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-03 09:47:04.837CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse |
dc.title.none.fl_str_mv |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
title |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
spellingShingle |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey Wagner, Gernot DECISION-MAKING DECISIONMAKER GUIDELINE DEVELOPER RAPID REVIEW SYSTEMATIC REVIEW UNCERTAINTY |
title_short |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
title_full |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
title_fullStr |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
title_full_unstemmed |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
title_sort |
Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey |
dc.creator.none.fl_str_mv |
Wagner, Gernot Nussbaumer Streit, Barbara Greimel, Judith Ciapponi, Agustín Gartlehner, Gerald |
author |
Wagner, Gernot |
author_facet |
Wagner, Gernot Nussbaumer Streit, Barbara Greimel, Judith Ciapponi, Agustín Gartlehner, Gerald |
author_role |
author |
author2 |
Nussbaumer Streit, Barbara Greimel, Judith Ciapponi, Agustín Gartlehner, Gerald |
author2_role |
author author author author |
dc.subject.none.fl_str_mv |
DECISION-MAKING DECISIONMAKER GUIDELINE DEVELOPER RAPID REVIEW SYSTEMATIC REVIEW UNCERTAINTY |
topic |
DECISION-MAKING DECISIONMAKER GUIDELINE DEVELOPER RAPID REVIEW SYSTEMATIC REVIEW UNCERTAINTY |
purl_subject.fl_str_mv |
https://purl.org/becyt/ford/3.3 https://purl.org/becyt/ford/3 |
dc.description.none.fl_txt_mv |
Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews. Fil: Wagner, Gernot. Danube University Krems; Alemania Fil: Nussbaumer Streit, Barbara. Danube University Krems; Alemania Fil: Greimel, Judith. Universidad de Hohenheim; Alemania Fil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina Fil: Gartlehner, Gerald. Danube University Krems; Alemania |
description |
Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews. |
publishDate |
2017 |
dc.date.none.fl_str_mv |
2017-08 |
dc.type.none.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion http://purl.org/coar/resource_type/c_6501 info:ar-repo/semantics/articulo |
format |
article |
status_str |
publishedVersion |
dc.identifier.none.fl_str_mv |
http://hdl.handle.net/11336/57602 Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-8 1471-2288 CONICET Digital CONICET |
url |
http://hdl.handle.net/11336/57602 |
identifier_str_mv |
Wagner, Gernot; Nussbaumer Streit, Barbara; Greimel, Judith; Ciapponi, Agustín; Gartlehner, Gerald; Trading certainty for speed - How much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: An international survey; BioMed Central; Bmc Medical Research Methodology; 17; 1; 8-2017; 1-8 1471-2288 CONICET Digital CONICET |
dc.language.none.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
info:eu-repo/semantics/altIdentifier/doi/10.1186/s12874-017-0406-5 info:eu-repo/semantics/altIdentifier/url/https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-017-0406-5 |
dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
eu_rights_str_mv |
openAccess |
rights_invalid_str_mv |
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
dc.format.none.fl_str_mv |
application/pdf application/pdf |
dc.publisher.none.fl_str_mv |
BioMed Central |
publisher.none.fl_str_mv |
BioMed Central |
dc.source.none.fl_str_mv |
reponame:CONICET Digital (CONICET) instname:Consejo Nacional de Investigaciones Científicas y Técnicas |
reponame_str |
CONICET Digital (CONICET) |
collection |
CONICET Digital (CONICET) |
instname_str |
Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.name.fl_str_mv |
CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.mail.fl_str_mv |
dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar |
_version_ |
1842268835079520256 |
score |
13.13397 |