Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse

Autores
Merpert, Ariel; Furman, Melina Gabriela; Anauati, Maria Victoria; Zommer, Laura; Taylor, Inés
Año de publicación
2017
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
The first step in journalistic fact-checking of political discourse is identifying whether statements contain “checkable facts” (i.e., not opinions). This randomized controlled experiment investigated how different demographic factors (age, gender, education, profession, and political affiliation) are associated with the ability to discern if statements contained checkable or noncheckable facts, as well as what impact training in identifying checkable facts can have on overall outcomes. A total of 3,357 participants identified checkable and noncheckable statements from a fictional political speech extract containing eight statements. Overall, participants were able to correctly identify an average of 69% of statements. Specific demographic factors (being male, young, and university educated) were positively associated with increased performance as well as working in professions that commonly analyze data, such as research. Participating in a short training session significantly increased participants’ performance. Initial political affiliation slightly reduces the ability to assess whether statements made by named politicians contained checkable facts.
Fil: Merpert, Ariel. Chequeado; Argentina
Fil: Furman, Melina Gabriela. Universidad de San Andrés; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Anauati, Maria Victoria. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de San Andrés; Argentina
Fil: Zommer, Laura. Chequeado; Argentina
Fil: Taylor, Inés. Universidad de San Andrés; Argentina
Materia
Checkable Statements
Fact-Checking
Political Affiliation
Training
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/41097

id CONICETDig_b78c119c9ea529af7bab38ea4e3c047d
oai_identifier_str oai:ri.conicet.gov.ar:11336/41097
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political DiscourseMerpert, ArielFurman, Melina GabrielaAnauati, Maria VictoriaZommer, LauraTaylor, InésCheckable StatementsFact-CheckingPolitical AffiliationTraininghttps://purl.org/becyt/ford/5.3https://purl.org/becyt/ford/5The first step in journalistic fact-checking of political discourse is identifying whether statements contain “checkable facts” (i.e., not opinions). This randomized controlled experiment investigated how different demographic factors (age, gender, education, profession, and political affiliation) are associated with the ability to discern if statements contained checkable or noncheckable facts, as well as what impact training in identifying checkable facts can have on overall outcomes. A total of 3,357 participants identified checkable and noncheckable statements from a fictional political speech extract containing eight statements. Overall, participants were able to correctly identify an average of 69% of statements. Specific demographic factors (being male, young, and university educated) were positively associated with increased performance as well as working in professions that commonly analyze data, such as research. Participating in a short training session significantly increased participants’ performance. Initial political affiliation slightly reduces the ability to assess whether statements made by named politicians contained checkable facts.Fil: Merpert, Ariel. Chequeado; ArgentinaFil: Furman, Melina Gabriela. Universidad de San Andrés; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Anauati, Maria Victoria. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de San Andrés; ArgentinaFil: Zommer, Laura. Chequeado; ArgentinaFil: Taylor, Inés. Universidad de San Andrés; ArgentinaRoutledge Journals, Taylor & Francis Ltd2017-09info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/41097Merpert, Ariel; Furman, Melina Gabriela; Anauati, Maria Victoria; Zommer, Laura; Taylor, Inés; Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse; Routledge Journals, Taylor & Francis Ltd; Communication Research Reports; 9-2017; 1-100882-40961746-4099CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.1080/08824096.2017.1366303info:eu-repo/semantics/altIdentifier/url/https://www.tandfonline.com/doi/abs/10.1080/08824096.2017.1366303info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T09:35:56Zoai:ri.conicet.gov.ar:11336/41097instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 09:35:57.193CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
title Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
spellingShingle Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
Merpert, Ariel
Checkable Statements
Fact-Checking
Political Affiliation
Training
title_short Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
title_full Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
title_fullStr Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
title_full_unstemmed Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
title_sort Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse
dc.creator.none.fl_str_mv Merpert, Ariel
Furman, Melina Gabriela
Anauati, Maria Victoria
Zommer, Laura
Taylor, Inés
author Merpert, Ariel
author_facet Merpert, Ariel
Furman, Melina Gabriela
Anauati, Maria Victoria
Zommer, Laura
Taylor, Inés
author_role author
author2 Furman, Melina Gabriela
Anauati, Maria Victoria
Zommer, Laura
Taylor, Inés
author2_role author
author
author
author
dc.subject.none.fl_str_mv Checkable Statements
Fact-Checking
Political Affiliation
Training
topic Checkable Statements
Fact-Checking
Political Affiliation
Training
purl_subject.fl_str_mv https://purl.org/becyt/ford/5.3
https://purl.org/becyt/ford/5
dc.description.none.fl_txt_mv The first step in journalistic fact-checking of political discourse is identifying whether statements contain “checkable facts” (i.e., not opinions). This randomized controlled experiment investigated how different demographic factors (age, gender, education, profession, and political affiliation) are associated with the ability to discern if statements contained checkable or noncheckable facts, as well as what impact training in identifying checkable facts can have on overall outcomes. A total of 3,357 participants identified checkable and noncheckable statements from a fictional political speech extract containing eight statements. Overall, participants were able to correctly identify an average of 69% of statements. Specific demographic factors (being male, young, and university educated) were positively associated with increased performance as well as working in professions that commonly analyze data, such as research. Participating in a short training session significantly increased participants’ performance. Initial political affiliation slightly reduces the ability to assess whether statements made by named politicians contained checkable facts.
Fil: Merpert, Ariel. Chequeado; Argentina
Fil: Furman, Melina Gabriela. Universidad de San Andrés; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Anauati, Maria Victoria. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de San Andrés; Argentina
Fil: Zommer, Laura. Chequeado; Argentina
Fil: Taylor, Inés. Universidad de San Andrés; Argentina
description The first step in journalistic fact-checking of political discourse is identifying whether statements contain “checkable facts” (i.e., not opinions). This randomized controlled experiment investigated how different demographic factors (age, gender, education, profession, and political affiliation) are associated with the ability to discern if statements contained checkable or noncheckable facts, as well as what impact training in identifying checkable facts can have on overall outcomes. A total of 3,357 participants identified checkable and noncheckable statements from a fictional political speech extract containing eight statements. Overall, participants were able to correctly identify an average of 69% of statements. Specific demographic factors (being male, young, and university educated) were positively associated with increased performance as well as working in professions that commonly analyze data, such as research. Participating in a short training session significantly increased participants’ performance. Initial political affiliation slightly reduces the ability to assess whether statements made by named politicians contained checkable facts.
publishDate 2017
dc.date.none.fl_str_mv 2017-09
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/41097
Merpert, Ariel; Furman, Melina Gabriela; Anauati, Maria Victoria; Zommer, Laura; Taylor, Inés; Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse; Routledge Journals, Taylor & Francis Ltd; Communication Research Reports; 9-2017; 1-10
0882-4096
1746-4099
CONICET Digital
CONICET
url http://hdl.handle.net/11336/41097
identifier_str_mv Merpert, Ariel; Furman, Melina Gabriela; Anauati, Maria Victoria; Zommer, Laura; Taylor, Inés; Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse; Routledge Journals, Taylor & Francis Ltd; Communication Research Reports; 9-2017; 1-10
0882-4096
1746-4099
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/doi/10.1080/08824096.2017.1366303
info:eu-repo/semantics/altIdentifier/url/https://www.tandfonline.com/doi/abs/10.1080/08824096.2017.1366303
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Routledge Journals, Taylor & Francis Ltd
publisher.none.fl_str_mv Routledge Journals, Taylor & Francis Ltd
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844613124525654016
score 13.070432