Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App

Autores
Perez Santangelo, Agustin; Solovey, Guillermo
Año de publicación
2022
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
Online experiments allow for fast, massive, cost-efficient data collection. However, uncontrolled conditions in online experiments can be problematic, particularly when inferences hinge on response-times (RTs) in the millisecond range. To address this challenge, we developed a mobile-friendly open-source application using R-Shiny, a popular R package. In particular, we aimed to replicate the numerical distance effect, a well-established cognitive phenomenon. In the task, 169 participants (109 with a mobile device, 60 on a desktop computer) completed 116 trials displaying two-digit target numbers and decided whether they were larger or smaller than a fixed standard number. Sessions lasted ∼7-minutes. Using generalized linear mixed models estimated with Bayesian inference methods, we observed a numerical distance effect: RTs decreased with the logarithm of the absolute difference between the target and the standard. Our results support the use of R-Shiny for RT-data collection. Furthermore, our method allowed us to measure systematic shifts in recorded RTs related to different OSs, web browsers, and devices, with mobile devices inducing longer shifts than desktop devices. Our work shows that precise RT measures can be reliably obtained online across mobile and desktop devices. It further paves the ground for the design of simple experimental tasks using R, a widely popular programming framework among cognitive scientists.
Fil: Perez Santangelo, Agustin. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Investigación en Ciencias de la Computación. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Investigación en Ciencias de la Computación; Argentina. Universidad Torcuato Di Tella; Argentina
Fil: Solovey, Guillermo. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Calculo. - Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Calculo; Argentina
Materia
NUMERICAL COGNITION
ONLINE EXPERIMENTS
R-SHINY
RESPONSE TIME
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/203615
Acceder
id CONICETDig_daa41ed9c6a2f8904daf0643aebe247d
oai_identifier_str oai:ri.conicet.gov.ar:11336/203615
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny AppPerez Santangelo, AgustinSolovey, GuillermoNUMERICAL COGNITIONONLINE EXPERIMENTSR-SHINYRESPONSE TIMEhttps://purl.org/becyt/ford/5.1https://purl.org/becyt/ford/5Online experiments allow for fast, massive, cost-efficient data collection. However, uncontrolled conditions in online experiments can be problematic, particularly when inferences hinge on response-times (RTs) in the millisecond range. To address this challenge, we developed a mobile-friendly open-source application using R-Shiny, a popular R package. In particular, we aimed to replicate the numerical distance effect, a well-established cognitive phenomenon. In the task, 169 participants (109 with a mobile device, 60 on a desktop computer) completed 116 trials displaying two-digit target numbers and decided whether they were larger or smaller than a fixed standard number. Sessions lasted ∼7-minutes. Using generalized linear mixed models estimated with Bayesian inference methods, we observed a numerical distance effect: RTs decreased with the logarithm of the absolute difference between the target and the standard. Our results support the use of R-Shiny for RT-data collection. Furthermore, our method allowed us to measure systematic shifts in recorded RTs related to different OSs, web browsers, and devices, with mobile devices inducing longer shifts than desktop devices. Our work shows that precise RT measures can be reliably obtained online across mobile and desktop devices. It further paves the ground for the design of simple experimental tasks using R, a widely popular programming framework among cognitive scientists.Fil: Perez Santangelo, Agustin. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Investigación en Ciencias de la Computación. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Investigación en Ciencias de la Computación; Argentina. Universidad Torcuato Di Tella; ArgentinaFil: Solovey, Guillermo. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Calculo. - Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Calculo; ArgentinaUbiquity Press2022-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/203615Perez Santangelo, Agustin; Solovey, Guillermo; Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App; Ubiquity Press; Journal of Cognition; 5; 1; 1-2022; 1-182514-4820CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://journalofcognition.org/articles/10.5334/joc.200info:eu-repo/semantics/altIdentifier/doi/10.5334/joc.200info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:41:09Zoai:ri.conicet.gov.ar:11336/203615instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:41:09.327CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
title Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
spellingShingle Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
Perez Santangelo, Agustin
NUMERICAL COGNITION
ONLINE EXPERIMENTS
R-SHINY
RESPONSE TIME
title_short Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
title_full Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
title_fullStr Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
title_full_unstemmed Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
title_sort Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App
dc.creator.none.fl_str_mv Perez Santangelo, Agustin
Solovey, Guillermo
author Perez Santangelo, Agustin
author_facet Perez Santangelo, Agustin
Solovey, Guillermo
author_role author
author2 Solovey, Guillermo
author2_role author
dc.subject.none.fl_str_mv NUMERICAL COGNITION
ONLINE EXPERIMENTS
R-SHINY
RESPONSE TIME
topic NUMERICAL COGNITION
ONLINE EXPERIMENTS
R-SHINY
RESPONSE TIME
purl_subject.fl_str_mv https://purl.org/becyt/ford/5.1
https://purl.org/becyt/ford/5
dc.description.none.fl_txt_mv Online experiments allow for fast, massive, cost-efficient data collection. However, uncontrolled conditions in online experiments can be problematic, particularly when inferences hinge on response-times (RTs) in the millisecond range. To address this challenge, we developed a mobile-friendly open-source application using R-Shiny, a popular R package. In particular, we aimed to replicate the numerical distance effect, a well-established cognitive phenomenon. In the task, 169 participants (109 with a mobile device, 60 on a desktop computer) completed 116 trials displaying two-digit target numbers and decided whether they were larger or smaller than a fixed standard number. Sessions lasted ∼7-minutes. Using generalized linear mixed models estimated with Bayesian inference methods, we observed a numerical distance effect: RTs decreased with the logarithm of the absolute difference between the target and the standard. Our results support the use of R-Shiny for RT-data collection. Furthermore, our method allowed us to measure systematic shifts in recorded RTs related to different OSs, web browsers, and devices, with mobile devices inducing longer shifts than desktop devices. Our work shows that precise RT measures can be reliably obtained online across mobile and desktop devices. It further paves the ground for the design of simple experimental tasks using R, a widely popular programming framework among cognitive scientists.
Fil: Perez Santangelo, Agustin. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Investigación en Ciencias de la Computación. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Investigación en Ciencias de la Computación; Argentina. Universidad Torcuato Di Tella; Argentina
Fil: Solovey, Guillermo. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Calculo. - Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Calculo; Argentina
description Online experiments allow for fast, massive, cost-efficient data collection. However, uncontrolled conditions in online experiments can be problematic, particularly when inferences hinge on response-times (RTs) in the millisecond range. To address this challenge, we developed a mobile-friendly open-source application using R-Shiny, a popular R package. In particular, we aimed to replicate the numerical distance effect, a well-established cognitive phenomenon. In the task, 169 participants (109 with a mobile device, 60 on a desktop computer) completed 116 trials displaying two-digit target numbers and decided whether they were larger or smaller than a fixed standard number. Sessions lasted ∼7-minutes. Using generalized linear mixed models estimated with Bayesian inference methods, we observed a numerical distance effect: RTs decreased with the logarithm of the absolute difference between the target and the standard. Our results support the use of R-Shiny for RT-data collection. Furthermore, our method allowed us to measure systematic shifts in recorded RTs related to different OSs, web browsers, and devices, with mobile devices inducing longer shifts than desktop devices. Our work shows that precise RT measures can be reliably obtained online across mobile and desktop devices. It further paves the ground for the design of simple experimental tasks using R, a widely popular programming framework among cognitive scientists.
publishDate 2022
dc.date.none.fl_str_mv 2022-01
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/203615
Perez Santangelo, Agustin; Solovey, Guillermo; Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App; Ubiquity Press; Journal of Cognition; 5; 1; 1-2022; 1-18
2514-4820
CONICET Digital
CONICET
url http://hdl.handle.net/11336/203615
identifier_str_mv Perez Santangelo, Agustin; Solovey, Guillermo; Running Online Behavioral Experiments Using R: Implementation of a Response-Time Decision Making Task as an R-Shiny App; Ubiquity Press; Journal of Cognition; 5; 1; 1-2022; 1-18
2514-4820
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://journalofcognition.org/articles/10.5334/joc.200
info:eu-repo/semantics/altIdentifier/doi/10.5334/joc.200
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Ubiquity Press
publisher.none.fl_str_mv Ubiquity Press
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844614441561227264
score 13.070432

Publicaciones similares