Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations

Autores
González, Federico Martín; Marrujo, Jonathan; Martínez, Magalí Ayelén; Barreyro, Juan Pablo; Burin, Debora Ines
Año de publicación
2024
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
Working memory (WM) tasks have been extensively studied with laboratory paper and pencil or computerized tasks; few studies have assessed the feasibility and psychometric properties of WM online tests for low-stakes research purposes. This study analyzed the online implementation of two verbal WM tasks, Letter-Number Sequencing and Running Span. Letter-Number Sequencing was tested in a supervised, online video conference setting in small groups. Running Span was assessed asynchronously and unsupervised. Both had adequate reliability. For Letter-Number Sequencing, approximately 25% of the sample had to be excluded following criteria for minimum performance and strategic behavior. In addition, performance did not follow the set size effect, a benchmark for WM tasks, and was systematically different from an in-person sample. In contrast, the remote online Running Span task displayed systematic lower performance with more to-be-remembered items (set size effect), with overall performance aligning closely with a similar in-person evaluation.
Fil: González, Federico Martín. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Marrujo, Jonathan. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
Fil: Martínez, Magalí Ayelén. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
Fil: Barreyro, Juan Pablo. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Saavedra 15. Centro Interdisciplinario de Investigaciones en Psicología Matemática y Experimental Dr. Horacio J. A. Rimoldi; Argentina
Fil: Burin, Debora Ines. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
Materia
WORKING MEMORY
ONLINE TESTING
REMOTE TESTING
RELIABILITY
VALIDITY
SET SIZE EFFECT
ONLINE TESTING
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/240940

id CONICETDig_41152b76af0e08ec452549f0072f7784
oai_identifier_str oai:ri.conicet.gov.ar:11336/240940
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two ImplementationsGonzález, Federico MartínMarrujo, JonathanMartínez, Magalí AyelénBarreyro, Juan PabloBurin, Debora InesWORKING MEMORYONLINE TESTINGREMOTE TESTINGRELIABILITYVALIDITYSET SIZE EFFECTONLINE TESTINGhttps://purl.org/becyt/ford/5.1https://purl.org/becyt/ford/5Working memory (WM) tasks have been extensively studied with laboratory paper and pencil or computerized tasks; few studies have assessed the feasibility and psychometric properties of WM online tests for low-stakes research purposes. This study analyzed the online implementation of two verbal WM tasks, Letter-Number Sequencing and Running Span. Letter-Number Sequencing was tested in a supervised, online video conference setting in small groups. Running Span was assessed asynchronously and unsupervised. Both had adequate reliability. For Letter-Number Sequencing, approximately 25% of the sample had to be excluded following criteria for minimum performance and strategic behavior. In addition, performance did not follow the set size effect, a benchmark for WM tasks, and was systematically different from an in-person sample. In contrast, the remote online Running Span task displayed systematic lower performance with more to-be-remembered items (set size effect), with overall performance aligning closely with a similar in-person evaluation.Fil: González, Federico Martín. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Marrujo, Jonathan. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; ArgentinaFil: Martínez, Magalí Ayelén. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; ArgentinaFil: Barreyro, Juan Pablo. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Saavedra 15. Centro Interdisciplinario de Investigaciones en Psicología Matemática y Experimental Dr. Horacio J. A. Rimoldi; ArgentinaFil: Burin, Debora Ines. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; ArgentinaUniversidad de Valencia2024-06info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/240940González, Federico Martín; Marrujo, Jonathan; Martínez, Magalí Ayelén; Barreyro, Juan Pablo; Burin, Debora Ines; Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations; Universidad de Valencia; Psicologica; 45; 2; 6-2024; 1-310211-2159CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://digital.csic.es/handle/10261/295885info:eu-repo/semantics/altIdentifier/doi/10.20350/digitalCSIC/16342info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:34:03Zoai:ri.conicet.gov.ar:11336/240940instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:34:03.607CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
title Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
spellingShingle Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
González, Federico Martín
WORKING MEMORY
ONLINE TESTING
REMOTE TESTING
RELIABILITY
VALIDITY
SET SIZE EFFECT
ONLINE TESTING
title_short Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
title_full Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
title_fullStr Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
title_full_unstemmed Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
title_sort Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations
dc.creator.none.fl_str_mv González, Federico Martín
Marrujo, Jonathan
Martínez, Magalí Ayelén
Barreyro, Juan Pablo
Burin, Debora Ines
author González, Federico Martín
author_facet González, Federico Martín
Marrujo, Jonathan
Martínez, Magalí Ayelén
Barreyro, Juan Pablo
Burin, Debora Ines
author_role author
author2 Marrujo, Jonathan
Martínez, Magalí Ayelén
Barreyro, Juan Pablo
Burin, Debora Ines
author2_role author
author
author
author
dc.subject.none.fl_str_mv WORKING MEMORY
ONLINE TESTING
REMOTE TESTING
RELIABILITY
VALIDITY
SET SIZE EFFECT
ONLINE TESTING
topic WORKING MEMORY
ONLINE TESTING
REMOTE TESTING
RELIABILITY
VALIDITY
SET SIZE EFFECT
ONLINE TESTING
purl_subject.fl_str_mv https://purl.org/becyt/ford/5.1
https://purl.org/becyt/ford/5
dc.description.none.fl_txt_mv Working memory (WM) tasks have been extensively studied with laboratory paper and pencil or computerized tasks; few studies have assessed the feasibility and psychometric properties of WM online tests for low-stakes research purposes. This study analyzed the online implementation of two verbal WM tasks, Letter-Number Sequencing and Running Span. Letter-Number Sequencing was tested in a supervised, online video conference setting in small groups. Running Span was assessed asynchronously and unsupervised. Both had adequate reliability. For Letter-Number Sequencing, approximately 25% of the sample had to be excluded following criteria for minimum performance and strategic behavior. In addition, performance did not follow the set size effect, a benchmark for WM tasks, and was systematically different from an in-person sample. In contrast, the remote online Running Span task displayed systematic lower performance with more to-be-remembered items (set size effect), with overall performance aligning closely with a similar in-person evaluation.
Fil: González, Federico Martín. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Marrujo, Jonathan. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
Fil: Martínez, Magalí Ayelén. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
Fil: Barreyro, Juan Pablo. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Saavedra 15. Centro Interdisciplinario de Investigaciones en Psicología Matemática y Experimental Dr. Horacio J. A. Rimoldi; Argentina
Fil: Burin, Debora Ines. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Psicología. Instituto de Investigaciones; Argentina
description Working memory (WM) tasks have been extensively studied with laboratory paper and pencil or computerized tasks; few studies have assessed the feasibility and psychometric properties of WM online tests for low-stakes research purposes. This study analyzed the online implementation of two verbal WM tasks, Letter-Number Sequencing and Running Span. Letter-Number Sequencing was tested in a supervised, online video conference setting in small groups. Running Span was assessed asynchronously and unsupervised. Both had adequate reliability. For Letter-Number Sequencing, approximately 25% of the sample had to be excluded following criteria for minimum performance and strategic behavior. In addition, performance did not follow the set size effect, a benchmark for WM tasks, and was systematically different from an in-person sample. In contrast, the remote online Running Span task displayed systematic lower performance with more to-be-remembered items (set size effect), with overall performance aligning closely with a similar in-person evaluation.
publishDate 2024
dc.date.none.fl_str_mv 2024-06
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/240940
González, Federico Martín; Marrujo, Jonathan; Martínez, Magalí Ayelén; Barreyro, Juan Pablo; Burin, Debora Ines; Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations; Universidad de Valencia; Psicologica; 45; 2; 6-2024; 1-31
0211-2159
CONICET Digital
CONICET
url http://hdl.handle.net/11336/240940
identifier_str_mv González, Federico Martín; Marrujo, Jonathan; Martínez, Magalí Ayelén; Barreyro, Juan Pablo; Burin, Debora Ines; Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations; Universidad de Valencia; Psicologica; 45; 2; 6-2024; 1-31
0211-2159
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://digital.csic.es/handle/10261/295885
info:eu-repo/semantics/altIdentifier/doi/10.20350/digitalCSIC/16342
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Universidad de Valencia
publisher.none.fl_str_mv Universidad de Valencia
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844614356787003392
score 13.070432