Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search

Autores
Kamienkowski, Juan Esteban; Varatharajah, Alexander; Sigman, Mariano; Ison, Matias Julian
Año de publicación
2018
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.
Fil: Kamienkowski, Juan Esteban. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Física; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Computación. Laboratorio de Inteligencia Artificial Aplicada; Argentina
Fil: Varatharajah, Alexander. University Of Leicester. Control And Instr.research Gr.engineering Dep.; Reino Unido
Fil: Sigman, Mariano. Universidad Torcuato Di Tella; Argentina
Fil: Ison, Matias Julian. University of Nottingham; Estados Unidos
Materia
VISUAL SEARCH
EEG
EYE MOVEMENTS
ATTENTION
NATURAL SCENES
OSCILLATIONS
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/104345
Acceder
id CONICETDig_03c4cbbbd0813546b66a37d7a44dacf7
oai_identifier_str oai:ri.conicet.gov.ar:11336/104345
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual searchKamienkowski, Juan EstebanVaratharajah, AlexanderSigman, MarianoIson, Matias JulianVISUAL SEARCHEEGEYE MOVEMENTSATTENTIONNATURAL SCENESOSCILLATIONShttps://purl.org/becyt/ford/1.7https://purl.org/becyt/ford/1Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.Fil: Kamienkowski, Juan Esteban. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Física; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Computación. Laboratorio de Inteligencia Artificial Aplicada; ArgentinaFil: Varatharajah, Alexander. University Of Leicester. Control And Instr.research Gr.engineering Dep.; Reino UnidoFil: Sigman, Mariano. Universidad Torcuato Di Tella; ArgentinaFil: Ison, Matias Julian. University of Nottingham; Estados UnidosElsevier2018-08info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/104345Kamienkowski, Juan Esteban; Varatharajah, Alexander; Sigman, Mariano; Ison, Matias Julian; Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search; Elsevier; Journal Neuroimag; 183; 8-2018; 73-861053-8119CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://linkinghub.elsevier.com/retrieve/pii/S105381191830702Xinfo:eu-repo/semantics/altIdentifier/doi/10.1016/j.neuroimage.2018.08.010info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-nd/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-10T13:08:49Zoai:ri.conicet.gov.ar:11336/104345instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-10 13:08:50.207CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
title Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
spellingShingle Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
Kamienkowski, Juan Esteban
VISUAL SEARCH
EEG
EYE MOVEMENTS
ATTENTION
NATURAL SCENES
OSCILLATIONS
title_short Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
title_full Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
title_fullStr Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
title_full_unstemmed Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
title_sort Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search
dc.creator.none.fl_str_mv Kamienkowski, Juan Esteban
Varatharajah, Alexander
Sigman, Mariano
Ison, Matias Julian
author Kamienkowski, Juan Esteban
author_facet Kamienkowski, Juan Esteban
Varatharajah, Alexander
Sigman, Mariano
Ison, Matias Julian
author_role author
author2 Varatharajah, Alexander
Sigman, Mariano
Ison, Matias Julian
author2_role author
author
author
dc.subject.none.fl_str_mv VISUAL SEARCH
EEG
EYE MOVEMENTS
ATTENTION
NATURAL SCENES
OSCILLATIONS
topic VISUAL SEARCH
EEG
EYE MOVEMENTS
ATTENTION
NATURAL SCENES
OSCILLATIONS
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.7
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.
Fil: Kamienkowski, Juan Esteban. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Física; Argentina. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Computación. Laboratorio de Inteligencia Artificial Aplicada; Argentina
Fil: Varatharajah, Alexander. University Of Leicester. Control And Instr.research Gr.engineering Dep.; Reino Unido
Fil: Sigman, Mariano. Universidad Torcuato Di Tella; Argentina
Fil: Ison, Matias Julian. University of Nottingham; Estados Unidos
description Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.
publishDate 2018
dc.date.none.fl_str_mv 2018-08
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/104345
Kamienkowski, Juan Esteban; Varatharajah, Alexander; Sigman, Mariano; Ison, Matias Julian; Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search; Elsevier; Journal Neuroimag; 183; 8-2018; 73-86
1053-8119
CONICET Digital
CONICET
url http://hdl.handle.net/11336/104345
identifier_str_mv Kamienkowski, Juan Esteban; Varatharajah, Alexander; Sigman, Mariano; Ison, Matias Julian; Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search; Elsevier; Journal Neuroimag; 183; 8-2018; 73-86
1053-8119
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://linkinghub.elsevier.com/retrieve/pii/S105381191830702X
info:eu-repo/semantics/altIdentifier/doi/10.1016/j.neuroimage.2018.08.010
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1842980425723543552
score 12.993085

Publicaciones similares