Exploring the anatomical encoding of voice with a mathematical model of the vocal system

Autores
Assaneo, María Florencia; Sitt, Jacobo Diego; Varoquaux, Gael; Sigman, Mariano; Cohen, Laurent; Trevisan, Marcos Alberto
Año de publicación
2016
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.
Fil: Assaneo, María Florencia. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. University of New York; Estados Unidos
Fil: Sitt, Jacobo Diego. Inserm; Francia. Universite de Paris VI; Francia. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Varoquaux, Gael. Inserm; Francia. Institut National de Recherche en Informatique et en Automatique; Francia
Fil: Sigman, Mariano. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. Universidad Torcuato di Tella; Argentina
Fil: Cohen, Laurent. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Universite de Paris VI; Francia
Fil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Materia
Biomechanical Vocal Model
Neural Coding of Voice
Voice Identity
Auditory Cortex
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/46562

id CONICETDig_35eeb28d665bc4b949bb0c013b563bd5
oai_identifier_str oai:ri.conicet.gov.ar:11336/46562
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Exploring the anatomical encoding of voice with a mathematical model of the vocal systemAssaneo, María FlorenciaSitt, Jacobo DiegoVaroquaux, GaelSigman, MarianoCohen, LaurentTrevisan, Marcos AlbertoBiomechanical Vocal ModelNeural Coding of VoiceVoice IdentityAuditory Cortexhttps://purl.org/becyt/ford/1.3https://purl.org/becyt/ford/1The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.Fil: Assaneo, María Florencia. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. University of New York; Estados UnidosFil: Sitt, Jacobo Diego. Inserm; Francia. Universite de Paris VI; Francia. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Varoquaux, Gael. Inserm; Francia. Institut National de Recherche en Informatique et en Automatique; FranciaFil: Sigman, Mariano. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. Universidad Torcuato di Tella; ArgentinaFil: Cohen, Laurent. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Universite de Paris VI; FranciaFil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; ArgentinaAcademic Press Inc Elsevier Science2016-11info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/46562Assaneo, María Florencia; Sitt, Jacobo Diego; Varoquaux, Gael; Sigman, Mariano; Cohen, Laurent; et al.; Exploring the anatomical encoding of voice with a mathematical model of the vocal system; Academic Press Inc Elsevier Science; Neuroimage; 141; 11-2016; 31-391053-8119CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.1016/j.neuroimage.2016.07.033info:eu-repo/semantics/altIdentifier/url/https://www.sciencedirect.com/science/article/pii/S1053811916303408info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-nd/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-10T13:02:35Zoai:ri.conicet.gov.ar:11336/46562instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-10 13:02:36.154CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Exploring the anatomical encoding of voice with a mathematical model of the vocal system
title Exploring the anatomical encoding of voice with a mathematical model of the vocal system
spellingShingle Exploring the anatomical encoding of voice with a mathematical model of the vocal system
Assaneo, María Florencia
Biomechanical Vocal Model
Neural Coding of Voice
Voice Identity
Auditory Cortex
title_short Exploring the anatomical encoding of voice with a mathematical model of the vocal system
title_full Exploring the anatomical encoding of voice with a mathematical model of the vocal system
title_fullStr Exploring the anatomical encoding of voice with a mathematical model of the vocal system
title_full_unstemmed Exploring the anatomical encoding of voice with a mathematical model of the vocal system
title_sort Exploring the anatomical encoding of voice with a mathematical model of the vocal system
dc.creator.none.fl_str_mv Assaneo, María Florencia
Sitt, Jacobo Diego
Varoquaux, Gael
Sigman, Mariano
Cohen, Laurent
Trevisan, Marcos Alberto
author Assaneo, María Florencia
author_facet Assaneo, María Florencia
Sitt, Jacobo Diego
Varoquaux, Gael
Sigman, Mariano
Cohen, Laurent
Trevisan, Marcos Alberto
author_role author
author2 Sitt, Jacobo Diego
Varoquaux, Gael
Sigman, Mariano
Cohen, Laurent
Trevisan, Marcos Alberto
author2_role author
author
author
author
author
dc.subject.none.fl_str_mv Biomechanical Vocal Model
Neural Coding of Voice
Voice Identity
Auditory Cortex
topic Biomechanical Vocal Model
Neural Coding of Voice
Voice Identity
Auditory Cortex
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.3
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.
Fil: Assaneo, María Florencia. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. University of New York; Estados Unidos
Fil: Sitt, Jacobo Diego. Inserm; Francia. Universite de Paris VI; Francia. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Varoquaux, Gael. Inserm; Francia. Institut National de Recherche en Informatique et en Automatique; Francia
Fil: Sigman, Mariano. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina. Universidad Torcuato di Tella; Argentina
Fil: Cohen, Laurent. Centre de Recherche de I'institut Du Cerveau Et de la Moelle Epiniere; Francia. Universite de Paris VI; Francia
Fil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
description The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.
publishDate 2016
dc.date.none.fl_str_mv 2016-11
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/46562
Assaneo, María Florencia; Sitt, Jacobo Diego; Varoquaux, Gael; Sigman, Mariano; Cohen, Laurent; et al.; Exploring the anatomical encoding of voice with a mathematical model of the vocal system; Academic Press Inc Elsevier Science; Neuroimage; 141; 11-2016; 31-39
1053-8119
CONICET Digital
CONICET
url http://hdl.handle.net/11336/46562
identifier_str_mv Assaneo, María Florencia; Sitt, Jacobo Diego; Varoquaux, Gael; Sigman, Mariano; Cohen, Laurent; et al.; Exploring the anatomical encoding of voice with a mathematical model of the vocal system; Academic Press Inc Elsevier Science; Neuroimage; 141; 11-2016; 31-39
1053-8119
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/doi/10.1016/j.neuroimage.2016.07.033
info:eu-repo/semantics/altIdentifier/url/https://www.sciencedirect.com/science/article/pii/S1053811916303408
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-nd/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Academic Press Inc Elsevier Science
publisher.none.fl_str_mv Academic Press Inc Elsevier Science
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1842980027619082240
score 12.993085