Discrete Anatomical Coordinates for Speech Production and Synthesis

Autores
Assaneo, María Florencia; Ramírez Butavand, Daniela; Trevisan, Marcos Alberto; Mindlin, Bernardo Gabriel
Año de publicación
2019
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
The sounds of all languages are described by a finite set of symbols, which are extracted from the continuum of sounds produced by the vocal organ. How the discrete phonemic identity is encoded in the continuous movements producing speech remains an open question for the experimental phonology. In this work, this question is assessed by using Hall-effect transducers and magnets - mounted on the tongue, lips, and jaw - to track the kinematics of the oral tract during the vocalization of vowel-consonant-vowel structures. Using a threshold strategy, the time traces of the transducers were converted into discrete motor coordinates unambiguously associated with the vocalized phonemes. Furthermore, the signals of the transducers combined with the discretization strategy were used to drive a low-dimensional vocal model capable of synthesizing intelligible speech. The current work not only assesses a relevant inquiry of the biology of language, but also demonstrates the performance of the experimental technique to monitor the displacement of the main articulators of the vocal tract while speaking. This novel electronic device represents an economic and portable option to the standard systems used to study the vocal tract movements.
Fil: Assaneo, María Florencia. University of New York; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Ramírez Butavand, Daniela. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Mindlin, Bernardo Gabriel. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Materia
ARTICULATORY SPEECH SYNTHESIZER
EXPERIMENTAL PHONOLOGY
HALL-EFFECT TRANSDUCERS
MATHEMATICAL MODELING
SPEECH MOTOR COORDINATES
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/147443
Acceder
id CONICETDig_feabe39c27d5e5cbed28f47f055f9147
oai_identifier_str oai:ri.conicet.gov.ar:11336/147443
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Discrete Anatomical Coordinates for Speech Production and SynthesisAssaneo, María FlorenciaRamírez Butavand, DanielaTrevisan, Marcos AlbertoMindlin, Bernardo GabrielARTICULATORY SPEECH SYNTHESIZEREXPERIMENTAL PHONOLOGYHALL-EFFECT TRANSDUCERSMATHEMATICAL MODELINGSPEECH MOTOR COORDINATEShttps://purl.org/becyt/ford/1.3https://purl.org/becyt/ford/1The sounds of all languages are described by a finite set of symbols, which are extracted from the continuum of sounds produced by the vocal organ. How the discrete phonemic identity is encoded in the continuous movements producing speech remains an open question for the experimental phonology. In this work, this question is assessed by using Hall-effect transducers and magnets - mounted on the tongue, lips, and jaw - to track the kinematics of the oral tract during the vocalization of vowel-consonant-vowel structures. Using a threshold strategy, the time traces of the transducers were converted into discrete motor coordinates unambiguously associated with the vocalized phonemes. Furthermore, the signals of the transducers combined with the discretization strategy were used to drive a low-dimensional vocal model capable of synthesizing intelligible speech. The current work not only assesses a relevant inquiry of the biology of language, but also demonstrates the performance of the experimental technique to monitor the displacement of the main articulators of the vocal tract while speaking. This novel electronic device represents an economic and portable option to the standard systems used to study the vocal tract movements.Fil: Assaneo, María Florencia. University of New York; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; ArgentinaFil: Ramírez Butavand, Daniela. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; ArgentinaFil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; ArgentinaFil: Mindlin, Bernardo Gabriel. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; ArgentinaFrontiers Media2019-04info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/147443Assaneo, María Florencia; Ramírez Butavand, Daniela; Trevisan, Marcos Alberto; Mindlin, Bernardo Gabriel; Discrete Anatomical Coordinates for Speech Production and Synthesis; Frontiers Media; Frontiers in Communication; 4; 4-2019; 1-132297-900XCONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/url/https://www.frontiersin.org/article/10.3389/fcomm.2019.00013/fullinfo:eu-repo/semantics/altIdentifier/doi/10.3389/fcomm.2019.00013info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-10-29T12:50:25Zoai:ri.conicet.gov.ar:11336/147443instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-10-29 12:50:26.199CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Discrete Anatomical Coordinates for Speech Production and Synthesis
title Discrete Anatomical Coordinates for Speech Production and Synthesis
spellingShingle Discrete Anatomical Coordinates for Speech Production and Synthesis
Assaneo, María Florencia
ARTICULATORY SPEECH SYNTHESIZER
EXPERIMENTAL PHONOLOGY
HALL-EFFECT TRANSDUCERS
MATHEMATICAL MODELING
SPEECH MOTOR COORDINATES
title_short Discrete Anatomical Coordinates for Speech Production and Synthesis
title_full Discrete Anatomical Coordinates for Speech Production and Synthesis
title_fullStr Discrete Anatomical Coordinates for Speech Production and Synthesis
title_full_unstemmed Discrete Anatomical Coordinates for Speech Production and Synthesis
title_sort Discrete Anatomical Coordinates for Speech Production and Synthesis
dc.creator.none.fl_str_mv Assaneo, María Florencia
Ramírez Butavand, Daniela
Trevisan, Marcos Alberto
Mindlin, Bernardo Gabriel
author Assaneo, María Florencia
author_facet Assaneo, María Florencia
Ramírez Butavand, Daniela
Trevisan, Marcos Alberto
Mindlin, Bernardo Gabriel
author_role author
author2 Ramírez Butavand, Daniela
Trevisan, Marcos Alberto
Mindlin, Bernardo Gabriel
author2_role author
author
author
dc.subject.none.fl_str_mv ARTICULATORY SPEECH SYNTHESIZER
EXPERIMENTAL PHONOLOGY
HALL-EFFECT TRANSDUCERS
MATHEMATICAL MODELING
SPEECH MOTOR COORDINATES
topic ARTICULATORY SPEECH SYNTHESIZER
EXPERIMENTAL PHONOLOGY
HALL-EFFECT TRANSDUCERS
MATHEMATICAL MODELING
SPEECH MOTOR COORDINATES
purl_subject.fl_str_mv https://purl.org/becyt/ford/1.3
https://purl.org/becyt/ford/1
dc.description.none.fl_txt_mv The sounds of all languages are described by a finite set of symbols, which are extracted from the continuum of sounds produced by the vocal organ. How the discrete phonemic identity is encoded in the continuous movements producing speech remains an open question for the experimental phonology. In this work, this question is assessed by using Hall-effect transducers and magnets - mounted on the tongue, lips, and jaw - to track the kinematics of the oral tract during the vocalization of vowel-consonant-vowel structures. Using a threshold strategy, the time traces of the transducers were converted into discrete motor coordinates unambiguously associated with the vocalized phonemes. Furthermore, the signals of the transducers combined with the discretization strategy were used to drive a low-dimensional vocal model capable of synthesizing intelligible speech. The current work not only assesses a relevant inquiry of the biology of language, but also demonstrates the performance of the experimental technique to monitor the displacement of the main articulators of the vocal tract while speaking. This novel electronic device represents an economic and portable option to the standard systems used to study the vocal tract movements.
Fil: Assaneo, María Florencia. University of New York; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Ramírez Butavand, Daniela. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Trevisan, Marcos Alberto. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
Fil: Mindlin, Bernardo Gabriel. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Ciudad Universitaria. Instituto de Física de Buenos Aires. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Instituto de Física de Buenos Aires; Argentina
description The sounds of all languages are described by a finite set of symbols, which are extracted from the continuum of sounds produced by the vocal organ. How the discrete phonemic identity is encoded in the continuous movements producing speech remains an open question for the experimental phonology. In this work, this question is assessed by using Hall-effect transducers and magnets - mounted on the tongue, lips, and jaw - to track the kinematics of the oral tract during the vocalization of vowel-consonant-vowel structures. Using a threshold strategy, the time traces of the transducers were converted into discrete motor coordinates unambiguously associated with the vocalized phonemes. Furthermore, the signals of the transducers combined with the discretization strategy were used to drive a low-dimensional vocal model capable of synthesizing intelligible speech. The current work not only assesses a relevant inquiry of the biology of language, but also demonstrates the performance of the experimental technique to monitor the displacement of the main articulators of the vocal tract while speaking. This novel electronic device represents an economic and portable option to the standard systems used to study the vocal tract movements.
publishDate 2019
dc.date.none.fl_str_mv 2019-04
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/147443
Assaneo, María Florencia; Ramírez Butavand, Daniela; Trevisan, Marcos Alberto; Mindlin, Bernardo Gabriel; Discrete Anatomical Coordinates for Speech Production and Synthesis; Frontiers Media; Frontiers in Communication; 4; 4-2019; 1-13
2297-900X
CONICET Digital
CONICET
url http://hdl.handle.net/11336/147443
identifier_str_mv Assaneo, María Florencia; Ramírez Butavand, Daniela; Trevisan, Marcos Alberto; Mindlin, Bernardo Gabriel; Discrete Anatomical Coordinates for Speech Production and Synthesis; Frontiers Media; Frontiers in Communication; 4; 4-2019; 1-13
2297-900X
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/https://www.frontiersin.org/article/10.3389/fcomm.2019.00013/full
info:eu-repo/semantics/altIdentifier/doi/10.3389/fcomm.2019.00013
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Frontiers Media
publisher.none.fl_str_mv Frontiers Media
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1847427581989617664
score 13.10058

Publicaciones similares