A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

• Autores: Dematties, Dario Jesus; Rizzi, Silvio; Thiruvathukal, George K.; Pérez Cesaretti, Mauricio David; Wainselboim, Alejandro Javier; Zanutto, Bonifacio Silvano
• Año de publicación: 2020
• Idioma: inglés
• Tipo de recurso: artículo
• Materia: CORTICAL DYNAMICS; UNSUPERVISED LEARNING; BRAIN-INSPIRED ARTIFICIAL NEURAL NETWORKS; GRAMMAR EMERGENCE
• Institución: Consejo Nacional de Investigaciones Científicas y Técnicas

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.
Fil: Dematties, Dario Jesus. Universidad de Buenos Aires. Facultad de Ingeniería. Instituto de Ingeniería Biomédica; Argentina
Fil: Rizzi, Silvio. Argonne National Laboratory; Estados Unidos
Fil: Thiruvathukal, George K.. University of Chicago; Estados Unidos. Argonne National Laboratory; Estados Unidos
Fil: Pérez Cesaretti, Mauricio David. Uppsala Universitet.; Suecia
Fil: Wainselboim, Alejandro Javier. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza. Instituto de Ciencias Humanas, Sociales y Ambientales; Argentina
Fil: Zanutto, Bonifacio Silvano. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Biología y Medicina Experimental. Fundación de Instituto de Biología y Medicina Experimental. Instituto de Biología y Medicina Experimental; Argentina. Universidad de Buenos Aires. Facultad de Ingeniería. Instituto de Ingeniería Biomédica; Argentina