PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo

Autores
Manoiloff, Laura Maria Victoria; Vivas, Leticia Yanina; Andreini, Silvia Constanza; Linares, Nicolás; Del Boca, Laura; Segui, Juan
Año de publicación
2018
Idioma
español castellano
Tipo de recurso
artículo
Estado
versión publicada
Descripción
En este trabajo se presenta el diseño y validación de la Prueba Argentina Psicolingüística de Denominación de Imágenes (PAPDI). La misma tiene dos características que la diferencian de las pruebas actualmente disponibles en nuestro medio: a) el hecho de que los estímulos han sido seleccionados y ordenados controlando ciertas variables psicolingüísticas de probada influencia en esta tarea, como Complejidad visual, Concordancia con la Imagen, Variabilidad de la imagen, Familiaridad, Acuerdo en el nombre, Edad de adquisición y Frecuencia de uso, y toman sus valores de normas argentinas; y b) las claves semánticas se han elaborado de acuerdo con normas de producción de atributos semánticos también recolectadas en nuestro país. Se analizaron las propiedades psicométricas mediante el estudio de pacientes con enfermedad de Alzheimer, con lesiones cerebrales focales y participantes sin patología neurológica. Se buscaron evidencias de validez de criterio mediante el análisis de grupos contrastados y la correlación con el test de Boston. A su vez, se estudió la confiabilidad de las puntuaciones por dos métodos: consistencia interna y test-retest. También se analizó la capacidad de discriminación entre pacientes con y sin afasia mediante curvas ROC. Se estudió asimismo la influencia de las variables socio-demográficas. Los resultados indicaron que la PAPDI presenta cualidades psicométricas aceptables para su uso en la clínica.
In the current paper, first part, we present the design and development of the Argentinean Psycholinguistic Image Naming Test (PAPDI). This test has two characteristics that make it different andreini, linares, Fuentes leiza, del Boca y seguí from those currently available in our country: (a) the stimuli have been selected by controlling the variables that affect the stages of visual analysis and image recognition (Visual Complexity and Image Agreement) and conceptual knowledge (Image Variability and Familiarity) of the drawing of the object; and the variables (Frequency of Use and Age of Acquisition) that affect the stage that seeks to evaluate the test were manipulated: activation, selection and retrieval of the lexical label (phonological form of the name), to generate a gradient of difficulty in the items of the test. However, the variable Naming Agreement, that also affects this stage, was controlled to selected pictures with only one predominating name. The quantification of these factors by means of specific variables is influenced by the cultural and linguistic context from which they were obtained, consequently we took their values from Argen- tinean normative data base and (b) semantic cues were elaborated according to semantic feature production norms also from Argentina. The phonological cues corresponded to the first sylable of the object's name. Their use allows to generate more precise hypotheses about the lo- cation of the deficit and allows to infer relevant information about the cognitive profile. There- fore, the process of construction and development of the test is presented, showing how these particularities were taken into consideration, which variables were controlled and which were manipulated, and their justification. For the design of the test 62, black and white pictures were originally selected from the 400 pictures taken from Cycowicz’s set (of frequent use in Experi- mental Psychology and Neuropsychology). They correspond to concrete concepts from different semantic categories belonging to both living and non living domains. The criteria used to include those images were that they were moderately complex (in quantity of lines and details), mod- erately familiar and that they had a mean image variability value. They had to have a medium to high concordance degree between the mental image and its corresponding representation. Be- sides, these images had to have a naming agreement superior to 80%. To conform the first version of the test, the 62 images selected were ordered according to the variable Age of Acquisition and each image was assigned its corresponding semantic and phonological cues. The former were extracted from the Argentinean norms considering the most relevant features. The second consisted on the word ́s first syllable. A pilot study with healthy population (n = 50), of different ages, both sexes and three educational levels, was carried out through which 30 images were selected that constituted the test ́s final version. The deleted items were: figures that did not evoke a univocal response, that is, they were easily con- fused with other objects; figures that had more than one acceptable answer although not all were correct; and items that presented a ceiling effect where the scores accumulated in high scores and did not allow to discriminate the participants' ability to select, retrieve and produce a word (only 25 and 30% of the items were retained). In the test ́s final version, the items were reordered according to the Age of Acquisition and Frequency values and their difficulty in naming (following the percentage of successes in the spontaneous response). And images that were contain in another naming tests were deleted. The test is short enough for use in the clinic and freely accessible. The second part of the paper presents the psychometric studies that provide evidence of their relevance and validity.
Fil: Manoiloff, Laura Maria Victoria. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Vivas, Leticia Yanina. Universidad Nacional de Mar del Plata. Facultad de Psicología. Instituto de Psicología Básica, Aplicada y Tecnología. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Psicología Básica, Aplicada y Tecnología; Argentina
Fil: Andreini, C.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Linares, N.. Hospital Interzonal General de Agudos `oscar Alende´; Argentina
Fil: Fuentes, M.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Del Boca, M. L.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Segui, J.. Universidad Rene Descartes; Francia
Materia
Prueba de denominación de imágenes
Normas argentinas
Validación
Memoria semántica
Lenguaje
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/99002

id CONICETDig_8bcce257e117ae3fa7d3b53f390d467f
oai_identifier_str oai:ri.conicet.gov.ar:11336/99002
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y DesarrolloPAPDI: Argentinean Psycholinguistic Image Naming Test. Design and DevelopmentManoiloff, Laura Maria VictoriaVivas, Leticia YaninaAndreini, Silvia ConstanzaLinares, NicolásDel Boca, LauraSegui, JuanPrueba de denominación de imágenesNormas argentinasValidaciónMemoria semánticaLenguajehttps://purl.org/becyt/ford/5.1https://purl.org/becyt/ford/5En este trabajo se presenta el diseño y validación de la Prueba Argentina Psicolingüística de Denominación de Imágenes (PAPDI). La misma tiene dos características que la diferencian de las pruebas actualmente disponibles en nuestro medio: a) el hecho de que los estímulos han sido seleccionados y ordenados controlando ciertas variables psicolingüísticas de probada influencia en esta tarea, como Complejidad visual, Concordancia con la Imagen, Variabilidad de la imagen, Familiaridad, Acuerdo en el nombre, Edad de adquisición y Frecuencia de uso, y toman sus valores de normas argentinas; y b) las claves semánticas se han elaborado de acuerdo con normas de producción de atributos semánticos también recolectadas en nuestro país. Se analizaron las propiedades psicométricas mediante el estudio de pacientes con enfermedad de Alzheimer, con lesiones cerebrales focales y participantes sin patología neurológica. Se buscaron evidencias de validez de criterio mediante el análisis de grupos contrastados y la correlación con el test de Boston. A su vez, se estudió la confiabilidad de las puntuaciones por dos métodos: consistencia interna y test-retest. También se analizó la capacidad de discriminación entre pacientes con y sin afasia mediante curvas ROC. Se estudió asimismo la influencia de las variables socio-demográficas. Los resultados indicaron que la PAPDI presenta cualidades psicométricas aceptables para su uso en la clínica.In the current paper, first part, we present the design and development of the Argentinean Psycholinguistic Image Naming Test (PAPDI). This test has two characteristics that make it different andreini, linares, Fuentes leiza, del Boca y seguí from those currently available in our country: (a) the stimuli have been selected by controlling the variables that affect the stages of visual analysis and image recognition (Visual Complexity and Image Agreement) and conceptual knowledge (Image Variability and Familiarity) of the drawing of the object; and the variables (Frequency of Use and Age of Acquisition) that affect the stage that seeks to evaluate the test were manipulated: activation, selection and retrieval of the lexical label (phonological form of the name), to generate a gradient of difficulty in the items of the test. However, the variable Naming Agreement, that also affects this stage, was controlled to selected pictures with only one predominating name. The quantification of these factors by means of specific variables is influenced by the cultural and linguistic context from which they were obtained, consequently we took their values from Argen- tinean normative data base and (b) semantic cues were elaborated according to semantic feature production norms also from Argentina. The phonological cues corresponded to the first sylable of the object's name. Their use allows to generate more precise hypotheses about the lo- cation of the deficit and allows to infer relevant information about the cognitive profile. There- fore, the process of construction and development of the test is presented, showing how these particularities were taken into consideration, which variables were controlled and which were manipulated, and their justification. For the design of the test 62, black and white pictures were originally selected from the 400 pictures taken from Cycowicz’s set (of frequent use in Experi- mental Psychology and Neuropsychology). They correspond to concrete concepts from different semantic categories belonging to both living and non living domains. The criteria used to include those images were that they were moderately complex (in quantity of lines and details), mod- erately familiar and that they had a mean image variability value. They had to have a medium to high concordance degree between the mental image and its corresponding representation. Be- sides, these images had to have a naming agreement superior to 80%. To conform the first version of the test, the 62 images selected were ordered according to the variable Age of Acquisition and each image was assigned its corresponding semantic and phonological cues. The former were extracted from the Argentinean norms considering the most relevant features. The second consisted on the word ́s first syllable. A pilot study with healthy population (n = 50), of different ages, both sexes and three educational levels, was carried out through which 30 images were selected that constituted the test ́s final version. The deleted items were: figures that did not evoke a univocal response, that is, they were easily con- fused with other objects; figures that had more than one acceptable answer although not all were correct; and items that presented a ceiling effect where the scores accumulated in high scores and did not allow to discriminate the participants' ability to select, retrieve and produce a word (only 25 and 30% of the items were retained). In the test ́s final version, the items were reordered according to the Age of Acquisition and Frequency values and their difficulty in naming (following the percentage of successes in the spontaneous response). And images that were contain in another naming tests were deleted. The test is short enough for use in the clinic and freely accessible. The second part of the paper presents the psychometric studies that provide evidence of their relevance and validity.Fil: Manoiloff, Laura Maria Victoria. Universidad Nacional de Córdoba. Facultad de Psicología; ArgentinaFil: Vivas, Leticia Yanina. Universidad Nacional de Mar del Plata. Facultad de Psicología. Instituto de Psicología Básica, Aplicada y Tecnología. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Psicología Básica, Aplicada y Tecnología; ArgentinaFil: Andreini, C.. Universidad Nacional de Córdoba. Facultad de Psicología; ArgentinaFil: Linares, N.. Hospital Interzonal General de Agudos `oscar Alende´; ArgentinaFil: Fuentes, M.. Universidad Nacional de Córdoba. Facultad de Psicología; ArgentinaFil: Del Boca, M. L.. Universidad Nacional de Córdoba. Facultad de Psicología; ArgentinaFil: Segui, J.. Universidad Rene Descartes; FranciaCentro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA)2018-08info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/zipapplication/pdfhttp://hdl.handle.net/11336/99002Manoiloff, Laura Maria Victoria; Vivas, Leticia Yanina; Andreini, Silvia Constanza; Linares, Nicolás; Del Boca, Laura; et al.; PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo; Centro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA); Interdisciplinaria; 35; 1; 8-2018; 105-1181668-7027CONICET DigitalCONICETspainfo:eu-repo/semantics/altIdentifier/url/http://www.ciipme-conicet.gov.ar/ojs/index.php?journal=interdisciplinaria&page=article&op=download&path%5B%5D=453&path%5B%5D=64info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T10:29:26Zoai:ri.conicet.gov.ar:11336/99002instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 10:29:27.054CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
PAPDI: Argentinean Psycholinguistic Image Naming Test. Design and Development
title PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
spellingShingle PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
Manoiloff, Laura Maria Victoria
Prueba de denominación de imágenes
Normas argentinas
Validación
Memoria semántica
Lenguaje
title_short PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
title_full PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
title_fullStr PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
title_full_unstemmed PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
title_sort PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo
dc.creator.none.fl_str_mv Manoiloff, Laura Maria Victoria
Vivas, Leticia Yanina
Andreini, Silvia Constanza
Linares, Nicolás
Del Boca, Laura
Segui, Juan
author Manoiloff, Laura Maria Victoria
author_facet Manoiloff, Laura Maria Victoria
Vivas, Leticia Yanina
Andreini, Silvia Constanza
Linares, Nicolás
Del Boca, Laura
Segui, Juan
author_role author
author2 Vivas, Leticia Yanina
Andreini, Silvia Constanza
Linares, Nicolás
Del Boca, Laura
Segui, Juan
author2_role author
author
author
author
author
dc.subject.none.fl_str_mv Prueba de denominación de imágenes
Normas argentinas
Validación
Memoria semántica
Lenguaje
topic Prueba de denominación de imágenes
Normas argentinas
Validación
Memoria semántica
Lenguaje
purl_subject.fl_str_mv https://purl.org/becyt/ford/5.1
https://purl.org/becyt/ford/5
dc.description.none.fl_txt_mv En este trabajo se presenta el diseño y validación de la Prueba Argentina Psicolingüística de Denominación de Imágenes (PAPDI). La misma tiene dos características que la diferencian de las pruebas actualmente disponibles en nuestro medio: a) el hecho de que los estímulos han sido seleccionados y ordenados controlando ciertas variables psicolingüísticas de probada influencia en esta tarea, como Complejidad visual, Concordancia con la Imagen, Variabilidad de la imagen, Familiaridad, Acuerdo en el nombre, Edad de adquisición y Frecuencia de uso, y toman sus valores de normas argentinas; y b) las claves semánticas se han elaborado de acuerdo con normas de producción de atributos semánticos también recolectadas en nuestro país. Se analizaron las propiedades psicométricas mediante el estudio de pacientes con enfermedad de Alzheimer, con lesiones cerebrales focales y participantes sin patología neurológica. Se buscaron evidencias de validez de criterio mediante el análisis de grupos contrastados y la correlación con el test de Boston. A su vez, se estudió la confiabilidad de las puntuaciones por dos métodos: consistencia interna y test-retest. También se analizó la capacidad de discriminación entre pacientes con y sin afasia mediante curvas ROC. Se estudió asimismo la influencia de las variables socio-demográficas. Los resultados indicaron que la PAPDI presenta cualidades psicométricas aceptables para su uso en la clínica.
In the current paper, first part, we present the design and development of the Argentinean Psycholinguistic Image Naming Test (PAPDI). This test has two characteristics that make it different andreini, linares, Fuentes leiza, del Boca y seguí from those currently available in our country: (a) the stimuli have been selected by controlling the variables that affect the stages of visual analysis and image recognition (Visual Complexity and Image Agreement) and conceptual knowledge (Image Variability and Familiarity) of the drawing of the object; and the variables (Frequency of Use and Age of Acquisition) that affect the stage that seeks to evaluate the test were manipulated: activation, selection and retrieval of the lexical label (phonological form of the name), to generate a gradient of difficulty in the items of the test. However, the variable Naming Agreement, that also affects this stage, was controlled to selected pictures with only one predominating name. The quantification of these factors by means of specific variables is influenced by the cultural and linguistic context from which they were obtained, consequently we took their values from Argen- tinean normative data base and (b) semantic cues were elaborated according to semantic feature production norms also from Argentina. The phonological cues corresponded to the first sylable of the object's name. Their use allows to generate more precise hypotheses about the lo- cation of the deficit and allows to infer relevant information about the cognitive profile. There- fore, the process of construction and development of the test is presented, showing how these particularities were taken into consideration, which variables were controlled and which were manipulated, and their justification. For the design of the test 62, black and white pictures were originally selected from the 400 pictures taken from Cycowicz’s set (of frequent use in Experi- mental Psychology and Neuropsychology). They correspond to concrete concepts from different semantic categories belonging to both living and non living domains. The criteria used to include those images were that they were moderately complex (in quantity of lines and details), mod- erately familiar and that they had a mean image variability value. They had to have a medium to high concordance degree between the mental image and its corresponding representation. Be- sides, these images had to have a naming agreement superior to 80%. To conform the first version of the test, the 62 images selected were ordered according to the variable Age of Acquisition and each image was assigned its corresponding semantic and phonological cues. The former were extracted from the Argentinean norms considering the most relevant features. The second consisted on the word ́s first syllable. A pilot study with healthy population (n = 50), of different ages, both sexes and three educational levels, was carried out through which 30 images were selected that constituted the test ́s final version. The deleted items were: figures that did not evoke a univocal response, that is, they were easily con- fused with other objects; figures that had more than one acceptable answer although not all were correct; and items that presented a ceiling effect where the scores accumulated in high scores and did not allow to discriminate the participants' ability to select, retrieve and produce a word (only 25 and 30% of the items were retained). In the test ́s final version, the items were reordered according to the Age of Acquisition and Frequency values and their difficulty in naming (following the percentage of successes in the spontaneous response). And images that were contain in another naming tests were deleted. The test is short enough for use in the clinic and freely accessible. The second part of the paper presents the psychometric studies that provide evidence of their relevance and validity.
Fil: Manoiloff, Laura Maria Victoria. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Vivas, Leticia Yanina. Universidad Nacional de Mar del Plata. Facultad de Psicología. Instituto de Psicología Básica, Aplicada y Tecnología. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Psicología Básica, Aplicada y Tecnología; Argentina
Fil: Andreini, C.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Linares, N.. Hospital Interzonal General de Agudos `oscar Alende´; Argentina
Fil: Fuentes, M.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Del Boca, M. L.. Universidad Nacional de Córdoba. Facultad de Psicología; Argentina
Fil: Segui, J.. Universidad Rene Descartes; Francia
description En este trabajo se presenta el diseño y validación de la Prueba Argentina Psicolingüística de Denominación de Imágenes (PAPDI). La misma tiene dos características que la diferencian de las pruebas actualmente disponibles en nuestro medio: a) el hecho de que los estímulos han sido seleccionados y ordenados controlando ciertas variables psicolingüísticas de probada influencia en esta tarea, como Complejidad visual, Concordancia con la Imagen, Variabilidad de la imagen, Familiaridad, Acuerdo en el nombre, Edad de adquisición y Frecuencia de uso, y toman sus valores de normas argentinas; y b) las claves semánticas se han elaborado de acuerdo con normas de producción de atributos semánticos también recolectadas en nuestro país. Se analizaron las propiedades psicométricas mediante el estudio de pacientes con enfermedad de Alzheimer, con lesiones cerebrales focales y participantes sin patología neurológica. Se buscaron evidencias de validez de criterio mediante el análisis de grupos contrastados y la correlación con el test de Boston. A su vez, se estudió la confiabilidad de las puntuaciones por dos métodos: consistencia interna y test-retest. También se analizó la capacidad de discriminación entre pacientes con y sin afasia mediante curvas ROC. Se estudió asimismo la influencia de las variables socio-demográficas. Los resultados indicaron que la PAPDI presenta cualidades psicométricas aceptables para su uso en la clínica.
publishDate 2018
dc.date.none.fl_str_mv 2018-08
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/99002
Manoiloff, Laura Maria Victoria; Vivas, Leticia Yanina; Andreini, Silvia Constanza; Linares, Nicolás; Del Boca, Laura; et al.; PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo; Centro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA); Interdisciplinaria; 35; 1; 8-2018; 105-118
1668-7027
CONICET Digital
CONICET
url http://hdl.handle.net/11336/99002
identifier_str_mv Manoiloff, Laura Maria Victoria; Vivas, Leticia Yanina; Andreini, Silvia Constanza; Linares, Nicolás; Del Boca, Laura; et al.; PAPDI: Prueba Argentina Psicolingüística de Denominación de Imágenes. Construcción y Desarrollo; Centro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA); Interdisciplinaria; 35; 1; 8-2018; 105-118
1668-7027
CONICET Digital
CONICET
dc.language.none.fl_str_mv spa
language spa
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/url/http://www.ciipme-conicet.gov.ar/ojs/index.php?journal=interdisciplinaria&page=article&op=download&path%5B%5D=453&path%5B%5D=64
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/zip
application/pdf
dc.publisher.none.fl_str_mv Centro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA)
publisher.none.fl_str_mv Centro Interamericano de Investigaciones Psicológicas y Ciencias Afines (CIIPCA)
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844614300915728384
score 13.070432