This paper presents a novel framework for evaluating Neural Language Models' linguistic abilities using a constructionist approach. Not only is the usage-based model in line with the un- derlying stochastic philosophy of neural architectures, but it also allows the linguist to keep meaning as a determinant factor in the analysis. We outline the framework and present two possible scenarios for its application.

Pannitto, L., Herbelot, A. (2023). CALaMo: a Constructionist Assessment of Language Models. Washington, D.C. : Association for Computational Linguistics.

CALaMo: a Constructionist Assessment of Language Models

Pannitto, Ludovica
Primo
;
2023

Abstract

This paper presents a novel framework for evaluating Neural Language Models' linguistic abilities using a constructionist approach. Not only is the usage-based model in line with the un- derlying stochastic philosophy of neural architectures, but it also allows the linguist to keep meaning as a determinant factor in the analysis. We outline the framework and present two possible scenarios for its application.
2023
Proceedings of the First International Workshop on Construction Grammars and NLP (CxGs+NLP, GURT/SyntaxFest 2023)
21
30
Pannitto, L., Herbelot, A. (2023). CALaMo: a Constructionist Assessment of Language Models. Washington, D.C. : Association for Computational Linguistics.
Pannitto, Ludovica; Herbelot, Aurelie
File in questo prodotto:
File Dimensione Formato  
2023.cxgsnlp-1.3.pdf

accesso aperto

Tipo: Versione (PDF) editoriale
Licenza: Creative commons
Dimensione 351.54 kB
Formato Adobe PDF
351.54 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/940477
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact