Legal document retrieval is heavily influenced by how documents are segmented, or”chunked,” for processing within Retrieval-Augmented Generation (RAG) systems. This paper investigates the effectiveness of three automated chunking techniques — Simple Text Splitting, Recursive Text Splitting using regular expressions (regex), and Semantic Chunking — within the legal domain, using the General Data Protection Regulation (GDPR) as a testbed. The chunking methods were evaluated based on their semantic relevance to a set of seventeen legal questions and their corresponding relevant sections, with performance measured using cosine similarity metrics. Results show that none of the methods consistently produced high semantic relevance on an individual chunk level: Git Hub link.

Ferraris, A.F., Audrito, D., Siragusa, G., Piovano, A. (2024). Legal Chunking: Evaluating Methods for Effective Legal Text Retrieval. NIEUWE HEMWEG 6B, 1013 BG AMSTERDAM, NETHERLANDS : IOS Press BV [10.3233/FAIA241255].

Legal Chunking: Evaluating Methods for Effective Legal Text Retrieval

Andrea Filippo Ferraris
Primo
;
Davide Audrito;
2024

Abstract

Legal document retrieval is heavily influenced by how documents are segmented, or”chunked,” for processing within Retrieval-Augmented Generation (RAG) systems. This paper investigates the effectiveness of three automated chunking techniques — Simple Text Splitting, Recursive Text Splitting using regular expressions (regex), and Semantic Chunking — within the legal domain, using the General Data Protection Regulation (GDPR) as a testbed. The chunking methods were evaluated based on their semantic relevance to a set of seventeen legal questions and their corresponding relevant sections, with performance measured using cosine similarity metrics. Results show that none of the methods consistently produced high semantic relevance on an individual chunk level: Git Hub link.
2024
Frontiers in Artificial Intelligence and Applications
275
281
Ferraris, A.F., Audrito, D., Siragusa, G., Piovano, A. (2024). Legal Chunking: Evaluating Methods for Effective Legal Text Retrieval. NIEUWE HEMWEG 6B, 1013 BG AMSTERDAM, NETHERLANDS : IOS Press BV [10.3233/FAIA241255].
Ferraris, Andrea Filippo; Audrito, Davide; Siragusa, Giovanni; Piovano, Alessandro
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/1042362
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
  • OpenAlex ND
social impact