The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and---for the first time---it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.

Barron Cedeno, A., Alam, F., Caselli, T., Da San Martino, G., Elsayed, T., Galassi, A., et al. (2023). The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority. Springer Nature [10.1007/978-3-031-28241-6_59].

The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority

Barron Cedeno, Alberto
Primo
;
Caselli, Tommaso;Galassi, Andrea;Ruggeri, Federico;
2023

Abstract

The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and---for the first time---it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.
2023
Advances in Information Retrieval
506
517
Barron Cedeno, A., Alam, F., Caselli, T., Da San Martino, G., Elsayed, T., Galassi, A., et al. (2023). The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority. Springer Nature [10.1007/978-3-031-28241-6_59].
Barron Cedeno, Alberto ; Alam, Firoj; Caselli, Tommaso; Da San Martino, Giovanni; Elsayed, Tamer; Galassi, Andrea; Haouari, Fatima; Ruggeri, Federico;...espandi
File in questo prodotto:
File Dimensione Formato  
The-CLEF-2023-CheckThat!-Lab-Checkworthiness,-Subjectivity,-Political Bias,-Factuality,-and-Authority.pdf

accesso aperto

Tipo: Versione (PDF) editoriale
Licenza: Licenza per accesso libero gratuito
Dimensione 733.36 kB
Formato Adobe PDF
733.36 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/920671
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 37
  • ???jsp.display-item.citation.isi??? 7
social impact