There are many different relatedness measures, based for instance on citation relations or textual similarity, that can be used to cluster scientific publications. We propose a principled methodology for evaluating the accuracy of clustering solutions obtained using these relatedness measures. We formally show that the proposed methodology has an important consistency property. The empirical analyses that we present are based on publications in the fields of cell biology, condensed matter physics, and economics. Using the BM25 text-based relatedness measure as the evaluation criterion, we find that bibliographic coupling relations yield more accurate clustering solutions than direct citation relations and cocitation relations. The so-called extended direct citation approach performs similarly to or slightly better than bibliographic coupling in terms of the accuracy of the resulting clustering solutions. The other way around, using a citation-based relatedness measure as evaluation criterion, BM25 turns out to yield more accurate clustering solutions than other text-based relatedness measures.

A principled methodology for comparing relatedness measures for clustering publications / Waltman L.; Boyack K.W.; Colavizza G.; van Eck N.J.. - In: QUANTITATIVE SCIENCE STUDIES. - ISSN 2641-3337. - ELETTRONICO. - 1:2(2020), pp. 691-713. [10.1162/qss_a_00035]

A principled methodology for comparing relatedness measures for clustering publications

Colavizza G.;
2020

Abstract

There are many different relatedness measures, based for instance on citation relations or textual similarity, that can be used to cluster scientific publications. We propose a principled methodology for evaluating the accuracy of clustering solutions obtained using these relatedness measures. We formally show that the proposed methodology has an important consistency property. The empirical analyses that we present are based on publications in the fields of cell biology, condensed matter physics, and economics. Using the BM25 text-based relatedness measure as the evaluation criterion, we find that bibliographic coupling relations yield more accurate clustering solutions than direct citation relations and cocitation relations. The so-called extended direct citation approach performs similarly to or slightly better than bibliographic coupling in terms of the accuracy of the resulting clustering solutions. The other way around, using a citation-based relatedness measure as evaluation criterion, BM25 turns out to yield more accurate clustering solutions than other text-based relatedness measures.
2020
A principled methodology for comparing relatedness measures for clustering publications / Waltman L.; Boyack K.W.; Colavizza G.; van Eck N.J.. - In: QUANTITATIVE SCIENCE STUDIES. - ISSN 2641-3337. - ELETTRONICO. - 1:2(2020), pp. 691-713. [10.1162/qss_a_00035]
Waltman L.; Boyack K.W.; Colavizza G.; van Eck N.J.
File in questo prodotto:
File Dimensione Formato  
qss_a_00035.pdf

accesso aperto

Descrizione: Articolo
Tipo: Versione (PDF) editoriale
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione (CCBY)
Dimensione 822.46 kB
Formato Adobe PDF
822.46 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/948753
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 29
social impact