World university rankings have had an impact on academic competition worldwide. The comparability of ranking results depends on how data is collected within each university. When data concepts are interpreted differently, data variety is introduced and ranking results cannot be used in a meaningful manner. In this case study, the effect of semantic harmonisation of the data concepts of the Times Higher Education World University Ranking is evaluated. Based on two independent initiatives, in Italy and in Belgium, the data and results of this ranking before and after interuniversity harmonisation of data collection are compared. This study demonstrates that, despite the data definitions provided by the ranking organisation, the data concepts ‘academic staff’ and ‘students’ are interpreted differently within each university. These differences can affect how universities are positioned relative to each other in ranking tables. A profound level of semantic harmonisation is then required to ensure semantically comparable data.

Fuzzy data definitions distort fair comparability of universities in university rankings: results from Italy and Belgium on the Times Higher Education Ranking / Poelmans H.; Sacchetti L.; Vancauwenbergh S.; Piazza S.. - In: QUALITY IN HIGHER EDUCATION. - ISSN 1353-8322. - ELETTRONICO. - 1:(2023), pp. 1-22. [10.1080/13538322.2023.2173967]

Fuzzy data definitions distort fair comparability of universities in university rankings: results from Italy and Belgium on the Times Higher Education Ranking

Sacchetti L.;Piazza S.
2023

Abstract

World university rankings have had an impact on academic competition worldwide. The comparability of ranking results depends on how data is collected within each university. When data concepts are interpreted differently, data variety is introduced and ranking results cannot be used in a meaningful manner. In this case study, the effect of semantic harmonisation of the data concepts of the Times Higher Education World University Ranking is evaluated. Based on two independent initiatives, in Italy and in Belgium, the data and results of this ranking before and after interuniversity harmonisation of data collection are compared. This study demonstrates that, despite the data definitions provided by the ranking organisation, the data concepts ‘academic staff’ and ‘students’ are interpreted differently within each university. These differences can affect how universities are positioned relative to each other in ranking tables. A profound level of semantic harmonisation is then required to ensure semantically comparable data.
2023
Fuzzy data definitions distort fair comparability of universities in university rankings: results from Italy and Belgium on the Times Higher Education Ranking / Poelmans H.; Sacchetti L.; Vancauwenbergh S.; Piazza S.. - In: QUALITY IN HIGHER EDUCATION. - ISSN 1353-8322. - ELETTRONICO. - 1:(2023), pp. 1-22. [10.1080/13538322.2023.2173967]
Poelmans H.; Sacchetti L.; Vancauwenbergh S.; Piazza S.
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/921672
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact