The Italian National Scientific Qualification (ASN) was introduced in 2010 as part of a major reform of the national university system. Under the new regulation, the scientific qualification for a specific role (associate or full professor) and field of study is required to apply for a permanent professor position. The ASN is peculiar since it makes use of bibliometric indicators with associated thresholds as one of the parameters used to assess applicants. The first round of the ASN received 59,149 applications, and the results have been made publicly available for a short period of time, including the values of the quantitative indicators for each applicant. The availability of this wealth of information provides an opportunity to draw a fairly detailed picture of a nation-wide evaluation exercise, and to study the impact of the bibliometric indicators on the qualification results. In this paper we provide a first account of the Italian National Scientific Qualification from a quantitative point of view. We show that significant differences exist among scientific disciplines, in particular with respect to the fraction of qualified applicants, that can not be easily explained. Furthermore, we describe some issues related to the definition and use of the bibliometric indicators and the corresponding thresholds. Our analysis aims at drawing attention to potential problems that should be addressed by decision-makers in future rounds of the ASN.

Moreno Marzolla (2015). Quantitative Analysis of the Italian National Scientific Qualification. JOURNAL OF INFORMETRICS, 9(2), 285-316 [10.1016/j.joi.2015.02.006].

Quantitative Analysis of the Italian National Scientific Qualification

MARZOLLA, MORENO
2015

Abstract

The Italian National Scientific Qualification (ASN) was introduced in 2010 as part of a major reform of the national university system. Under the new regulation, the scientific qualification for a specific role (associate or full professor) and field of study is required to apply for a permanent professor position. The ASN is peculiar since it makes use of bibliometric indicators with associated thresholds as one of the parameters used to assess applicants. The first round of the ASN received 59,149 applications, and the results have been made publicly available for a short period of time, including the values of the quantitative indicators for each applicant. The availability of this wealth of information provides an opportunity to draw a fairly detailed picture of a nation-wide evaluation exercise, and to study the impact of the bibliometric indicators on the qualification results. In this paper we provide a first account of the Italian National Scientific Qualification from a quantitative point of view. We show that significant differences exist among scientific disciplines, in particular with respect to the fraction of qualified applicants, that can not be easily explained. Furthermore, we describe some issues related to the definition and use of the bibliometric indicators and the corresponding thresholds. Our analysis aims at drawing attention to potential problems that should be addressed by decision-makers in future rounds of the ASN.
2015
Moreno Marzolla (2015). Quantitative Analysis of the Italian National Scientific Qualification. JOURNAL OF INFORMETRICS, 9(2), 285-316 [10.1016/j.joi.2015.02.006].
Moreno Marzolla
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/432566
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 15
  • ???jsp.display-item.citation.isi??? 15
social impact