This article studies the Type I error, false positive rates, and power of four versions of the Lagrange multiplier test to detect measurement noninvariance in item response theory (IRT) models for binary data under model misspecification. The tests considered are the Lagrange multiplier test computed with the Hessian and cross-product approach, the generalized Lagrange multiplier test and the generalized jackknife score test. The two model misspecifications are those of local dependence among items and nonnormal distribution of the latent variable. The power of the tests is computed in two ways, empirically through Monte Carlo simulation methods and asymptotically, using the asymptotic distribution of each test under the alternative hypothesis. The performance of these tests is evaluated by means of a simulation study. The results highlight that, under mild model misspecification, all tests have good performance while, under strong model misspecification, the tests performance deteriorates, especially for false positive rates under local dependence and power for small sample size under misspecification of the latent variable distribution. In general, the Lagrange multiplier test computed with the Hessian approach and the generalized Lagrange multiplier test have better performance in terms of false positive rates while the Lagrange multiplier test computed with the cross-product approach has the highest power for small sample sizes. The asymptotic power turns out to be a good alternative to the classic empirical power because it is less time consuming. The Lagrange tests studied here have been also applied to a real data set.

Use of the Lagrange Multiplier Test for Assessing Measurement Invariance Under Model Misspecification / Lucia Guastadisegni; Silvia Cagnone; Irini Moustaki; Vassilis Vasdekis. - In: EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT. - ISSN 0013-1644. - ELETTRONICO. - 82:2(2022), pp. 254-280. [10.1177/00131644211020355]

Use of the Lagrange Multiplier Test for Assessing Measurement Invariance Under Model Misspecification

Lucia Guastadisegni
Primo
;
Silvia Cagnone
Secondo
;
2022

Abstract

This article studies the Type I error, false positive rates, and power of four versions of the Lagrange multiplier test to detect measurement noninvariance in item response theory (IRT) models for binary data under model misspecification. The tests considered are the Lagrange multiplier test computed with the Hessian and cross-product approach, the generalized Lagrange multiplier test and the generalized jackknife score test. The two model misspecifications are those of local dependence among items and nonnormal distribution of the latent variable. The power of the tests is computed in two ways, empirically through Monte Carlo simulation methods and asymptotically, using the asymptotic distribution of each test under the alternative hypothesis. The performance of these tests is evaluated by means of a simulation study. The results highlight that, under mild model misspecification, all tests have good performance while, under strong model misspecification, the tests performance deteriorates, especially for false positive rates under local dependence and power for small sample size under misspecification of the latent variable distribution. In general, the Lagrange multiplier test computed with the Hessian approach and the generalized Lagrange multiplier test have better performance in terms of false positive rates while the Lagrange multiplier test computed with the cross-product approach has the highest power for small sample sizes. The asymptotic power turns out to be a good alternative to the classic empirical power because it is less time consuming. The Lagrange tests studied here have been also applied to a real data set.
2022
Use of the Lagrange Multiplier Test for Assessing Measurement Invariance Under Model Misspecification / Lucia Guastadisegni; Silvia Cagnone; Irini Moustaki; Vassilis Vasdekis. - In: EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT. - ISSN 0013-1644. - ELETTRONICO. - 82:2(2022), pp. 254-280. [10.1177/00131644211020355]
Lucia Guastadisegni; Silvia Cagnone; Irini Moustaki; Vassilis Vasdekis
File in questo prodotto:
File Dimensione Formato  
11585_821406.pdf

accesso aperto

Tipo: Postprint
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione - Non commerciale - Non opere derivate (CCBYNCND)
Dimensione 958.33 kB
Formato Adobe PDF
958.33 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/821406
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 2
social impact