Statistical methods are based on model assumptions, and it is statistical folklore that a method's model assumptions should be checked before applying it. This can be formally done by running one or more misspecification tests testing model assumptions before running a method that requires these assumptions; here we focus on model-based tests. A combined test procedure can be defined by specifying a protocol in which first model assumptions are tested and then, conditionally on the outcome, a test is run that requires or does not require the tested assumptions. Although such an approach is often taken in practice, much of the literature that investigated this is surprisingly critical of it. Our aim is to explore conditions under which model checking is advisable or not advisable. For this, we review results regarding such ``combined procedures'' in the literature, we review and discuss controversial views on the role of model checking in statistics, and we present a general setup in which we can show that preliminary model checking is advantageous, which implies conditions for making model checking worthwhile.

Shamsudheen, I., Hennig, C. (2023). Should We Test the Model Assumptions Before Running a Model-based Test?. JOURNAL OF DATA SCIENCE, STATISTICS, AND VISUALISATION, 3(3 (September)), 1-40 [10.52933/jdssv.v3i3.73].

Should We Test the Model Assumptions Before Running a Model-based Test?

Hennig, Christian
Secondo
Membro del Collaboration Group
2023

Abstract

Statistical methods are based on model assumptions, and it is statistical folklore that a method's model assumptions should be checked before applying it. This can be formally done by running one or more misspecification tests testing model assumptions before running a method that requires these assumptions; here we focus on model-based tests. A combined test procedure can be defined by specifying a protocol in which first model assumptions are tested and then, conditionally on the outcome, a test is run that requires or does not require the tested assumptions. Although such an approach is often taken in practice, much of the literature that investigated this is surprisingly critical of it. Our aim is to explore conditions under which model checking is advisable or not advisable. For this, we review results regarding such ``combined procedures'' in the literature, we review and discuss controversial views on the role of model checking in statistics, and we present a general setup in which we can show that preliminary model checking is advantageous, which implies conditions for making model checking worthwhile.
2023
Shamsudheen, I., Hennig, C. (2023). Should We Test the Model Assumptions Before Running a Model-based Test?. JOURNAL OF DATA SCIENCE, STATISTICS, AND VISUALISATION, 3(3 (September)), 1-40 [10.52933/jdssv.v3i3.73].
Shamsudheen, Iqbal; Hennig, Christian
File in questo prodotto:
File Dimensione Formato  
JDSSV_shamsudheen_hennig_final.pdf

accesso aperto

Descrizione: Paper
Tipo: Versione (PDF) editoriale
Licenza: Licenza per Accesso Aperto. Altra tipologia di licenza compatibile con Open Access
Dimensione 506.1 kB
Formato Adobe PDF
506.1 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/949292
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact