Multiple-choice items are extensively used across different assessment contexts. A crucial requirement for ensuring their validity is their correct development, and a number of item-writing guidelines have been proposed that support item developers. This experimental pilot study aimed to investigate the effect of violating two item-writing guidelines: the differential length of the correct option compared to distractors and its lexical overlap with the stem. Standard and flawed items, respectively adhering to and deviating from guidelines, were randomly assigned to 55 college students and compared in their psychometric functioning. Results indicated that, in general, flawed items tended to be easier and less subject to random answers than standard ones, but significant differences were few. Discrepancies between standard and flawed subtests approached statistical significance with medium effect sizes. Although of interest, findings must be cautiously interpreted due to the small sample size. Implications for future research are discussed.

Differential length and overlap with the stem in multiple-choice item options: A pilot experiment / Casu, Giulia; García-García, Carmen. - In: PSICOLOGÍA EDUCATIVA. - ISSN 1135-755X. - ELETTRONICO. - 25:1(2019), pp. 43-48. [10.5093/psed2018a20]

Differential length and overlap with the stem in multiple-choice item options: A pilot experiment

Casu, Giulia
;
2019

Abstract

Multiple-choice items are extensively used across different assessment contexts. A crucial requirement for ensuring their validity is their correct development, and a number of item-writing guidelines have been proposed that support item developers. This experimental pilot study aimed to investigate the effect of violating two item-writing guidelines: the differential length of the correct option compared to distractors and its lexical overlap with the stem. Standard and flawed items, respectively adhering to and deviating from guidelines, were randomly assigned to 55 college students and compared in their psychometric functioning. Results indicated that, in general, flawed items tended to be easier and less subject to random answers than standard ones, but significant differences were few. Discrepancies between standard and flawed subtests approached statistical significance with medium effect sizes. Although of interest, findings must be cautiously interpreted due to the small sample size. Implications for future research are discussed.
2019
Differential length and overlap with the stem in multiple-choice item options: A pilot experiment / Casu, Giulia; García-García, Carmen. - In: PSICOLOGÍA EDUCATIVA. - ISSN 1135-755X. - ELETTRONICO. - 25:1(2019), pp. 43-48. [10.5093/psed2018a20]
Casu, Giulia; García-García, Carmen
File in questo prodotto:
File Dimensione Formato  
Casu & Garcia-Garcia 2019.pdf

accesso aperto

Tipo: Versione (PDF) editoriale
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione - Non commerciale - Non opere derivate (CCBYNCND)
Dimensione 148.28 kB
Formato Adobe PDF
148.28 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/670935
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact