Item Response Modeling of Forced-Choice Questionnaires

Brown, Anna and Maydeu-Olivares, Alberto (2011) Item Response Modeling of Forced-Choice Questionnaires. Educational and Psychological Measurement, 71 (3). pp. 460-502. ISSN 0013-1644. (Full text available)

PDF - Accepted Version
Download (1MB) Preview
[img]
Preview
Official URL
http://dx.doi.org/10.1177/0013164410375112

Abstract

Multidimensional forced-choice formats can significantly reduce the impact of numerous response biases typically associated with rating scales. However, if scored with classical methodology, these questionnaires produce ipsative data, which lead to distorted scale relationships and make comparisons between individuals problematic. This research demonstrates how item response theory (IRT) modeling may be applied to overcome these problems. A multidimensional IRT model based on Thurstone’s framework for comparative data is introduced, which is suitable for use with any forced-choice questionnaire composed of items fitting the dominance response model, with any number of measured traits, and any block sizes (i.e., pairs, triplets, quads, etc.). Thurstonian IRT models are normal ogive models with structured factor loadings, structured uniquenesses, and structured local dependencies. These models can be straightforwardly estimated using structural equation modeling (SEM) software Mplus. A number of simulation studies are performed to investigate how latent traits are recovered under various forced-choice designs and provide guidelines for optimal questionnaire design. An empirical application is given to illustrate how the model may be applied in practice. It is concluded that when the recommended design guidelines are met, scores estimated from forced-choice questionnaires with the proposed methodology reproduce the latent traits well.

Item Type: Article
Subjects: H Social Sciences > HA Statistics
Divisions: Faculties > Social Sciences > School of Psychology > Applied Psychology
Depositing User: Anna Brown
Date Deposited: 11 Jun 2012 10:06
Last Modified: 03 May 2013 08:51
Resource URI: http://kar.kent.ac.uk/id/eprint/29626 (The current URI for this page, for reference purposes)
  • Depositors only (login required):

Downloads

Downloads per month over past year