Skip to main content

Doing less but getting more: Improving forced-choice measures with Item Response Theory

Brown, Anna (2010) Doing less but getting more: Improving forced-choice measures with Item Response Theory. Assessment and Development Matters, 2 (1). pp. 21-25. ISSN 2040-4069. (KAR id:44768)

PDF Author's Accepted Manuscript
Language: English
Download (182kB) Preview
[thumbnail of Brown 2010 Doing Less But Getting More.pdf]
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL:


Forced-choice tests, despite being resistant to response biases and showing good operational validities, have psychometric problems if scored traditionally. These questionnaires are generally longer than their normative counterparts, and more cognitively challenging.

The OPQ32i was shortened and re-scored using the latest advances in IRT. One item was removed out of each block, making the completion quicker and less cognitively complex. The shortened version (OPQ32r) shows good reliability, equivalent or better validity than the full ipsative version, and produces scale scores with normative properties.

Results suggest that the IRT methodology can significantly improve efficiency of existing forced-choice measures so that test takers can do less (complete shorter and easier questionnaire) and test users can get more (bias-resistant instrument of superior psychometric quality).

Item Type: Article
Subjects: B Philosophy. Psychology. Religion > BF Psychology
H Social Sciences > HA Statistics
Divisions: Divisions > Division of Human and Social Sciences > School of Psychology
Depositing User: Anna Brown
Date Deposited: 18 Nov 2014 10:03 UTC
Last Modified: 16 Nov 2021 10:17 UTC
Resource URI: (The current URI for this page, for reference purposes)
Brown, Anna:
  • Depositors only (login required):


Downloads per month over past year