Doing less but getting more: Improving forced-choice measures with Item Response Theory

Brown, Anna (2010) Doing less but getting more: Improving forced-choice measures with Item Response Theory. Assessment and Development Matters, 2 (1). pp. 21-25. ISSN 2040-4069. (Full text available)

PDF - Author's Accepted Manuscript
Download (182kB) Preview
[img]
Preview
Official URL
http://shop.bps.org.uk/assessment-development-matt...

Abstract

Forced-choice tests, despite being resistant to response biases and showing good operational validities, have psychometric problems if scored traditionally. These questionnaires are generally longer than their normative counterparts, and more cognitively challenging. The OPQ32i was shortened and re-scored using the latest advances in IRT. One item was removed out of each block, making the completion quicker and less cognitively complex. The shortened version (OPQ32r) shows good reliability, equivalent or better validity than the full ipsative version, and produces scale scores with normative properties. Results suggest that the IRT methodology can significantly improve efficiency of existing forced-choice measures so that test takers can do less (complete shorter and easier questionnaire) and test users can get more (bias-resistant instrument of superior psychometric quality).

Item Type: Article
Subjects: B Philosophy. Psychology. Religion > BF Psychology
H Social Sciences > HA Statistics
Divisions: Faculties > Social Sciences > School of Psychology > Applied Psychology
Depositing User: Anna Brown
Date Deposited: 18 Nov 2014 10:03 UTC
Last Modified: 02 Feb 2015 16:43 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/44768 (The current URI for this page, for reference purposes)
  • Depositors only (login required):

Downloads

Downloads per month over past year