Skip to main content

Influence of Context on Item Parameters in Forced-Choice Personality Assessments

Lin, Yin, Brown, Anna (2016) Influence of Context on Item Parameters in Forced-Choice Personality Assessments. Educational and Psychological Measurement, 77 (3). pp. 389-414. ISSN 0013-1644. E-ISSN 1552-3888. (doi:10.1177/0013164416646162) (KAR id:54785)

PDF Author's Accepted Manuscript
Language: English


Click to download this file (854kB) Preview
[thumbnail of Context in forced-choice assessments_Revised_Final.pdf]
Preview
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL:
http://dx.doi.org/10.1177/0013164416646162

Abstract

A fundamental assumption in computerized adaptive testing (CAT) is that item parameters are invariant with respect to context – items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the influence of context on item parameters by comparing parameter estimates from two FC instruments. The first instrument was compiled of blocks of three items, whereas in the second, the context was manipulated by adding one item to each block, resulting in blocks of four. The item parameter estimates were highly similar. However, a small number of significant deviations were observed, confirming the importance of context when designing adaptive FC assessments. Two patterns of such deviations were identified, and methods to reduce their occurrences in a FC CAT setting were proposed. It was shown that with a small proportion of violations of the parameter invariance assumption, score estimation remained stable.

Item Type: Article
DOI/Identification number: 10.1177/0013164416646162
Projects: Asking the right questions: Increasing fairness and accuracy of personality assessments with Computerised Adaptive Testing
Uncontrolled keywords: Forced choice, computerized adaptive testing, multidimensional item response theory
Subjects: B Philosophy. Psychology. Religion > BF Psychology
H Social Sciences > HA Statistics
Divisions: Divisions > Division of Human and Social Sciences > School of Psychology
Funders: [UNSPECIFIED] Economic and Social Research Council
[UNSPECIFIED] Corporate Executive Board
Depositing User: Anna Brown
Date Deposited: 05 Apr 2016 09:24 UTC
Last Modified: 16 Feb 2021 13:34 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/54785 (The current URI for this page, for reference purposes)
Brown, Anna: https://orcid.org/0000-0002-5612-2627
  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.