Influence of Context on Item Parameters in Forced-Choice Personality Assessments

Lin, Yin and Brown, Anna (2016) Influence of Context on Item Parameters in Forced-Choice Personality Assessments. Educational and Psychological Measurement, . ISSN 0013-1644. E-ISSN 1552-3888. (doi:https://doi.org/10.1177/0013164416646162) (Full text available)

PDF - Author's Accepted Manuscript

Creative Commons Licence
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Download (496kB) Preview
[img]
Preview
Official URL
http://dx.doi.org/10.1177/0013164416646162

Abstract

A fundamental assumption in computerized adaptive testing (CAT) is that item parameters are invariant with respect to context – items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the influence of context on item parameters by comparing parameter estimates from two FC instruments. The first instrument was compiled of blocks of three items, whereas in the second, the context was manipulated by adding one item to each block, resulting in blocks of four. The item parameter estimates were highly similar. However, a small number of significant deviations were observed, confirming the importance of context when designing adaptive FC assessments. Two patterns of such deviations were identified, and methods to reduce their occurrences in a FC CAT setting were proposed. It was shown that with a small proportion of violations of the parameter invariance assumption, score estimation remained stable.

Item Type: Article
Projects: [UNSPECIFIED] Asking the right questions: Increasing fairness and accuracy of personality assessments with Computerised Adaptive Testing
Uncontrolled keywords: Forced choice, computerized adaptive testing, multidimensional item response theory
Subjects: B Philosophy. Psychology. Religion > BF Psychology
H Social Sciences > HA Statistics
Divisions: Faculties > Social Sciences > School of Psychology > Applied Psychology
Depositing User: Anna Brown
Date Deposited: 05 Apr 2016 09:24 UTC
Last Modified: 30 Jan 2017 15:14 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/54785 (The current URI for this page, for reference purposes)
  • Depositors only (login required):

Downloads

Downloads per month over past year