Online Testing: Mode of Administration and the Stability of OPQ32i Scores

This study explores the equivalence of web-based administration with no local supervision and traditional paper-and-pencil supervised versions of OPQ32i (the ipsative format version of the Occupational Personality Questionnaire). Samples of data were collected from a range of client projects and matched in terms of industry sector, assessment purpose (selection or development) and candidate category (graduate or managerial/professional). The analysis indicates that lack of local supervision in high-stakes situations has little if any impact on scale scores. At worst, some scales appear to show shifts of less than quarter of an SD, with most scales showing little change, if any. Analyses in terms of the Big Five show differences of less than .2 of an SD. Scale reliabilities and scale covariances appear to be unaffected by the differences between the supervised and unsupervised administration conditions.