Yeates, Peter, Edwards, Rebecca Jane, Narain, Aditya, McKinley, Robert, Lefroy, Janet, McCray, Gareth, Roberts, Giles, Hammond, Ellie, McBain, Stu, Blythe, Andrew, and others. (2026) Determining the influence of video-based benchmarking (VBB) on examiner variability in objective structured clinical exams (OSCE): The Align study. Medical Teacher, . ISSN 0142-159X. (doi:10.1080/0142159X.2026.2631743) (KAR id:113443)
|
PDF
Publisher pdf
Language: English 
This work is licensed under a Creative Commons Attribution 4.0 International License.
|
|
|
Download this file (PDF/3MB) |
Preview |
| Request a format suitable for use with assistive technology e.g. a screenreader | |
| Official URL: https://doi.org/10.1080/0142159X.2026.2631743 |
|
Abstract
Reducing examiner variability in Objective Structured Clinical Exams (OSCEs) is a priority within clinical performance assessment. In contrast to typical OSCE examiner training, video-based benchmarking (VBB) involves examiners scoring videos a/from their specific station b/shortly before the OSCE and then reflecting on and discussing scores/justifications agreed by an expert panel. Whilst realist evaluation has described mechanisms and contexts by which VBB may operate, VBB's overall efficacy is unknown. We performed a multi-centre (12 UK medical schools) stratified randomised controlled trial of VBB versus control to determine the influence of VBB on examiners' score variability and other score characteristics. Secondarily, we compared the average scores allocated by examiners from different schools. 171 medically qualified, trained OSCE examiners participated in the study. VBB showed no significant effect on overall examiner variability. In pre-specified analyses, VBB reduced variability from group mean of initially 'outlying' examiners on the borderline performance (VBB mean variability 3.02 out of 27 (IQR1.98-4.98), control 4.70 (3.91-5.70), < 0.016) and made examiners more likely to correctly fail a minimally failing performance ( < 0.03, OR = 2.133[95% CI 1.081-4.208]). VBB caused a small increase in confidence. There were no significant differences in average scores by school. VBB may enhance trust in OSCEs through more accurate classification of borderline performances and aligning outlying examiners scoring.
| Item Type: | Article |
|---|---|
| DOI/Identification number: | 10.1080/0142159X.2026.2631743 |
| Uncontrolled keywords: | randomized control trial, Assessment, video-based benchmarking, OSCEs, examiner variability |
| Subjects: |
L Education R Medicine |
| Institutional Unit: | Schools > Kent and Medway Medical School |
| Former Institutional Unit: |
There are no former institutional units.
|
| SWORD Depositor: | JISC Publications Router |
| Depositing User: | JISC Publications Router |
| Date Deposited: | 01 Apr 2026 15:29 UTC |
| Last Modified: | 01 Apr 2026 15:32 UTC |
| Resource URI: | https://kar.kent.ac.uk/id/eprint/113443 (The current URI for this page, for reference purposes) |
- Link to SensusAccess
- Export to:
- RefWorks
- EPrints3 XML
- BibTeX
- CSV
- Depositors only (login required):
Altmetric
Altmetric
