The first OSCE; Does students' experience of performing in public affect their results? Assessment and evaluation of admissions, knowledge, skills and attitudes

Background: Personal qualities have been shown to affect students' exam results. We studied the effect of experience, and level, of public performance in music, drama, dance, sport, and debate at the time of admission to medical school as a predictor of student achievement in their first objective structured clinical examination (OSCE). Methods: A single medical school cohort (n=265) sitting their first clinical exam in 2011 as third year students were studied. Pre-admission statements made at the time of application were coded for their stated achievements in the level of public performance; participation in each activity was scored 0-3, where 0 was no record, 1=leisure time activity, 2=activity at school or local level, 3=activity at district, regional or national level. These scores were correlated to OSCE results by linear regression and t-test. Comparison was made between the highest scoring students in each area, and students scoring zero by t-test. Results: There was a bell shaped distribution in public performance score in this cohort. There was no significant linear regression relationship between OSCE results and overall performance score, or between any subgroups. There was a significant difference between students with high scores in theatre, debate and vocal music areas, grouped together as verbal performance, and students scoring zero in these areas. (p<0.05, t-test) with an effect size of 0.4. Conclusions: We found modest effects from pre-admission experience of verbal performance on students' scores in the OSCE examination. As these data are taken from students' admission statements, we call into question the received wisdom that such statements are unreliable.