Evaluation of the Prescribing Skills Assessment implementation, performance and medical student experience in Australia and New Zealand

Abstract

Aims: The UK Prescribing Safety Assessment was modified for use in Australia and New Zealand (ANZ) as the Prescribing Skills Assessment (PSA). We investigated the implementation, student performance and acceptability of the ANZ PSA for final-year medical students.

Methods: This study used a mixed-method approach involving student data (n = 6440) for 2017–2019 (PSA overall score and 8 domain subscores). Data were also aggregated by medical school and included student evaluation survey results. Quantitative data were analysed using descriptive and multivariate analyses. The pass rate was established by a modified Angoff method. Thematic analyses of open-ended survey comments were conducted.

Results: The average pass rate was slightly higher in 2017 (89%) which used a different examination to 2018 (85%) and 2019 (86%). Little difference was identified between schools for the PSA overall performance or domain subscores. There was low intercorrelation between subscores. Most students provided positive feedback about the PSA regarding the interface and clarity of questions, but an average of 35% reported insufficient time for completion. Further, 70% on average felt unprepared by their school curricula for the PSA, which is in part explained by the low prescribing experience; 69% reported completing ≤10 prescriptions during training.

Conclusion: The ANZ PSA was associated with high pass rates and acceptability, although student preparedness was highlighted as a concern for further investigation. We demonstrate how a collaboration of medical schools can adapt a medical education assessment resource (UK PSA) as a means for fulfilling an unmet need.