Skip to main content
placeholder image

Improving assessment practice through cross-institutional collaboration: an exercise on the use of OSCEs

Journal Article


Abstract


  • Background: This study was undertaken to improve assessment practice on OSCEs through collaboration across geographically dispersed medical schools in Australia.

    Methods: A total of eleven OSCE stations were co-developed by four medical schools and used in summative 2011 and 2012 examinations for the assessment of clinical performance in the early clinical and exit OSCEs in each school’s medical course. Partial Credit Rasch Model was used to evaluate the psychometric properties of the shared OSCE data. Evaluation of the quality assurance reports was used to determine the beneficial impact of the collaborative benchmarking exercise on learning and teaching outcomes.

    Results: The data for each examination demonstrated sufficient fit to the Rasch model with infit mean square values ranging from 0.88 to 0.99. Person separation (1.25–1.63) indices indicated good reliability. Evaluation of perceived benefits showed that the benchmarking process was successful as it highlighted common curriculum areas requiring specific focus and provided comparable data on the quality of teaching at the participating medical schools.

    Conclusion: This research demonstrates the validity of the psychometric data and benefits of evaluating clinical competence across medical schools without the enforcement of a prescriptive national curriculum or assessment.

UOW Authors


  •   Malau-Aduli, Bunmi Sherifat (external author)
  •   Teague, Peta-Ann (external author)
  •   Turner, Richard (external author)
  •   Holman, Benjamin (external author)
  •   D'Souza, Karen (external author)
  •   Garne, David
  •   Heal, Clare (external author)
  •   Heggarty, Paula (external author)
  •   Hudson, Judith (external author)
  •   Wilson, Ian
  •   van der Vleuten, Cees (external author)

Publication Date


  • 2016

Citation


  • Malau-Aduli, B., Teague, P., Turner, R., Holman, B., D'Souza, K., Garne, D. L., Heal, C., Heggarty, P., Hudson, J. N., Wilson, I. G. & van der Vleuten, C. (2016). Improving assessment practice through cross-institutional collaboration: an exercise on the use of OSCEs. Medical Teacher, 38 (3), 263-271.

Scopus Eid


  • 2-s2.0-84962344591

Ro Metadata Url


  • http://ro.uow.edu.au/smhpapers/3563

Number Of Pages


  • 8

Start Page


  • 263

End Page


  • 271

Volume


  • 38

Issue


  • 3

Abstract


  • Background: This study was undertaken to improve assessment practice on OSCEs through collaboration across geographically dispersed medical schools in Australia.

    Methods: A total of eleven OSCE stations were co-developed by four medical schools and used in summative 2011 and 2012 examinations for the assessment of clinical performance in the early clinical and exit OSCEs in each school’s medical course. Partial Credit Rasch Model was used to evaluate the psychometric properties of the shared OSCE data. Evaluation of the quality assurance reports was used to determine the beneficial impact of the collaborative benchmarking exercise on learning and teaching outcomes.

    Results: The data for each examination demonstrated sufficient fit to the Rasch model with infit mean square values ranging from 0.88 to 0.99. Person separation (1.25–1.63) indices indicated good reliability. Evaluation of perceived benefits showed that the benchmarking process was successful as it highlighted common curriculum areas requiring specific focus and provided comparable data on the quality of teaching at the participating medical schools.

    Conclusion: This research demonstrates the validity of the psychometric data and benefits of evaluating clinical competence across medical schools without the enforcement of a prescriptive national curriculum or assessment.

UOW Authors


  •   Malau-Aduli, Bunmi Sherifat (external author)
  •   Teague, Peta-Ann (external author)
  •   Turner, Richard (external author)
  •   Holman, Benjamin (external author)
  •   D'Souza, Karen (external author)
  •   Garne, David
  •   Heal, Clare (external author)
  •   Heggarty, Paula (external author)
  •   Hudson, Judith (external author)
  •   Wilson, Ian
  •   van der Vleuten, Cees (external author)

Publication Date


  • 2016

Citation


  • Malau-Aduli, B., Teague, P., Turner, R., Holman, B., D'Souza, K., Garne, D. L., Heal, C., Heggarty, P., Hudson, J. N., Wilson, I. G. & van der Vleuten, C. (2016). Improving assessment practice through cross-institutional collaboration: an exercise on the use of OSCEs. Medical Teacher, 38 (3), 263-271.

Scopus Eid


  • 2-s2.0-84962344591

Ro Metadata Url


  • http://ro.uow.edu.au/smhpapers/3563

Number Of Pages


  • 8

Start Page


  • 263

End Page


  • 271

Volume


  • 38

Issue


  • 3