Skip to main content

The effect of commercial coaching on selection test performance

Journal Article


Abstract


  • Aim: To investigate whether commercial coaching affects performance in the Undergraduate Medical and Health Sciences Admission Test (UMAT).

    Method: The effect of coaching on the UMAT scores of 402 final high school students applying for medicine was examined using t-tests and multiple regression analyses that controlled for academic performance, high school type and gender.

    Results: Over half (56.2%) of the participants had enrolled in commercial coaching. Coaching had no influence on UMAT Section 1 or 2, even after controlling for academic performance, gender and type of high school. UMAT Section 3 was significantly higher for coached students, but this was only the case for high ability students. Coaching had a slight negative effect for lower ability students. Those attending academically selective high school also had higher UMAT scores.

    Conclusion: The results have implications for the fairness and validity of the UMAT. The differential effect of coaching possibly occurred because high academic ability students are able to learn solution rules for non-verbal tests. We propose that the effect of school type relates to a competitive culture that drives extended test practice in academically selective schools.

UOW Authors


  •   Griffin, Barbara (external author)
  •   Carless, Sally (external author)
  •   Wilson, Ian

Publication Date


  • 2013

Citation


  • Griffin, B., Carless, S. & Wilson, I. G. (2013). The effect of commercial coaching on selection test performance. Medical Teacher, 35 (4), 295-300.

Scopus Eid


  • 2-s2.0-84876392084

Ro Metadata Url


  • http://ro.uow.edu.au/smhpapers/485

Has Global Citation Frequency


Number Of Pages


  • 5

Start Page


  • 295

End Page


  • 300

Volume


  • 35

Issue


  • 4

Place Of Publication


  • United Kingdom

Abstract


  • Aim: To investigate whether commercial coaching affects performance in the Undergraduate Medical and Health Sciences Admission Test (UMAT).

    Method: The effect of coaching on the UMAT scores of 402 final high school students applying for medicine was examined using t-tests and multiple regression analyses that controlled for academic performance, high school type and gender.

    Results: Over half (56.2%) of the participants had enrolled in commercial coaching. Coaching had no influence on UMAT Section 1 or 2, even after controlling for academic performance, gender and type of high school. UMAT Section 3 was significantly higher for coached students, but this was only the case for high ability students. Coaching had a slight negative effect for lower ability students. Those attending academically selective high school also had higher UMAT scores.

    Conclusion: The results have implications for the fairness and validity of the UMAT. The differential effect of coaching possibly occurred because high academic ability students are able to learn solution rules for non-verbal tests. We propose that the effect of school type relates to a competitive culture that drives extended test practice in academically selective schools.

UOW Authors


  •   Griffin, Barbara (external author)
  •   Carless, Sally (external author)
  •   Wilson, Ian

Publication Date


  • 2013

Citation


  • Griffin, B., Carless, S. & Wilson, I. G. (2013). The effect of commercial coaching on selection test performance. Medical Teacher, 35 (4), 295-300.

Scopus Eid


  • 2-s2.0-84876392084

Ro Metadata Url


  • http://ro.uow.edu.au/smhpapers/485

Has Global Citation Frequency


Number Of Pages


  • 5

Start Page


  • 295

End Page


  • 300

Volume


  • 35

Issue


  • 4

Place Of Publication


  • United Kingdom