Skip to main content

Preliminary reliability of an observer rating scale for assessing medication adherence on psychiatric wards

Journal Article


Abstract


  • Objectives: Medication non-adherence is a major contributor to poor outcomes following discharge from psychiatric hospitals. It is therefore imperative that staff are able to accurately assess the extent to which patients have engaged with treatment. This study presents data on a new observer rating instrument of patient medication adherence.

    Method: Staff participating in a medication adherence training program were given a brief overview of the Observer Rating of Medication Taking (ORMT) scale. Participants then watched six video vignettes of patient adherence behaviour and provided a rating on their scale for each vignette. Participant ratings were then compared with ratings.

    Results: Percentage agreement between and participants ranged from a low of 68% through to 98% agreement. Only one vignette was rated significantly differently [Mdiff = .33, t(49) = 2.08, p = .007], with 32% of people falling outside the expert rating range, (all of those ratings being higher). This difference was attributed to between group differences, [F(2,47) = 3.49, p < .05] and post-hoc assessment suggested that the differences between expert and trainee ratings for the vignette may be explained by trainee characteristics, as distinct from inherent characteristics of the rating scale.

    Conclusion: The ORMT can help mental health professionals identify particular non-adherent behaviours thus facilitating identification and treatment of likely non-adherence before discharge. The scale appears to be accessible to a variety of professions with a range of experience and requires minimum training in order to be used reliably.

UOW Authors


  •   Byrne, Mitch K.
  •   Deane, Frank
  •   Willis, Aimee (external author)
  •   Hawkins, Barbara (external author)
  •   Quinn, Rebecca (external author)

Publication Date


  • 2009

Citation


  • Byrne, M. K., Deane, F. P., Willis, A., Hawkins, B. & Quinn, R. (2009). Preliminary reliability of an observer rating scale for assessing medication adherence on psychiatric wards. Journal of Evaluation in Clinical Practice, 15 (2), 246-251.

Scopus Eid


  • 2-s2.0-62849089307

Ro Metadata Url


  • http://ro.uow.edu.au/hbspapers/3306

Has Global Citation Frequency


Number Of Pages


  • 5

Start Page


  • 246

End Page


  • 251

Volume


  • 15

Issue


  • 2

Abstract


  • Objectives: Medication non-adherence is a major contributor to poor outcomes following discharge from psychiatric hospitals. It is therefore imperative that staff are able to accurately assess the extent to which patients have engaged with treatment. This study presents data on a new observer rating instrument of patient medication adherence.

    Method: Staff participating in a medication adherence training program were given a brief overview of the Observer Rating of Medication Taking (ORMT) scale. Participants then watched six video vignettes of patient adherence behaviour and provided a rating on their scale for each vignette. Participant ratings were then compared with ratings.

    Results: Percentage agreement between and participants ranged from a low of 68% through to 98% agreement. Only one vignette was rated significantly differently [Mdiff = .33, t(49) = 2.08, p = .007], with 32% of people falling outside the expert rating range, (all of those ratings being higher). This difference was attributed to between group differences, [F(2,47) = 3.49, p < .05] and post-hoc assessment suggested that the differences between expert and trainee ratings for the vignette may be explained by trainee characteristics, as distinct from inherent characteristics of the rating scale.

    Conclusion: The ORMT can help mental health professionals identify particular non-adherent behaviours thus facilitating identification and treatment of likely non-adherence before discharge. The scale appears to be accessible to a variety of professions with a range of experience and requires minimum training in order to be used reliably.

UOW Authors


  •   Byrne, Mitch K.
  •   Deane, Frank
  •   Willis, Aimee (external author)
  •   Hawkins, Barbara (external author)
  •   Quinn, Rebecca (external author)

Publication Date


  • 2009

Citation


  • Byrne, M. K., Deane, F. P., Willis, A., Hawkins, B. & Quinn, R. (2009). Preliminary reliability of an observer rating scale for assessing medication adherence on psychiatric wards. Journal of Evaluation in Clinical Practice, 15 (2), 246-251.

Scopus Eid


  • 2-s2.0-62849089307

Ro Metadata Url


  • http://ro.uow.edu.au/hbspapers/3306

Has Global Citation Frequency


Number Of Pages


  • 5

Start Page


  • 246

End Page


  • 251

Volume


  • 15

Issue


  • 2