Skip to main content
placeholder image

Is it time to stop using statistical significance?

Journal Article


Abstract


  • The important first step in the critical appraisal of a randomised trial is not an evaluation of the statistical analyses. The most important aspect to consider when reviewing a study of a new drug is the appropriateness and quality of the trial design and methods. The next most important aspect is the effect size of different treatments and its clinical significance. Rather than reporting statistical significance, studies should report the difference between treatments and its precision. Over-reliance on statistical significance and p values may lead to incorrect conclusions. Trial reports about drugs should therefore avoid the term statistical significance and quote p values with caution.

Publication Date


  • 2021

Citation


  • Frank, O., Tam, C. W. M., & Rhee, J. (2021). Is it time to stop using statistical significance?. Australian Prescriber, 44(1), 16-18. doi:10.18773/austprescr.2020.074

Scopus Eid


  • 2-s2.0-85100923221

Start Page


  • 16

End Page


  • 18

Volume


  • 44

Issue


  • 1

Abstract


  • The important first step in the critical appraisal of a randomised trial is not an evaluation of the statistical analyses. The most important aspect to consider when reviewing a study of a new drug is the appropriateness and quality of the trial design and methods. The next most important aspect is the effect size of different treatments and its clinical significance. Rather than reporting statistical significance, studies should report the difference between treatments and its precision. Over-reliance on statistical significance and p values may lead to incorrect conclusions. Trial reports about drugs should therefore avoid the term statistical significance and quote p values with caution.

Publication Date


  • 2021

Citation


  • Frank, O., Tam, C. W. M., & Rhee, J. (2021). Is it time to stop using statistical significance?. Australian Prescriber, 44(1), 16-18. doi:10.18773/austprescr.2020.074

Scopus Eid


  • 2-s2.0-85100923221

Start Page


  • 16

End Page


  • 18

Volume


  • 44

Issue


  • 1