Skip to main content
placeholder image

Metamorphic relations for detection of performance anomalies

Conference Paper


Abstract


  • Metamorphic relations can be used to improve performance testing by comparing successive runs of the software under test. We examine one such metamorphic relation for page load times, which we used to discover and repair a race condition in the Adobe Experience Platform Launch Tag Manager. Histograms for page load times had different modalities, which alerted us to the presence of the bug. We discuss the need for performance measures in addition to the popular mean and standard deviation. We describe two approaches to automatically determine modality: Gaussian Mixture Models and the Silverman Test for Multimodality. Metamorphic relations which involve these performance measures can be used to alert engineers to the presence of performance anomalies.

Authors


  •   Johnston, Owen (external author)
  •   Jarman, Darryl C. (external author)
  •   Berry, Jeffrey (external author)
  •   Zhi Quan (George) Zhou
  •   Chen, Tsong Yueh (external author)

Publication Date


  • 2019

Citation


  • Johnston, O., Jarman, D., Berry, J., Zhou, Z. & Chen, T. Yueh. (2019). Metamorphic relations for detection of performance anomalies. Proceedings - 2019 IEEE/ACM 4th International Workshop on Metamorphic Testing, MET 2019 (pp. 63-69). United States: IEEE.

Scopus Eid


  • 2-s2.0-85071461228

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/3152

Start Page


  • 63

End Page


  • 69

Place Of Publication


  • United States

Abstract


  • Metamorphic relations can be used to improve performance testing by comparing successive runs of the software under test. We examine one such metamorphic relation for page load times, which we used to discover and repair a race condition in the Adobe Experience Platform Launch Tag Manager. Histograms for page load times had different modalities, which alerted us to the presence of the bug. We discuss the need for performance measures in addition to the popular mean and standard deviation. We describe two approaches to automatically determine modality: Gaussian Mixture Models and the Silverman Test for Multimodality. Metamorphic relations which involve these performance measures can be used to alert engineers to the presence of performance anomalies.

Authors


  •   Johnston, Owen (external author)
  •   Jarman, Darryl C. (external author)
  •   Berry, Jeffrey (external author)
  •   Zhi Quan (George) Zhou
  •   Chen, Tsong Yueh (external author)

Publication Date


  • 2019

Citation


  • Johnston, O., Jarman, D., Berry, J., Zhou, Z. & Chen, T. Yueh. (2019). Metamorphic relations for detection of performance anomalies. Proceedings - 2019 IEEE/ACM 4th International Workshop on Metamorphic Testing, MET 2019 (pp. 63-69). United States: IEEE.

Scopus Eid


  • 2-s2.0-85071461228

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/3152

Start Page


  • 63

End Page


  • 69

Place Of Publication


  • United States