Skip to main content
placeholder image

Metamorphic Relations for Enhancing System Understanding and Use

Journal Article


Download full-text (Open Access)

Abstract


  • Modern information technology paradigms, such as online services and off-the-shelf products, often involve a wide variety of users with different or even conflicting objectives. Every software output may satisfy some users, but may also fail to satisfy others. Furthermore, users often do not know the internal working mechanisms of the systems. This situation is quite different from bespoke software, where developers and users usually know each other. This paper proposes an approach to help users to better understand the software that they use, and thereby more easily achieve their objectives - even when they do not fully understand how the system is implemented. Our approach borrows the concept of metamorphic relations from the field of metamorphic testing (MT), using it in an innovative way that extends beyond MT. We also propose a "symmetry" metamorphic relation pattern and a "change direction" metamorphic relation input pattern that can be used to derive multiple concrete metamorphic relations. Empirical studies reveal previously unknown failures in some of the most popular applications in the world, and show how our approach can help users to better understand and better use the systems. The empirical results provide strong evidence of the simplicity, applicability, and effectiveness of our methodology.

Authors


  •   Zhi Quan (George) Zhou
  •   Sun, Liqun (external author)
  •   Chen, Tsong Yueh (external author)
  •   Towey, Dave (external author)

Publication Date


  • 2019

Citation


  • Zhou, Z., Sun, L., Chen, T. & Towey, D. (2019). Metamorphic Relations for Enhancing System Understanding and Use. IEEE Transactions on Software Engineering, Online First 1-40.

Scopus Eid


  • 2-s2.0-85055039825

Ro Full-text Url


  • https://ro.uow.edu.au/cgi/viewcontent.cgi?article=4000&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2982

Number Of Pages


  • 39

Start Page


  • 1

End Page


  • 40

Volume


  • Online First

Place Of Publication


  • United States

Abstract


  • Modern information technology paradigms, such as online services and off-the-shelf products, often involve a wide variety of users with different or even conflicting objectives. Every software output may satisfy some users, but may also fail to satisfy others. Furthermore, users often do not know the internal working mechanisms of the systems. This situation is quite different from bespoke software, where developers and users usually know each other. This paper proposes an approach to help users to better understand the software that they use, and thereby more easily achieve their objectives - even when they do not fully understand how the system is implemented. Our approach borrows the concept of metamorphic relations from the field of metamorphic testing (MT), using it in an innovative way that extends beyond MT. We also propose a "symmetry" metamorphic relation pattern and a "change direction" metamorphic relation input pattern that can be used to derive multiple concrete metamorphic relations. Empirical studies reveal previously unknown failures in some of the most popular applications in the world, and show how our approach can help users to better understand and better use the systems. The empirical results provide strong evidence of the simplicity, applicability, and effectiveness of our methodology.

Authors


  •   Zhi Quan (George) Zhou
  •   Sun, Liqun (external author)
  •   Chen, Tsong Yueh (external author)
  •   Towey, Dave (external author)

Publication Date


  • 2019

Citation


  • Zhou, Z., Sun, L., Chen, T. & Towey, D. (2019). Metamorphic Relations for Enhancing System Understanding and Use. IEEE Transactions on Software Engineering, Online First 1-40.

Scopus Eid


  • 2-s2.0-85055039825

Ro Full-text Url


  • https://ro.uow.edu.au/cgi/viewcontent.cgi?article=4000&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2982

Number Of Pages


  • 39

Start Page


  • 1

End Page


  • 40

Volume


  • Online First

Place Of Publication


  • United States