Skip to main content
placeholder image

Adaptive Random Testing in Detecting Layout Faults of Web Applications

Journal Article


Abstract


  • As part of a software testing process, output verification poses a challenge when the output is not numeric or textual, such as graphical. The industry practice of using human oracles (testers) to observe and verify the correctness of the actual results is both expensive and error-prone. In particular, this practice is usually unsustainable when developing web applications — the most popular software of our era. This is because web applications change frequently due to the fast-evolving requirements amid popular demand. To improve the cost effectiveness of browser output verification, in this study we design failure-based testing techniques and evaluate the effectiveness and efficiency thereof in the context of web testing. With a novel application of the concept of adaptive random sequence (ARS), our approach leverages peculiar characteristics of failure patterns found in browser layout rendering. An empirical study shows that the use of failure patterns and inclination to guide the testing flow leads to more cost-effective results than other classic methods. This study extends the application of ARSs from the input space of programs to their output space, and also shows that adaptive random testing (ART) can outperform random testing (RT) in both failure detection effectiveness (in terms of F-measure) and failure detection efficiency (in terms of execution time).

Authors


  •   Selay, Elmin (external author)
  •   Zhi Quan (George) Zhou
  •   Chen, Tsong Yueh (external author)
  •   Kuo, Diana (external author)

Publication Date


  • 2018

Citation


  • Selay, E., Zhou, Z., Chen, T. & Kuo, F. (2018). Adaptive Random Testing in Detecting Layout Faults of Web Applications. International Journal Of Software Engineering And Knowledge Engineering, 28 (10), 1399-1428.

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2155

Number Of Pages


  • 29

Start Page


  • 1399

End Page


  • 1428

Volume


  • 28

Issue


  • 10

Place Of Publication


  • Singapore

Abstract


  • As part of a software testing process, output verification poses a challenge when the output is not numeric or textual, such as graphical. The industry practice of using human oracles (testers) to observe and verify the correctness of the actual results is both expensive and error-prone. In particular, this practice is usually unsustainable when developing web applications — the most popular software of our era. This is because web applications change frequently due to the fast-evolving requirements amid popular demand. To improve the cost effectiveness of browser output verification, in this study we design failure-based testing techniques and evaluate the effectiveness and efficiency thereof in the context of web testing. With a novel application of the concept of adaptive random sequence (ARS), our approach leverages peculiar characteristics of failure patterns found in browser layout rendering. An empirical study shows that the use of failure patterns and inclination to guide the testing flow leads to more cost-effective results than other classic methods. This study extends the application of ARSs from the input space of programs to their output space, and also shows that adaptive random testing (ART) can outperform random testing (RT) in both failure detection effectiveness (in terms of F-measure) and failure detection efficiency (in terms of execution time).

Authors


  •   Selay, Elmin (external author)
  •   Zhi Quan (George) Zhou
  •   Chen, Tsong Yueh (external author)
  •   Kuo, Diana (external author)

Publication Date


  • 2018

Citation


  • Selay, E., Zhou, Z., Chen, T. & Kuo, F. (2018). Adaptive Random Testing in Detecting Layout Faults of Web Applications. International Journal Of Software Engineering And Knowledge Engineering, 28 (10), 1399-1428.

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2155

Number Of Pages


  • 29

Start Page


  • 1399

End Page


  • 1428

Volume


  • 28

Issue


  • 10

Place Of Publication


  • Singapore