Many-objective test suite generation for software product lines

Hierons, Robert M.1; Li, Miqing2; Liu, Xiaohui3; Parejo, Jose Antonio4; Segura, Sergio4; Yao, Xin5

2020

10.1145/3361146

ACM Transactions on Software Engineering and Methodology   影响因子和分区

15577392

1557-7392

A Software Product Line (SPL) is a set of products built from a number of features, the set of valid products being defined by a feature model. Typically, it does not make sense to test all products defined by an SPL and one instead chooses a set of products to test (test selection) and, ideally, derives a good order in which to test them (test prioritisation). Since one cannot know in advance which products will reveal faults, test selection and prioritisation are normally based on objective functions that are known to relate to likely effectiveness or cost. This article introduces a new technique, the grid-based evolution strategy (GrES), which considers several objective functions that assess a selection or prioritisation and aims to optimise on all of these. The problem is thus a many-objective optimisation problem.We use a new approach, in which all of the objective functions are considered but one (pairwise coverage) is seen as the most important. We also derive a novel evolution strategy based on domain knowledge. The results of the evaluation, on randomly generated and realistic feature models, were promising, with GrES outperforming previously proposed techniques and a range of many-objective optimisation algorithms.
© 2020 Association for Computing Machinery.

Software product line test selection test prioritisation multi-objective optimisation

EI ; SCI

英语

其他

[2017ZT07X386] ; European Commission[] ; Comisión Interministerial de Ciencia y Tecnología[TIN2015-70560-R] ; Engineering and Physical Sciences Research Council[EP/P005578/1] ; [ZDSYS201703031748284] ; [RTI2018-101204-B-C21] ; Shenzhen Peacock Plan[KQTD2016112514355531] ; European Regional Development Fund[]

Computer Science

Computer Science, Software Engineering

WOS:000565104100002

Association for Computing Machinery

20200808186954

Multiobjective optimization ; Software design ; Testing

Computer Applications:723.5 ; Optimization Techniques:921.5

COMPUTER SCIENCE

EV Compendex

1.University of Sheffield, United Kingdom
2.University of Birmingham, United Kingdom
3.Brunel University, United Kingdom
4.Universidad de Sevilla, Spain
5.Southern University of Science and Technology, University of Birmingham, United Kingdom

Hierons, Robert M.,Li, Miqing,Liu, Xiaohui,et al. Many-objective test suite generation for software product lines[J]. ACM Transactions on Software Engineering and Methodology,2020,29(1).

Hierons, Robert M.,Li, Miqing,Liu, Xiaohui,Parejo, Jose Antonio,Segura, Sergio,&Yao, Xin.(2020).Many-objective test suite generation for software product lines.ACM Transactions on Software Engineering and Methodology,29(1).

Hierons, Robert M.,et al."Many-objective test suite generation for software product lines".ACM Transactions on Software Engineering and Methodology 29.1(2020).