Evolving Rules for Action Selection in Automated Testing via Genetic Programming - A First Approach.
Lecture Notes in Computer Science(2017)
摘要
Tools that perform automated software testing via the user interface rely on an action selection mechanism that at each step of the testing process decides what to do next. This mechanism is often based on random choice, a practice commonly referred to as monkey testing. In this work we evaluate a first approach to genetic programming (GP) for action selection that involves evolving IF-THEN-ELSE rules; we carry out experiments and compare the results with those obtained by random selection and also by Q-learning, a reinforcement learning technique. Three applications are used as Software Under Test (SUT) in the experiments, two of which are proprietary desktop applications and the other one an open source web-based application. Statistical analysis is used to compare the three action selection techniques on the three SUTs; for this, a number of metrics are used that are valid even under the assumption that access to the source code is not available and testing is only possible via the GUI. Even at this preliminary stage, the analysis shows the potential of GP to evolve action selection mechanisms.
更多查看译文
关键词
Automated testing via the GUI,Action selection for testing,Testing metrics,Genetic Programming
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络