Active Learning for Efficient Testing of Student Programs
Lecture Notes in Computer Science(2018)
摘要
In this work, we propose an automated method to identify semantic bugs in student programs, called ATAS, which builds upon the recent advances in both symbolic execution and active learning. Symbolic execution is a program analysis technique which can generate test cases through symbolic constraint solving. Our method makes use of a reference implementation of the task as its sole input. We compare our method with a symbolic execution-based baseline on 6 programming tasks retrieved from CodeForces comprising a total of 23K student submissions. We show an average improvement of over 2.5x over the baseline in terms of runtime (thus making it more suitable for online evaluation), without a significant degradation in evaluation accuracy.
更多查看译文
关键词
Student programs,Automated testing,Active learning for classification,Symbolic execution
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络