STRESS-TESTING ALGORITHMS: GENERATING NEW TEST INSTANCES TO ELICIT INSIGHTS

Abstract

This project aims to develop a new paradigm in algorithm testing, creating novel test instances and tools to elicit insights into algorithm strengths and weaknesses. Such advances are urgently needed to support good research practice in academia, and to avoid disasters when deploying algorithms in practice. Extending our recent work in algorithm testing for combinatorial optimisation, described as 'ground-breaking,' this project aims to tackle the challenges needed to generalise the paradigm to other fields such as machine learning, forecasting, software testing, and other branches of optimisation. An online repository of test instances and tools aim to provide a valuable resource to improve..