Challenging Systems to discover vulnerabilities using computational red teaming

Funding Source: ARC Discovery Project

Computational red teaming concerns the design of computational models to role play intelligent adversaries. These adversaries who are determined to exploit a system rely on creative thinking to discover system-level vulnerabilities by challenging system design, implementation or operations. This project closes a gap in the risk assessment literature by designing automated computational red teaming methods to discover vulnerabilities associated with intentional risks. Scientific outcomes include novel automated skill assessment algorithms and new search techniques to exploit assumptions that could have been overlooked otherwise. Practical outcomes include robust risk assessment tools, strong research training, and high impact publications.

Return to Trusted Autonomy >>