AI-written patches are becoming attack maps for hackers
This summer, the maintainers of vm2, an open-source JavaScript sandboxing library with 1 million downloads per week, shipped fixes for 34 separate sandbox-escape vulnerabilities and Anthropic’s Claude co-wrote 19 of them. Weeks later, a security researcher pointed an AI agent at one of the advisories and asked for a way around the patch. The agent delivered. Shayaun Nejad, lead product security engineer at Rubrik, ran vulnerability variant analysis on the vm2 patch while preparing for a talk he held at the recent [un]prompted AI security conference in San Francisco. He wanted to highlight the challenges his development team faced when dealing with a flood of AI-discovered vulnerabilities, and noted that the same bugs kept being rediscovered later in new testing runs despite being fixed by AI-assisted pipelines. “Sometimes the [vulnerability] variant wouldn’t be caught until the model variation got better or the model used chaining analysis at a higher degree once it improved in order t