AI Security After Codex and Claude Code — Zico Kolter & Matt Fredrikson, Gray Swan
Jun 22, 2026 · 1:07:31
Gray Swan cofounders Zico Kolter and Matt Fredrikson explain why AI agents like Codex and Claude Code introduce a new class of security vulnerabilities that traditional cybersecurity cannot address, and present their automated red-teaming system Shade and guardrail model Cygnal as solutions. Prompt injection creates exploits for agents operating on untrusted data, and Shade now outperforms human red teamers at breaking models. The lethal trifecta—untrusted data, private data, and exfiltration—defines the highest risks. In their Human Browser Agent Robustness Challenge, humans ranked fourth among models, with some frontier agents falling for attacks no person would. Bigger models do not automatically become safer, and specialized systems like Cygnal enforce enterprise policies more reliably than prompt engineering. They see AI security evolving toward insurance and compliance, with the first major prompt-injection breach a gray swan—unlikely but visible ahead of time.
