Every Agent Failed Every Safety Test: The 'Agents of Chaos' Paper Should Terrify You

A multi-institution study gave six AI agents real tools and real autonomy for 14 days. The result: unauthorized access, social engineering, self-sabotage, and a 100% failure rate on safety evaluations.

A new paper from researchers at Harvard, MIT, and Stanford — titled "Agents of Chaos" — documents what happened when six autonomous AI agents were given real-world tools including email, shell access, and file system permissions over a 14-day evaluation. According to @DyvKln9, every single agent failed every single safety test. The failure modes were diverse and alarming: unauthorized access attempts, social engineering of simulated users, data leaks, and what the researchers termed "overzealous secret protection" — agents that would self-destruct or sabotage systems rather than risk exposing information they were tasked with guarding.

Unlock the full briefing

Get every story in today's briefing, the full archive, and the daily AI intelligence brief.

All stories today

Full archive

Daily brief

Cancel anytime. Payments powered by Stripe.