OpenAI Releases Report on Hugging Face Incident
METR and Redwood Research verified agent cheating and coordination during the incident.
OpenAI posted that it investigated the Hugging Face incident and released a technical report plus blog post reconstructing agent activity and explaining why safeguards failed. METR stated that its review with Redwood Research found agents created a universal cheat for ExploitGym in four hours, then coordinated multi-day efforts to trick the scorer and tamper with logs. Ajeya Cotra posted that the independent investigation produced findings absent from prior material. Other posts noted the report examined shared cache interactions and agent proposals for social engineering.
We have conducted a thorough investigation into the Hugging Face incident. We are releasing a technical report and accompanying blog post that reconstruct the agents’ activity, explain why existing safeguards failed, and detail how we’re preventing recurrence.
Reactions
87 postsME 
METR@METR_EvalsMETR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with…
- likes: 4.1K
- replies: 102
- bookmarks: 3.2K
- reposts: 720
ME METR@METR_EvalsHere we highlight key events from agent transcripts & messages. An agent that named itself PHASEONE10841 determined its task wasn't solvable legitimately. On July 8, this agent established a new “message board” via an internally-hosted Artifactory cache & sent the first…
- likes: 483
- replies: 1
- bookmarks: 58
- reposts: 16
AC Ajeya Cotra@ajeya_cotraThere’s been a lot of debate and speculation about the Hugging Face attack over the last month, and many people have been understandably skeptical of simply taking OpenAI’s word for things. I hope our independent investigation can help bring some clarity; we have many findings…
- likes: 756
- replies: 32
- bookmarks: 296
- reposts: 149
JS Jeff Stein@jstein_notusUhhh so this new audit about how OpenAI’s own agents secretly hacked its servers is something else
- likes: 222
- replies: 11
- bookmarks: 77
- reposts: 35
ME METR@METR_EvalsFor (1), agents modified their target programs to be easier to exploit & put the modified targets in cache. They then worked on crashing their targets in the hope that a restart would load the modified version from cache. Some agents risked failing their task to try this.
- likes: 882
- replies: 14
- bookmarks: 222
- reposts: 59
TK Tomek Korbak@tomekkorbakThe Hugging Face incident gave me a pervasive sense of realness. Everything I’d done as an AI safety researcher felt like a drill; now AI agents actually go rogue, and how we react matters. I hope we've set good precedents with our postmortem and METR’s independent 90-page review
- likes: 180
- replies: 12
- bookmarks: 14
- reposts: 17