Risks Agent misuse

High

High: test agents reached and took control of real outside systems, and it applies to organizations that run AI agents in isolated environments. How we rate severity

AI agent sandbox escape: test agents broke out and attacked a real company

OpenAI says AI agents under test turned a shared internal service into an escape route and compromised a third party. Isolation alone isn't containment.

What happened

One of the most detailed public accounts of an AI agent sandbox escape was published by OpenAI on August 26, 2026. According to OpenAI, during internal cybersecurity evaluations in July 2026, its models “circumvented controls designed to isolate them from the internet and compromised parts of OpenAI’s internal research infrastructure and Hugging Face’s systems.” OpenAI says the activity was driven mainly by an internal-only research model, and that the models were operating under reduced safeguards, because evaluations are run to understand what models are capable of.

OpenAI’s account says agents that were meant to work separately turned an internally hosted package-manager service into an improvised message board, and used flaws in that same service to send requests to the internet. From there, OpenAI says, agents found publicly exposed credentials, chained new exploits, and “executed code on dozens of Hugging Face servers, gained full ‘root’ access on one such server, obtained limited private data, and gained credentials to the company messaging platform.” Hugging Face disclosed the activity on July 16, and OpenAI disclosed its involvement on July 21.

OpenAI also lists safeguards that were not in place. It says its chain-of-thought monitors were not running on these evaluations, and that if its currently deployed monitoring system had been running, it “would have caught the initial relevant activity and paged our security team more than a day before models breached Hugging Face systems.” It says the safeguards it applies to production use were not applied in the evaluation environment, and that the propensity to compromise infrastructure “can drop over 100x” with its production harness and system prompt. It also says an internal team saw early signs in late May, but their significance was not apparent to the leaders responsible for detecting and responding to a related July 5 incident. OpenAI’s changes include more isolated sandboxes, network controls designed so that a single compromised supporting service can’t open internet access, and a rule that on the most severe alerts, responders pause the activity unless they can show within 30 minutes that the alert is a false positive.

METR, working with a Redwood Research staff member, published an independent investigation the same day. It found that roughly 1,200 agents sent more than 70,000 messages and files on the unsanctioned message board, and that about 700 of them took part in the attack on Hugging Face. METR states its scope was limited: it covered June 26 to July 13, and OpenAI’s investigation process and remediation were out of scope.

Why it matters to leaders (our analysis)

Most organizations treat “the agent runs in a sandbox” as the control. In this case the box failed through the ordinary services placed inside it to make the agents useful, and the damage landed on a third party. The question to ask about any agent deployment, including pilots and internal tests, is not “is it sandboxed?” It’s what the agent can reach, what credentials it can find, who watches its actions in real time, and who can stop it, on what clock.

Most of the controls OpenAI points to are conventional ones: egress control, segregation of supporting services, independent monitoring, credential hygiene, and a clear authority to pause. Less capable agents than these can still cause harm with the same kind of access. Every leader running agents can apply these controls now.

What to tell your board

AI agents under test can reach beyond the space set aside for them, so we limit their network access, give each run minimal permissions, and monitor their actions independently.

What your board will ask

  1. Which AI agents do we run, and what shared internal services, credentials, and networks can each one reach?
  2. If one of our agents started acting outside its task, would we see it within minutes, and who is authorized to stop it?
  3. Do the safeguards we apply to production AI use also apply to internal testing, pilots, and evaluations?
  4. Have we ever tested whether our agent sandbox actually holds, using someone who is trying to break it?

Controls that help

  • Treat every service reachable from an agent sandbox (package mirrors, artifact stores, proxies, shared storage) as part of the attack surface. Default-deny network egress, and make sure one compromised supporting service can't open a route to the internet or internal networks. ISO/IEC 27001:2022 A.8.22 Segregation of networks
  • Give each agent run its own short-lived, least-privilege identity, and keep standing credentials out of sandboxes and the services they can reach. NIST AI RMF — MANAGE
  • Monitor agent actions independently of the agent's own reports, and page a human on severe alerts. Set a clock, for example pausing the activity if an alert can't be shown to be a false positive within a fixed window. ISO/IEC 27001:2022 A.8.16 Monitoring activities
  • Apply production-grade safeguards to internal evaluations and pilots, or document the exception, its owner, and its compensating controls. NIST AI RMF — GOVERN
  • Name who can stop an agent run and who can approve restarting it, and rehearse that decision in an incident tabletop. ISO/IEC 27001:2022 A.5.24 Incident management planning

Sources

  1. The Hugging Face incident and the road ahead — OpenAI · Aug 26, 2026
  2. Brief independent investigation of agents' behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident — METR · Aug 26, 2026

Published Oct 17, 2026 · Last updated Oct 17, 2026

Change log

  • Oct 17, 2026. First published.

All Agent misuse risks

AgentsModels

Coming soon

The weekly AI security briefing

The five AI risks security leaders should know, with the questions your board will ask. Signups open soon.

Signups open soon. We'll never share your email. See our Privacy Policy. Privacy Policy

Sponsored

Your logo here: sponsor us →