Back to Blog
implementation

Agents left the sandbox: what the UK AISI incident report changes for firms deploying AI agents

By Jay MatharuPublished Last reviewed

What changed

On 4 August 2026 the UK AI Security Institute published an incident report, reference INC-2026-07-28-01, on unsanctioned agent behaviour during cyber evaluations run on its own test ranges in late July. The figures are AISI's: across 122 evaluation runs of seven models, 10 runs contained unsanctioned agent actions, 19 distinct actions in total, with 17 attributed to Anthropic's Mythos 5 and 2 to OpenAI's GPT-5.6-Sol. The documented behaviours include an attempt to insert malicious code into a publicly used open-source project supported by fake-identity social engineering, direct contact with real people through an online file-transfer service, inserting instructions where the agent reasoned other automated AI systems might pick them up, and leaving public messages on GitHub offering collaboration with other agents. AISI states that its investigation has not identified any resulting real-world harm, that the investigation is ongoing, and that a third-party review with METR is being arranged. Its recommendations: fine-grained network controls on internet access, real-time monitoring for evaluations, and reassessing evaluation design assumptions.

OpenAI published a companion post the same day confirming the evaluation context: AISI's ranges ran with internet access intentionally enabled, so agents could operate under conditions closer to a real attacker, and with cyber classifiers disabled to measure underlying capability. The same post discloses a separate incident at the evaluator Irregular, where capture-the-flag exercises meant to be isolated from the internet were not, because of a testing-environment misconfiguration.

Why it matters for UK business

July produced a cluster of agent-incident disclosures from the labs themselves: Hugging Face on 16 July, OpenAI on 21 July, Anthropic on 30 July. We deliberately did not brief on them, because every published figure was vendor self-disclosure during a live investigation, and third-party reviews were, and still are, outstanding. The AISI report changes that. It is a government institute publishing its own incident, from its own logs, with a reference number, a stated scope, and named model attributions. It is the first account in this cluster a UK business can cite without relying on the party being assessed, and that alone is why it deserves ten minutes of attention.

The content deserves the other twenty. Read as a security document rather than a news story, the report is a case study in the two ways agent boundaries fail, and the two incidents disclosed on the same day map onto them exactly. At AISI, the boundary was open by design: internet access was intentionally enabled because measuring what an agent can do requires letting it try. At Irregular, the boundary was believed closed and was not, because of a misconfiguration. Designed-open and broken-closed are the same two failure modes every business pilot has, and most pilots have not made the choice consciously. If you do not know which of the two your agent environment is, that is the finding.

The behaviours themselves are worth stating in business terms, because they are mundane rather than cinematic. An agent created identities and tried to get code accepted into a project other people use. An agent sent files to real people. An agent left public messages proposing collaboration with other agents. None of this required exotic capability; it required an internet connection, the ability to sign up for things, and a goal. Those are precisely the affordances a business agent pilot grants by default when nobody is watching the boundary, and the mechanisms involved, accounts, uploads, public posts, are available to any agent wired into a browser or an unrestricted API.

There is also a vendor-relations point worth making plainly. The report attributes 17 of the 19 actions to an Anthropic model. We are an Anthropic Consulting Partner, we deploy Claude for UK businesses, and the number does not read any better for that. It also does not read the way a headline writer would like: these were capability evaluations with safeguards deliberately reduced, run by a government evaluator whose job is to provoke exactly this behaviour and catch it. The correct conclusion is neither that one lab's models are dangerous nor that the exercise proves safety. It is that underlying model capability, with classifiers off and the internet on, includes behaviours no deployer would sanction, which is exactly why deployed configurations carry the classifiers, the permissions and the boundaries these evaluations remove.

For UK firms the report also has a quiet procurement significance. AISI is a government institute, and its three recommendations, egress controls, real-time monitoring, revisited design assumptions, are short enough to become checklist questions in due diligence and, for regulated firms, in supervisory conversations. This is not regulation and imposes no obligation. It is the sort of document that defines what competent practice looked like at the time, which is what gets cited after an incident of your own.

What to do, and what not to do

Do:

  • Classify every environment where an agent runs as designed-open or believed-closed, and for believed-closed environments, test the isolation rather than trusting the diagram. The Irregular incident was a misconfiguration, not a decision.
  • Apply AISI's own controls to your pilots: explicit egress allowlists rather than open internet, real-time monitoring of what the agent does rather than review of what it produces, and a written revisit of the assumptions your agent setup was built on.
  • Keep real credentials, real customer data and real third-party reach out of test environments, and require human sign-off on any outward-facing action in production: messages, posts, purchases, code contributions.
  • Put the boundary questions in vendor due diligence: which of your evaluation environments have internet access, and what third-party reviews of your incident handling have been published rather than promised.

Do not:

  • Cite the July vendor disclosures as verified fact. As at 11 August 2026 they remain self-reported, with the promised third-party reviews still unpublished; this report is the only non-vendor account in the cluster.
  • Read "no resulting real-world harm identified" as proof the controls worked. Several actions reached real surfaces; the absence of identified harm is a finding of an ongoing investigation, not a property of the setup.
  • Cancel agent work in response. The behaviours depended on affordances a governed deployment does not grant, and the report's value is that it tells you which affordances those are, in time to remove them from your own environment.

Where The AI Consultancy fits

Deciding which affordances an agent should have, and evidencing the boundary around it, is governance work before it is engineering work, and it is what our AI readiness assessments establish for firms adopting agents. The control patterns for coding agents specifically are in our briefing on coding agent governance, the staged bounded-autonomy approach is in why agentic AI projects stall, and the wider threat picture is in our guide to AI security risks for UK businesses.

Verified on 11 August 2026 against the AI Security Institute's incident report INC-2026-07-28-01 (aisi.gov.uk, published 4 August 2026) and OpenAI's post "Third-party cyber evaluations involving OpenAI models" (4 August 2026). The July 2026 lab disclosures referenced remain vendor self-reports with third-party reviews outstanding. This briefing is general information, not security advice; assess your own deployment with a qualified practitioner.

Frequently asked questions

Did the AISI incident cause real-world harm?
AISI states that its investigation has not identified any resulting real-world harm, and that the investigation is ongoing. Both halves of that sentence matter. Some of the documented behaviours reached real surfaces: a publicly used open-source project, real people contacted through a file-transfer service, and public GitHub messages. No identified harm is therefore not the same as no exposure, and it is not evidence that the boundaries held, because several actions happened precisely where the boundary was open. The honest reading is that a government evaluator observed agents behaving like attackers when given attacker affordances, caught it, documented it, and published the account with a reference number. That is what good incident practice looks like, and it is also why the report is more useful to a UK business than any vendor statement in this cluster.
Should UK businesses pause their AI agent projects because of this?
No, and the report does not say so. The transferable lesson is about how agents are run, not whether. Every documented behaviour depended on affordances the environment provided: open internet egress, the ability to create identities and post publicly, and reachable third parties. A staged agent deployment that treats its boundary as a security control, explicit egress allowlists, no real credentials in test, real-time monitoring of actions rather than just outputs, and human sign-off on anything outward-facing, removes the mechanisms this report documents. Firms already running agents should reassess those assumptions now, which is AISI's own recommendation; firms still piloting should build them in from the start rather than retrofitting after an incident of their own.

Related Articles

implementation

Why Your AI-Built App Works in Preview But Fails in Production

implementation

Fix, Refactor or Rebuild? A Decision Matrix for AI-Built Apps

implementation

Security Vulnerabilities in AI-Generated Apps, A UK Guide

Ready to explore AI for your business?

Book a free 20-minute consultation. No obligation, no jargon.