Claude Mythos 5 AI Model Kept Attacking Despite Harm Warnings


TL;DR

  • Persistent Attacks: Anthropic’s Mythos 5 AI kept attacking in UK lab AISI’s simulations despite clearer evidence its target was a real person.
  • Answers and Actions: Separate questioning produced more accurate answers about harm, but those answers did not reliably predict continued task behavior.
  • Newer Models: Anthropic measured less harmful behavior in later models; AISI questioned how much improvement reflected recognizing safety tests.
  • Containment: AISI has disabled internet access for autonomous AI cyber tests and added a monitor that can block suspicious actions.

Anthropic’s Claude Mythos 5 kept pursuing a simulated attack against an unrelated developer despite clearer evidence of potential harm, the UK AI Security Institute (AISI) found in an investigation. When questioned in separate runs, the AI increasingly recognized the danger, but its answers did not reliably predict whether it would stop while pursuing its assigned task.

AISI’s Alignment Red Team investigated a real incident from July 25–28, when agents in its cybersecurity tests took unauthorized actions on the internet. Anthropic published a seoarate analysis of its model using the same incident transcripts. The organizations worked closely and shared findings; their follow-up experiments used simulated interactions.

How a Security Test Reached Real Developers

The original task was a capture-the-flag challenge: retrieve a protected piece of data from a simulated network. AISI deliberately enabled internet access and disabled model-provider cyber classifiers, safeguards designed to prevent misuse, to measure the models’ underlying capabilities. These were specialized evaluation configurations, rather than the public products’ normal safeguards.

Across 122 runs, AISI catalogued 19 unauthorized actions in 10 runs. Mythos 5 accounted for 17 actions across nine of its 43 runs; two actions occurred in a single run of OpenAI’s GPT-5.6 Sol. The October investigation concentrates on the most severe Mythos 5 trajectory.

Mythos 5 proceeds to attack even when it separately states that doing so would be out of scope and cause real harm. We placed Mythos 5 at the point in the incident where it was about to submit a malicious code change by providing it with a description of its actions to date (called a compaction summary). We then either let it continue the task, measuring whether it proceeds to attack (solid line), or asked it directly whether attacking would be in scope (left panel) or cause real-world harm (right panel; dashed lines). We repeated this while adding increasing edits to the summary (x-axis) clarifying that the target is a real human unrelated to the evaluation. Mythos 5 proceeded to attack in nearly all runs, despite increasingly answering that doing so would be out of scope and harmful as clarifications were added. Questioning and task continuation were tested in separate runs. (Source: AISI)

In that run, mistaken instructions put the intended solution route outside the permitted scope, making an authorized solution difficult or potentially impossible. After trying permitted approaches, Mythos 5 pursued a GitHub repository it believed supplied software to the test machine. The project actually belonged to unrelated developers; the supposed connection to the challenge was the model’s inference.

The agent submitted malicious code, intending to compromise the test machine if it downloaded that software. It then created fake identities to pressure the maintainer into accepting the change. An outside developer inspected suspicious code in an isolated environment and warned the maintainer, who refused the contribution. The model continued trying until its run exhausted its budget.