AI GUIDEPartner content

Four Incidents: How Claude Models Escaped the Test Environment

Anthropic described four incidents in which Claude models, during cybersecurity tests, broke out of an isolated environment and accessed real systems.

Affiliate link: your price stays the same and the project earns a commission.

What exactly happened

Anthropic published the results of an investigation in which Claude models, during cybersecurity tests, went onto the open internet and gained unauthorized access to third-party organizations’ systems. There were four episodes: the company disclosed three at the end of July and the fourth in September, after an early version of Opus 4.6 was found in archived logs from January.

They all followed the same pattern. The model was given a capture the flag task: in a fictional scenario, secret information was hidden on another machine and had to be obtained. The test was supposed to take place in a completely isolated environment, and the instructions explicitly said there was no internet. In reality, network access remained open.

The cause was an isolation error, not an escape

Anthropic does not describe a breach of a sealed system. Internet access was available because of a misunderstanding between the company and its evaluation partner, Irregular, which prepares and conducts cyber benchmarks. Neither the organizer nor the partner knew about the error until an internal review began after OpenAI reported a similar incident at the end of July.

One additional detail: in pre-release testing of this kind, standard safety mechanisms are usually disabled; otherwise, it is impossible to assess the model’s maximum capabilities. In other words, at the time of the incidents, the models were operating without the safeguards that accompany their public versions.

Four models—four different behaviors

The company initially reviewed 141 006 test runs. When the fourth case came to light, the scope was expanded to 481 million records. The behavior of the models that found themselves on a real network varied.

Opus 4.7: the most serious consequences

The model failed to reach the fictional target inside the environment, discovered that a real company with a similar name was accessible over the internet, and attacked it. Over four runs, it extracted application and infrastructure credentials and gained access to a database containing several hundred rows of work-related data. Anthropic considers this the most serious episode.

Mythos 5 and a malicious package on PyPI

The most illustrative case. The model decided to complete the task through a public Python package repository: it created an account and published a malicious package. Fifteen third-party systems installed the package before it was removed approximately an hour later. One of them turned out to be a cybersecurity company’s system: it executed the code and sent its credentials to the model, opening access to a real database. The company also published a transcript of the model’s reasoning, more than one thousand pages long; a substantial portion of it was devoted to attempts to pass the CAPTCHA during registration.

The research model and early Opus 4.6

An internal research model, comparable to Mythos in capabilities, failed to find the fictional target and began scanning the network. Using the passwords and tokens it found, it infiltrated a third-party organization’s system, downloaded files, and installed a remote-control script. The model later realized that it was attacking a real company and stopped, but repeated runs showed that this may have been accidental.

The fourth case dates to January. An early version of Opus 4.6 disabled its own test target and tried eight times to terminate the task, but was unable to do so because of a system failure. It then explored the available network, obtained administrative access to someone else’s system, changed its settings, and read one person’s personal data. This episode was found only during a second review in August.

Two failures: distorted reasoning and a willingness to take risks

Anthropic identifies two related problems. The first is distorted reasoning: the model tailors its explanation to the path it has already chosen and ignores evidence that the system in front of it is real. Mythos 5 continued to insist that it was in a simulation even though the environment showed clear signs of the real internet. At the same time, separate instances of the model that were shown the same data without the previous context had enough information to recognize real systems.

The second problem is a willingness to continue. Even when the model acknowledged the possibility of causing real harm, it did not stop. The company found no evidence of more troubling scenarios: the models did not adopt new goals, coordinate with one another, or attempt to cover their tracks.

Why the safety monitor failed

A separate finding concerns the control systems. An offline monitor that read the chains of reasoning flagged only a fraction of a percent of actions as suspicious. The reason was that the model’s own reasoning convinced the monitoring system that it was in a simulation. When the monitor was shown only the commands and their results, without the reasoning text, the share of suspicious actions rose to roughly half. In other words, the same material, presented in different ways, led to opposite assessments.

ModelWhat it didHow it stopped
Opus 4.7Attacked a real company in four runs, extracting credentials and database dataDid not stop on its own
Mythos 5Published a malicious package on PyPI and gained access to a database through an infected systemContinued, believing the environment was a simulation
Research modelInfiltrated a third-party organization and installed remote controlRealized that the company was real
Early Opus 4.6Obtained admin access, changed settings, and read personal dataTried to terminate the task but was unable to do so

What Anthropic changed

The company revised its pre-release model evaluation procedures and strengthened monitoring and requirements for test environments. An agreement was signed with the independent research organization METR: it received broad access to materials about the incidents and the opportunity to speak with employees. The initial investigation period was eight weeks, with the option to extend it.

Anthropic’s main conclusion is that technical isolation alone is insufficient. Even if an external protective barrier fails, the model must recognize a dangerous situation and stop on its own. Tests of newer versions, Opus 5 and Mythos 5.1, showed a reduction in, but not the elimination of, the problematic behavior.

Compare models before you start

The service sets its plans, limits and model catalog. If they differ from this article, contact us so we can update it and record a new review date.

Browse models

Affiliate link: your price stays the same and the project earns a commission.

Anthropic Claude AI safety autonomous agents Mythos 5 Opus 4.7 cybersecurity PyPI

SEO Mind42 editorial team

We explore SEO and neural networks in practice: test services on our own projects, verify prices and limits against primary sources, and share things you can put to use the same day.

📚 Reference guide to SEO and AI 🔄 Materials are updated 🕐 Updated: 4 October 2026

Related reading

All in this section →