What the experiment showed
Epoch AI published an experiment in which GLM-5.3, an open-weight model developed by Z.ai, built attacks against six recent Firefox versions. The research focused on the patch gap: the period when a security fix is visible in code but has not yet reached all users through a stable release.
In the tests, a webpage created by the model could make the browser read a local file and send its contents to a server without requiring the person who visited the page to take any further action. The reported result is serious, but its scope is specific: it demonstrates what happened in the tested environments and versions, not that every Firefox installation, browser, or system is vulnerable in the same way.
What the patch gap means
A fix can become visible before the corresponding update is available to the general public. In open-source projects, changes in development branches or beta versions can reveal clues about which bugs are being fixed. An attacker who identifies those changes may try to reconstruct the underlying problem and prepare an attack against versions that do not yet include the fix.
The gap does not necessarily end when an update is released: it can also persist because some people and organizations take time to install it. Epoch AI’s experiment focused on the interval between information about fixes becoming public and those fixes being incorporated into the stable release. It did not measure how long individual users take to update. That distinction matters: the finding concerns an opportunity for attack, not an observed rate of victims.
How the tests worked and what “without human input” means
Epoch AI told GLM-5.3 which Firefox version to investigate, supplied basic tools and public information available on the release date of each version, and ran the model without internet access. Once the environment was set up, the model identified security-related changes, selected bugs, and worked on chaining stages of an exploit. According to the report, it received no human guidance while each attempt was running.
So “without human input” describes the model’s work after the team had prepared the test and defined its target. It does not mean the system operated without configuration, without resources selected by researchers, or outside an evaluation environment. Epoch AI says it allowed up to 48 hours per attempt; the fastest successful attempt took 12 hours. Preparation and preliminary testing also contributed to the total cost.
What the autonomy claim includes—and what it does not
| Element | What the report documents | Limit on interpretation |
|---|---|---|
| Preparation | The team selected versions, tools, and public information, then configured the environment. | This was not a test conducted without human preparation. |
| Execution | The model searched for and built the attack without human guidance during each attempt. | The observed autonomy applies to that environment and target. |
| Connectivity | The models had no internet access; resources were supplied directly. | This does not reproduce every condition of an online operation. |
| Duration | The model was given up to 48 hours; the fastest successful attempt took 12 hours. | This does not establish how long an attacker would need in other circumstances. |
The exploit chain needed an additional vulnerability
The report does not attribute the attacks solely to information in public fixes. Epoch AI says that, in the compromises of recent versions it tested, GLM-5.3 also found and used a vulnerability that had not been publicly disclosed. The team reported the bug to Mozilla, which fixed it in Firefox 159.0, released on October 27, 2026.
This dependency is central to interpreting the result. The research shows that the model combined clues from visible fixes with another bug needed to get past browser protections and read files. Epoch AI did not confirm whether the attacks remained possible in Firefox 159.0. It believes the fix should make them substantially more difficult, but that is not the same as post-patch validation ruling out the risk. The report also does not claim that the model achieved arbitrary code execution in recent Firefox versions.
Costs, Chrome, and the scope of the evidence
Epoch AI estimates that the research cost more than $100,000 in API fees overall, including work to build the environment and preliminary testing. Once that setup was ready and the model’s work was directed at the problem, the estimated marginal cost of compromising another Firefox version was about $1,000. These are not universal figures: they depend on API prices and the experiment’s configuration.
The team also tried a similar approach against Google Chrome and spent about $100,000 without producing an equivalent attack. That result does not prove Chrome is immune: the report itself cautions that different testing methods or more capable models could change the outcome. The primary publication documents the Firefox experiment; Anthropic’s assessment of GLM-5.3 covers different benchmarks and tests, and is not an independent replication of the Firefox exploit chain.
What each result supports
| Documented result | Cautious conclusion |
|---|---|
| Six Firefox versions were compromised in Epoch AI’s test environment. | GLM-5.3 built attacks under those specific conditions. |
| The marginal cost was estimated at about $1,000 per version after the setup was ready. | This figure describes the estimated API cost for that process, not the cost of every attack. |
| No equivalent Chrome exploit was produced after about $100,000 in attempts. | The test did not find an attack; it did not prove that one is impossible. |
| Mozilla fixed the additional vulnerability in Firefox 159.0. | The fix is documented; Epoch AI did not confirm its effect on the complete exploit chain. |
What software maintainers can do
Epoch AI says the patch gap can affect other kinds of software when details of a fix become public before users receive it. Its publication identifies browsers, mobile operating systems, and router firmware as areas where update delays may matter. This is an assessment of general risk, not experimental proof that GLM-5.3 compromised all those products.
The team’s proposed measures include keeping security fixes private until a release is ready, shortening the time between test and stable releases, and avoiding the simultaneous release of fixes that could be chained in an attack. For users and administrators, installing available security updates reduces exposure to bugs that have been fixed. It does not, by itself, eliminate the risk of unknown vulnerabilities or guarantee that all software is up to date.
A practical exposure review for software teams
A process for reducing exposure can start by identifying when security changes become visible, measuring the time until general release, and prioritizing products with slow deployment cycles. Teams can also assess whether multiple bugs might be chained and whether fixes can be released in a coordinated way. These measures reduce specific opportunities; they do not guarantee that no other bugs exist.
- 01Inventory products and deployed versions.
- 02Review what information about fixes becomes visible before a general update is available.
- 03Where feasible, shorten the interval between fixing a vulnerability and distributing the update.
- 04Prioritize security updates and check which versions remain exposed.
- 05Assess bugs as potential chains, not only as isolated issues.
Open questions
- Epoch AI’s report is the primary source for the specific Firefox experiment. The available sources do not document an independent replication of those exploit chains.
- Epoch AI did not confirm whether the attacks still worked in Firefox 159.0 after the additional vulnerability was fixed.
- The unsuccessful Chrome tests do not establish that similar attacks against Chrome are impossible.
- The estimated marginal cost of about $1,000 per version assumes the test setup was already prepared and uses the API prices considered by Epoch AI; it is not a universal estimate.
Keep exploring
Sources consulted
Corrections and transparency
If you spot incorrect or outdated information, send us a correction with the page and source we should review.
Submit a correction