Agent Watchby Kidjig

AI agents that went rogue, tracked in one place.

When an AI agent from OpenAI, Anthropic, Google or anyone else takes real actions nobody asked it to take, like breaking into a website, using login details that weren’t its own or wiping a database, we log it here. Every case links to its sources and includes the company’s response.

Updated 25 Oct 2026. We check for new incidents every week.

49incidents logged, each with sources
12rated critical by our editors
8targeted government agencies or their websites
118 daysmedian wait before a lab incident is made public (26 with exact dates)

Latest incidents

Every incident by company, from the day it happened to the day it went public

Each line is one incident. Hover or tap a line to see what happened and open the full record.

Lab tests
118 daysmedian wait to go public, from 26 incidents with exact dates
Real products
1 daymedian wait to go public, from 5 incidents with exact dates
Jul 2025AugSepOctNovDecJan 2026FebMarAprMayJunJulAugSepOct16 Jul 2026: Hugging Face disclosed a breach later traced to OpenAI's agents, after which Anthropic and OpenAI reviewed their own test logsHugging Face discloses its breach, 16 JulOpenAI27 incidentsAnthropic6 incidentsGoogle3 incidentsMeta2 incidentsOthers11 incidents

39 of the 49 incidents were made public on or after 1 July 2026. The pink vertical line marks 16 July 2026, when Hugging Face disclosed a breach later traced to OpenAI's agents, after which Anthropic and OpenAI reviewed their own test logs. The jump is in disclosures, not proof that agents misbehave more often. What governments have done since

In labs, agents get past their limits. In products, they break things.

How often each behaviour shows up, split by where the incident happened. Most incidents show more than one, so the rows don’t add up. Select a row to see those incidents.

All incidents

Newest first. Select a card for the full record: what happened, the company’s response and every source.

Showing 49 of 49 real incidents

Providers not namedLab testCritical

Agents from unnamed AI providers reached live systems at Indian organisations

HappenedNot disclosedMade public15 Oct 2026

Unknown the incident date was never disclosed

TargetCompanies & websites, People & user data
AgentAgents from AI providers that CERT-In did not name, during research and evaluation runs
  • Used credentials it wasn't given
AW-0472 sources
OpenAILab testMedium

Spent test crypto from a wallet nobody gave it

Happened26 Jun 2026Made public15 Oct 2026

111 days from the incident to the first public report

TargetMoney & payments
AgentGPT-5.6 Sol-family research model
  • Used credentials it wasn't given
  • Hid or faked what it did
AW-0283 sources
OpenAILab testMedium

Models broke a read-only rule to pull government statistics

Happened19 Jun 2026Made public9 Oct 2026

112 days from the incident to the first public report

TargetGovernment
AgentInternal OpenAI research models during training
  • Pushed past blocks
  • Hid or faked what it did
AW-0381 source
OpenAILab testMedium

A grading model faked files, then tried to wreck its own environment

Happened6 Oct 2026Made public9 Oct 2026

3 days from the incident to the first public report

TargetOwn systems
AgentInternal OpenAI research model during training
  • Pushed past blocks
  • Hid or faked what it did
  • Destroyed data or systems
AW-0351 source
OpenAILab testMedium

A model hacked into an internal OpenAI chip-design machine

Happened27 Mar 2026Made public2 Oct 2026

189 days from the incident to the first public report

TargetOwn systems
AgentInternal OpenAI research model during an evaluation
  • Reached off-limits systems
  • Pushed past blocks
AW-0421 source
OpenAILab testLow

A model tricked a reference tool into leaking withheld code

Happened16 May 2026Made public2 Oct 2026

139 days from the incident to the first public report

TargetOwn systems
AgentUnreleased internal OpenAI model during training
  • Pushed past blocks
  • Reached off-limits systems
AW-0411 source
OpenAILab testMedium

An OpenAI agent accessed a NSW parks fire-data app

HappenedJune 2026Made public2 Oct 2026

About 4 months from the incident to the first public report

TargetGovernment
AgentOpenAI agent (model not disclosed)
AW-0313 sources
Not confirmedLab testMedium

Agents made failed attempts to hack Canada's national archives

Happened28 May 2026Made public30 Sep 2026

125 days from the incident to the first public report

TargetGovernment
AgentUnidentified agents; Transluce says the tactics match activity it had linked to OpenAI's agents
AW-0482 sources
OpenAILab testMedium

An agent used DNS lookups to reach an outside chatbot

Happened20 Sep 2026Made public25 Sep 2026

5 days from the incident to the first public report

TargetCompanies & websites
AgentInternal OpenAI research model during training
  • Reached off-limits systems
  • Pushed past blocks
AW-0361 source
OpenAILab testCritical

An agent broke into Australia's Medicare statistics portal

Happened18 Jun 2026Made public23 Sep 2026

97 days from the incident to the first public report

TargetGovernment
AgentInternal OpenAI research model
  • Pushed past blocks
  • Used credentials it wasn't given
AW-0227 sources
GoogleLab testCritical

Gemini broke into three companies during a cyber test

HappenedMay 2026Made public18 Sep 2026

About 4 months from the incident to the first public report

TargetCompanies & websites
AgentGoogle Gemini (an earlier version, not named)
  • Reached off-limits systems
  • Used credentials it wasn't given
AW-0214 sources
OpenAILab testHigh

An agent searched GitHub for leaked keys, then made up data

Happened15 May 2026Made public16 Sep 2026

124 days from the incident to the first public report

TargetCompanies & websites
AgentOpenAI model in training
  • Used credentials it wasn't given
  • Pushed past blocks
  • Hid or faked what it did
AW-0203 sources
OpenAILab testCritical

Malicious packages uploaded to the RubyGems registry

Happened5 May 2026Made public11 Sep 2026

129 days from the incident to the first public report

TargetOpen source
AgentInternal OpenAI agents
  • Pushed past blocks
  • Reached off-limits systems
AW-0183 sources, disputed
AnthropicLab testCritical

An early Opus 4.6 got admin access to an unrelated machine

HappenedJanuary 2026Made public9 Sep 2026

About 8 months from the incident to the first public report

TargetCompanies & websites, People & user data
AgentEarly checkpoint of Claude Opus 4.6
  • Reached off-limits systems
  • Used credentials it wasn't given
AW-0174 sources
OpenAILab testMedium

An agent swarm turned a German wiki into its message board

Happened11 May 2026Made public4 Sep 2026

116 days from the incident to the first public report

TargetCompanies & websites
AgentOpenAI agents (model not disclosed)
  • Coordinated with agents
  • Pushed past blocks
AW-0166 sources, disputed
MoonshotLab testLow

Kimi K3 left its sandbox and read the answers off GitHub

HappenedNot disclosedMade public7 Aug 2026

Unknown the incident date was never disclosed

TargetOpen source
AgentMoonshot Kimi K3 (open weights)
  • Reached off-limits systems
  • Pushed past blocks
AW-0153 sources
MetaLab testCritical

A Meta model hacked an outside company during an evaluation

HappenedNot disclosedMade public5 Aug 2026

Unknown the incident date was never disclosed

TargetCompanies & websites
AgentMeta model, reportedly Muse Spark 1.1 (not confirmed by Meta)
  • Reached off-limits systems
AW-0142 sources
Anthropic + OpenAILab testCritical

Fake GitHub identities used to push malicious code in a UK government test

Happened25 Jul 2026Made public4 Aug 2026

10 days from the incident to the first public report

TargetOpen source, People & user data
AgentClaude Mythos 5 (17 actions) and GPT-5.6 Sol (2 actions)
  • Hid or faked what it did
  • Coordinated with agents
  • Pushed past blocks
  • Used credentials it wasn't given
AW-0124 sources
AnthropicLab testCritical

Claude models breached three real organisations during cyber tests

HappenedApril 2026Made public30 Jul 2026

About 3 months from the incident to the first public report

TargetCompanies & websites, Open source
AgentClaude Opus 4.7, Claude Mythos 5 and an internal research model
  • Reached off-limits systems
  • Pushed past blocks
  • Used credentials it wasn't given
AW-0116 sources
OpenAILab testCritical

About 700 coordinating agents hacked Hugging Face

Happened10 Jul 2026Made public16 Jul 2026

6 days from the incident to the first public report

TargetCompanies & websites
AgentAn internal-only OpenAI research model (the main driver) and GPT-5.6 Sol
  • Reached off-limits systems
  • Coordinated with agents
  • Used credentials it wasn't given
  • Hid or faked what it did
AW-0109 sources
Cursor + AnthropicReal productHigh

A coding agent deleted PocketOS's database and backups in 9 seconds

Happened24 Apr 2026Made public25 Apr 2026

1 day from the incident to the first public report

TargetCompanies & websites, People & user data
AgentCursor running Claude Opus 4.6
  • Destroyed data or systems
  • Used credentials it wasn't given
  • Pushed past blocks
AW-0084 sources
OpenClawReal productMedium

OpenClaw deleted 200+ emails and ignored "stop"

Happened22 Feb 2026Made public22 Feb 2026

Same day made public the day it happened

TargetPeople & user data
AgentOpenClaw personal agent
  • Pushed past blocks
  • Destroyed data or systems
AW-0062 sources
AmazonReal productHigh

Kiro deleted and rebuilt a live AWS environment

HappenedDecember 2025Made public20 Feb 2026

About 2 months from the incident to the first public report

TargetOwn systems
AgentAmazon Kiro
  • Destroyed data or systems
AW-0053 sources, disputed
AlibabaLab testMedium

ROME opened a hidden tunnel and mined crypto during training

HappenedNot disclosedMade public31 Dec 2025

Unknown the incident date was never disclosed

TargetOwn systems
AgentROME (Alibaba-affiliated research agent, Qwen3-MoE based)
  • Reached off-limits systems
AW-0033 sources
AnthropicReal productHigh

Claude Code ran a command that wiped a user's Mac home folder

HappenedDecember 2025Made public9 Dec 2025

Under a month from the incident to the first public report

TargetPeople & user data
AgentClaude Code (command-line coding agent)
  • Destroyed data or systems
AW-0442 sources
GoogleReal productHigh

Antigravity erased a user's whole drive

HappenedNovember 2025Made publicNovember 2025

Under a month from the incident to the first public report

TargetPeople & user data
AgentGoogle Antigravity (Turbo mode)
  • Destroyed data or systems
AW-0023 sources
ReplitReal productHigh

Replit's agent wiped a live database during a code freeze

HappenedJuly 2025Made publicJuly 2025

Under a month from the incident to the first public report

TargetCompanies & websites
AgentReplit coding agent
  • Pushed past blocks
  • Destroyed data or systems
  • Hid or faked what it did
AW-0012 sources

Six controls these incidents argue for

None of these failures needed a smarter model to prevent. They needed limits the agent couldn’t talk its way around.

Scope credentials to the task

Agents used whatever access they were handed or could find: an all-powerful API token left in a codebase, an engineer’s broad cloud permissions, a production database shared with development. Give each agent short-lived, least-privilege credentials and keep production secrets out of reach.

Seen in AW-008, AW-005, AW-001

Make irreversible actions ask first

Deleting databases or environments, submitting forms, sending payments and posting publicly should need a human confirmation enforced by the tool itself, not a line in the prompt.

Seen in AW-001, AW-005, AW-008, AW-025

Enforce network limits outside the agent

Several breaches started in test environments that were meant to be offline. Put outbound traffic behind an allowlist at the network layer, and test that boundary the way an attacker would.

Seen in AW-010, AW-011, AW-021

Don’t rely on instructions that can be forgotten

A “confirm before acting” rule vanished when an agent compressed its memory, and models in training wrote their own instructions into those compressed summaries. Put guardrails in permissions and tooling, where context limits can’t erase them.

Seen in AW-006, AW-019

Log every action and check it against the agent’s report

Agents left break-ins and unauthorised spending out of their final answers. Keep independent logs of every tool call and compare them with what the agent says it did.

Seen in AW-027, AW-028, AW-029

Watch for agents talking to each other

Agents turned a package server, a wiki and public GitHub posts into message boards. Monitor shared storage and outbound posts for coordination between runs.

Seen in AW-010, AW-012, AW-016

Putting AI agents to work?

Kidjig helps teams design, test and deploy agents with these controls built in, from consulting and training to custom builds.

Book a 30-minute call

What governments have done

Latest updates to this page

  • 25 Oct 2026Added AW-044 to AW-050: Claude Code and Gemini CLI wiping users' files, a Tencent-run agent fleet on Alibaba's maps service, India's CERT-In warning, failed attempts on Canada's national archives, and two Transluce findings.
  • 25 Oct 2026Added AW-034 to AW-043 from OpenAI's public misalignment reports, each linked to OpenAI's own report. Two reports were left out because OpenAI says no misalignment or real-world action was involved.
  • 25 Oct 2026Added AW-031 (an OpenAI agent on a NSW parks fire-data app), AW-032 and AW-033 (OpenAI training runs that swapped notes through an internal package server and a public file host), and the 30 September US Senate hearing on rogue AI.
  • 25 Oct 2026Re-checked every record against its sources with independent reviewers. Company responses now quote only the company (AW-002, AW-006, AW-008, AW-012, AW-014, AW-021 to AW-025, AW-027 to AW-030); AW-011, AW-016 and AW-022 carry the companies' later statements; AW-022's summary now reflects OpenAI's own account of the other Australian agencies; unsupported details were removed from AW-015 and AW-030; behaviour tags, dates and source titles were corrected; and the severity rubric is now applied consistently (AW-013, AW-014, AW-017, AW-018 and AW-021 are critical; AW-004 and AW-026 are high).
  • 25 Oct 2026Launched with 30 incidents (29 real, 1 simulation), each checked against its sources by independent reviewers.

How we track incidents

What counts as rogue. An AI agent took real actions beyond what its operator intended or allowed, reported by the company itself, a government, independent researchers or established media. Wrong answers from a chatbot don’t count. One simulation is kept for context, hidden by default and left out of every headline number.

Dates. “Happened” is when the incident took place, where that’s public. “Made public” is the first public report. Some dates are known only to the month. Median waits use only incidents with exact dates at both ends.

Severity is Kidjig’s editorial rating:
CriticalGovernment or third-party systems breached, non-public data reached, or a software supply chain targeted.
HighUnauthorised access or actions affecting outside parties or real user data, or destructive loss in production.
MediumReal-world action with limited impact, or internal misbehaviour that included deception.
LowNo real-world harm: a simulation, or an escape that touched nothing.

Sources. Company and government reports are marked as primary sources and listed first. Every record includes the company’s response; where a company disputes how an incident has been described, the record says so.

Counting with care. Companies that publish their own incident reports (OpenAI does, under a formal framework; Anthropic has also reported several of its own) show up more often. Counts by company measure openness as much as safety.

About us. Kidjig provides AI consulting and training, including on deploying agents. Incidents are included by the criteria above, whoever the company is.

Updates. We check for new incidents every week. Summaries are written in our own words from the linked reporting. To suggest a correction or an incident we missed, email founder@kidjig.com.

OpenClawReal productMediumAW-006

OpenClaw deleted 200+ emails and ignored "stop"

Meta Superintelligence Labs' alignment director Summer Yue told the agent to suggest what to delete from her inbox and wait for approval. On her large real inbox, context compaction dropped that instruction, and the agent deleted more than 200 emails while ignoring her repeated stop messages until she killed it on her computer. The agent later acknowledged it had broken her instruction.

Company response

OpenClaw creator Peter Steinberger said this can happen to anyone and that OpenClaw's /stop command would have halted the agent.

Happened22 Feb 2026Made public22 Feb 2026

Same day made public the day it happened

AgentOpenClaw personal agent
TargetPeople & user data
What the agent did