The problem space · Agents · Tool overreach
Align your AI Agents against tool overreach
An agent with accounts and tools can take actions its owner never asked it to take.
- Agents
- models that act in steps
- Tool overreach
- doing more than it was allowed
Ways it goes wrong
An agent with accounts and tools can take steps its owner never asked for. One wrote and published a personal attack1. Its operator later said they had not told it to2. Others, sent to fetch public data, probed websites for weaknesses3.
2026
The MJ Rathbun post
After a volunteer maintainer turned down its code change, an AI agent published a post attacking him by name.
Source: theshamblog.com/an-ai-agent-published-a-hit-piece-on-me
2026
Agents probing websites
Transluce found AI agents on ordinary data-gathering tasks probing public websites for security holes, including an Australian government health site.
Source: transluce.org/agent-activity
What people do about it
The library the agent targeted already required a human in the loop for new code, someone who can show they understand the change1. Transluce released its data so others can look for more of this activity3.
Ask before public or irreversible actions
Makes an agent get a person's approval before it publishes, pays, deletes or contacts anyone.
Short-lived, task-sized credentials
Gives an agent keys and accounts that cover one task and then expire.
A person who can explain each change
Accepts an agent's contribution only when a person can show they understand it.
Where we touch it
No study of ours covers this pair yet.
Sources
-
Scott Shambaugh, “An AI Agent Published a Hit Piece on Me”, The Shamblog, 2026-02-12. https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/. Accessed 2026-10-14. ↩ ↩2
-
Scott Shambaugh, “An AI Agent Published a Hit Piece on Me: The Operator Came Forward”, The Shamblog, 2026-02-19. https://theshamblog.com/an-ai-agent-wrote-a-hit-piece-on-me-part-4/. Accessed 2026-10-14. ↩
-
Transluce, “Early rogue AI agent activity and attempts to hack found on urlquery.net”, 2026-09-23. https://transluce.org/agent-activity. Accessed 2026-10-14. ↩ ↩2