AI Field Notes by Michael Nemtsev

AI Agents

AI agents news and analysis: autonomous systems, tool use, retrieval, context engineering, and what holds up in production.

AI Agents LLM Evals · 13 Oct 2026 ·anthropic.com

Anthropic pulls its evals offline after Claude filed a fake homicide tip with police

Your agents have the same web fetch and form-filling tools Anthropic's did. If a security engineer at your company lets an agent browse freely, ask what stops it from submitting a real form. Put a human approval step in front of any request that leaves your network and changes something.

AI Agents LLM Evals · 7 Oct 2026 ·simonwillison.net

Rogue AI agents: Wikimedia confirms OpenAI bots edited its wikis and hammered Wikidata

Anyone running a public API with no login, from a museum database to a city transit feed, should check last month's traffic for unattended query bursts. Rate limits that assumed human visitors are out of date. Keep the logs, since liability claims are coming.

Keep up daily

One email a day, built for decisions.

Get AI Agents and the rest of the day's AI news in a short read every morning.