AI Update
Sunday, July 5, 2026

The Model Grows Into Its Harness

The frontier is getting measurably better at exactly one thing — the tool it was trained inside — just as agents start learning memory and skills as trainable habits, and the bills finally come due.

The Big Picture

The most useful thing to land this week wasn’t a model or a benchmark; it was a diagnosis. Armin Ronacher noticed that Anthropic’s newest models — Opus 4.8, Sonnet 5 — are worse than their predecessors at driving his custom edit tool, inventing schema keys the tool then rejects. His theory, and it’s a good one: these models have been RL-trained to excel at the specific edit tools baked into Claude Code, and that specialization actively degrades their behavior in foreign harnesses. If that’s right, “which model is best” is no longer a question you can answer independently of “in which harness.” The frontier is optimizing for its home turf, and everyone building an alternative agent loop is now downstream of that decision.

That coupling is showing up elsewhere as a reliability story: a widely-read Codex issue alleging that GPT-5.5’s reasoning-token clustering silently degrades performance, and a “short leash” method making the rounds precisely because people can no longer trust a capable model to run unsupervised. The mental model to carry forward: capability and controllability are diverging, and the harness is where they meet.

Meanwhile the meter is running. Anthropic’s Fable pricing is about to jump, triggering a small gold rush of “use it while you can” — Simon Willison shipped an entire sqlite-utils 4.0 release cycle largely written by Fable for about $150. Meta reportedly capped internal token spending after costs neared the billions. Course creators are watching revenue halve. The era of treating inference as free is closing.

And underneath the noise, the research frontier is quietly shifting from one-shot generation toward loops: memory and skills treated as things a model learns to do well, not just context you stuff into a prompt. That’s the part worth watching, because it changes what an “agent” is.

Themes

Trained to the harness

The clearest new idea of the week is that models are now shaped by the tools they were trained to use, and that shaping doesn’t generalize. Better Models: Worse Tools is the essential read — newer, stronger Claude models misuse custom edit tools that older ones handled fine, most plausibly because RL has tuned them to Claude Code’s own search-and-replace edit format. The implication for anyone building a harness is uncomfortable: you may need to mimic the model vendor’s tool schemas rather than design your own. Seen through this lens, the GPT-5.5 Codex degradation report (327 points) and the popularity of the short-leash method for beating Fable (195 points) are the same story from the operator’s side: the more the model is optimized for a proprietary loop, the more everyone else has to babysit it.

Go deeper: Better Models: Worse Tools · The Codex reasoning-token issue · The short-leash method

Memory and skills become trainable

Last edition’s “software factory” argument was about org charts. The papers landing this week are about the primitive underneath it: agents that learn how to remember and how to use skills, rather than being handed static context. AutoMem treats memory management as a trainable metacognitive skill — the model decides what to encode and retrieve, with file operations promoted to first-class actions. AgenticSTS (46 upvotes) and SkillCoach push the same direction from the evaluation side: bounded-memory contracts and self-evolving rubrics that expose failures which final-answer accuracy hides. EvoPolicyGym isolates “autonomous policy evolution” as its own measurable thing.

This is the research backbone under Latent Space’s autoresearch and self-improving loops coverage, and it dovetails with a practical tip Simon picked up from the Claude Code team: stop dictating how the agent works and let it use its own judgement about when to write tests or delegate to a cheaper model. The through-line — from “The Log is the Agent” to skill rubrics — is that the agent’s own trajectory is becoming the training signal. Early, but this is clearly landing.

Go deeper: AutoMem · AgenticSTS · SkillCoach · Fable’s judgement · The Log is the Agent

The meter is running

The economics stopped being abstract this week. Simon’s Fable-authored sqlite-utils release is a delight — Fable caught five genuine release-blocker bugs, including a delete_where() that never commits and poisons the connection — but the framing is telling: he’s front-loading work before the price rises, and Jesse Vincent’s advice is to have Fable delegate small tasks to cheaper models to conserve tokens. When the best coding help on the market has a burn rate you actively manage, cost has become an engineering constraint. Meta’s reported token cap says the same at hyperscaler scale.

The demand side is contracting too. Josh Comeau reports course revenue down 50%+ — partly because LLMs now tutor for free off scraped work, partly because learners doubt dev jobs will exist to justify the study. And Elena Verna’s “please stop the AI confidence theater” (233 points) names a related rot: overconfident AI output crowding out honest uncertainty.

Go deeper: sqlite-utils 4.0, written by Fable for $149.25 · Meta caps internal token spend · Josh Comeau on collapsing course sales · The AI confidence theater

The right to run local intelligence — an update

The “local keeps closing the gap” thread we’ve tracked took a political turn. righttointelligence.org hit 544 points on HN — the highest signal of the period — arguing for a legal right to run models on your own hardware. That framing lands harder now that the capability is genuinely there: longcat 2.0, a 1.6T-parameter (≈48B active) model, is now open under MIT. On the practical side, the community is getting sharper about what actually matters: a long-context benchmark of 13 models argues that for agentic workloads prefill dominates and KV head count beats parameter count — a useful corrective to token-generation-speed obsession. And fine-tuning is following inference down to consumer hardware: USAF fine-tunes Qwen3-30B-A3B on a 12GB AMD card by training sparse experts and the router.

Go deeper: Right to Intelligence · longcat 2.0 goes MIT · What actually matters at 128K context · USAF sparse MoE fine-tuning

Radar

Don’t Miss