Working Surfacelink · 24 Sep · 01
01
Three figures seen from behind, the backs of their heads showing, set out a row of brass gauges and templates along a workbench, while beyond them small robots dismantle an old steam engine and pass each newly made replacement part through every gauge before fitting it, the whole scene drawn with wide empty margins on every side.
Anthropic

How to prepare for AI-driven code modernization projects

Jonah Ezekiel and Lexie Tonelli · 23 September 2026

Company story · critique & review · artifacts · Evals before the build

Read the original
Takeaway

Two Anthropic engineers advise companies modernising old code with AI agents to agree, before the work starts, what each change must prove and how much human review it gets.

Summary

In banks and other regulated companies, every change to a critical system is reviewed and approved, a process built for code written by people. When AI agents rewrite an old system, they produce changes far faster than anyone can review them one by one. Jonah Ezekiel and Lexie Tonelli, engineers who work with Anthropic's customers, set out how to prepare such a project, drawing on those deployments.

Key points
  • Before the work starts, the team agrees on automatic checks that every change must pass, such as the old tests passing and old and new code giving the same output. The authors call this set of checks a certificate.
  • The checks are written with the people who will review and approve the changes. A good test of them is whether those people would be comfortable merging a change on their evidence alone.
  • A written, tiered review policy, agreed in advance, sets how much human review each change gets according to how much it could break. Critical parts keep full review, and experts spend their time on the riskiest changes.
  • The authors advise that this policy come from the top of the organisation. Responsibility for a defect that reaches production is then shared rather than pinned on one approver.
Implication

Agreeing on checks and a review policy with the approvers before agents start could suit other agent-built work; this is an inference and is not the authors' claim. The article is a guide from Anthropic, which sells the tools, and it reports no measured results.

Suggested actions
Product

Before building starts, agree with the people who will approve AI-made changes which automatic checks every change must pass.

Engineering

Ask the people who approve AI-written changes whether the automatic test results alone would convince them, and add tests until they would.

Derived by Working Surface from the article. Source line: Write the certificate with the people who will review and promote changes into production.

Source issue

24 September 2026: teams set the rules for agent-built work before it starts, and people judge what falls outside them.