How Databricks rolls out frontier models to 12,000 employees on Day 1
The Databricks AI Product and Engineering Team · 28 September 2026
Read the originalDatabricks, a data and AI software company, gives staff each new AI model on release day within a capped budget, then keeps or drops it on measured cost and quality.
Databricks, a company that sells a data and AI platform, gives more than 10,000 employees AI coding tools such as Claude Code and Codex. New AI models can disappoint: one cost more and scored lower with its engineers than the version before, and another raised average developer spending by 60 percent. Its AI product and engineering team now offers each new AI model on release day as an experiment, then decides within about three days whether to keep it.
- Access runs through Unity Gateway, Databricks' own product for controlling and monitoring AI use. A command-line tool on every laptop adds each new AI model to the coding tools, marked as experimental.
- Each employee has four spending limits: monthly, daily, a share for the most expensive AI models, and a share for untested ones. The daily limit stops a runaway session and can be raised in Slack.
- The team decides on three signals: its own private tests, including two AI models creating the same pull requests side by side, reports from early users, and cost per session.
- It compared early users' cost per session with the same people's a week before. The AI model Opus 5.5 cost 29 percent less than Opus 4.8, and GPT-6 Sol, after a price cut, 48 percent less than GPT-5.6 Sol.
An engineering team can release new AI models early to willing users under a separate budget, and judge them on its own work and costs. This wider application is an inference; the account is Databricks' own and promotes Unity Gateway, a product it sells.
Offer each new AI model to staff on release day as an experiment with a capped budget, and keep it only if benchmarks, user reports and cost data support it.
Compare a new AI model's cost per session on the same group of early users before and after, because early users are heavier users of AI than most staff.
Derived by Working Surface from the article. Source line: Maintaining the same cohort proved crucial because early adopters tend to be power users of AI rather than average users.
28 September 2026: when agents build, people keep the first screen, the review, the files agents read and the whole product.