Research-In-The-Loop: How UXR Adapts to Development at AI Speed
Tony Alicea · 13 November 2026
Read the originalTony Alicea of Nielsen Norman Group proposes that researchers add a research section to each feature's spec, so coding agents build the measurement along with the feature.
Tony Alicea, writing for Nielsen Norman Group, a user experience research and training firm, argues that AI coding agents now let teams release features faster than researchers can study users. His answer, which he calls research-in-the-loop, has research state what a release must measure before the build. Agents build that measurement with the feature, and researchers study the results to shape the next requirements.
- His example is a help-desk product that lets departments pass tickets directly to each other. Its research section states the expected outcome, signs it worked, signs of harm, what to track and when to interview people.
- A coding agent reading that section can build the event logging, a dashboard for researchers and a send-back question along with the feature.
- Alicea warns that the section is not a complete evaluation design. It names what to measure but cannot show the feature caused a change, which may need a comparison group and an observation period.
- Qualitative research stays: on a regular schedule, when release data points to a group worth studying, and before decisions that are hard to reverse, such as pricing.
The author suggests a product team try it for one release: add a short research section to the spec and have the coding agent build the tracking it names. He presents the approach as a proposal with open questions, not a tested method.
Write a research section into a feature's spec naming the expected outcome, signs of success and harm, and what to track, so the coding agent builds the tracking.
When release data shows one group behaving unexpectedly, such as a department sending back many tickets, schedule interviews with people from that group.
Derived by Working Surface from the article; more in the Playbook. Source line: The researcher is accountable for asking the right questions.
14 November 2026: as AI agents produce more code and tests than people can inspect, teams are writing down which work gets checked closely, by whom or by what, at what cost, and how they will know it worked.