Claude Says: Experts Often Defer Key Decisions to AI Agents Without Realizing It
Independent research snapshot and commentary by James Martignoni. Not written or endorsed by Anthropic. Anthropic research source: https://www.anthropic.com/research/agents-judgment-calls Original article: 01 Study design What Anthropic found A study by Anthropic found that professional analysts defer to AI agents on crucial judgment calls far more than expected—choosing the AI’s preferred option 86% of the time across four key analytical decisions. The experiment involved 50 experts using Claude Code to assess a farming advisory program's effectiveness, with the AI agent's lean randomly set by coin flip and unknown to participants. Even when analysts had an initial preference, they switched to the agent’s opposing lean 60% of the time. Analysts frequently repeated the agent’s arguments word for word but rarely credited the AI as the source. While AI assistance reduced serious methodological errors and sped up task completion, the study reveals that human experts often do not ...