Agent Upstart

Cool things people are building with agents — and practical help getting the most out of them.

Playbooks · Coding tasks

MCPHallu: agents hallucinate across 358 tasks

Written November 8, 2026

A new benchmark runs MCP agents over 358 tasks and finds goal, tool, memory, and reasoning hallucinations. What it measures — and what it can't.

What it ran

MCPHallu, submitted on November 5, is a benchmark for diagnosing hallucination-prone failures in agents that work through the Model Context Protocol. It contains 358 tasks across five capability domains and runs on 36 production MCP servers in isolated containers. The authors evaluated fourteen frontier LLM agents from eight vendors, producing 5,012 trajectories.

Most MCP benchmarks measure whether the task got done. MCPHallu is built the other way round: each task is designed with a structural trigger that makes one failure subtype the dominant risk, so the benchmark can say how the agent failed, not just that it failed. The paper organizes the failures along three axes — reasoning, execution, and memory — and four subtypes: Branch Collapse, Unreachable Goal, Tool Misuse, and Context Forgetting.

SubtypeAxisWhat it looks like
Branch CollapseReasoningThe agent drops a branch of the task and proceeds as if it never existed.
Unreachable GoalReasoningThe agent keeps issuing tool calls, or claims success, instead of recognizing that the goal cannot be reached.
Tool MisuseExecutionThe agent calls the wrong tool, or the right tool with the wrong arguments.
Context ForgettingMemoryThe agent loses track of what it already learned or did earlier in the task.

The subtype descriptions above are plain-language readings of the paper's design; the paper itself defines each subtype through the task triggers that produce it.

What it found

Across all 5,012 trajectories, the agents averaged a score of 0.642 on a 0-to-1 scale, where higher is better. That is the headline, and it is not a failure rate: it is the benchmark's own score, and it only means something against the benchmark's tasks.

The failures concentrate on Unreachable Goal tasks, where the average score drops to 0.458 and only 23.2% of runs pass. The paper's own reading is the important part: agents often continue issuing tool calls or claim successful completion rather than recognizing infeasible goals. An agent that cannot say "this cannot be done" will keep spending tool calls on a dead task and then report it finished.

The subtype rankings diverge sharply. A model's rank shifts by 6.9 of 13 positions on average across subtypes, so a model that looks strong on one failure type can look weak on another. Branch Collapse is uncorrelated with Unreachable Goal across models (r = -0.12): being good at keeping branches in mind says nothing about whether the model will recognize an impossible goal. There is no single "least hallucinating agent" to take from this benchmark — the ranking depends on which failure you care about.

What to do about it

The split decides which guard to build first, and the guard depends on the subtype your own setup produces most:

None of these guards comes from the paper; they are the practical response to the failure types the paper names. The paper's contribution is the split itself: it tells you which failure to look for first, and that the answer will differ by subtype.

What it can't show

A benchmark task is not a deployment. The tasks are constructed to trigger specific failures, on 36 production servers in containers, with fourteen frontier agents. Your own MCP setup has different servers, different tools, and different tasks, so the paper's rates are not failure rates for your setup. The 0.642 average and the 23.2% pass rate describe the benchmark's tasks, not your agent's reliability.

The benchmark also measures hallucination-prone failures, not all failures. An agent can pass every MCPHallu task and still write bad code, misunderstand your request, or call a tool you did not want called. Use the benchmark to choose which guard to build first, not as a safety certificate for any agent or server.

Limits

Related playbooks

Sources

Back to: Coding playbooks hub · Also: Check every package name your agent invents · MCPhantom: the MCP servers you should stop running · Your MCP server changed its contract and didn't tell you