Memindex

September 23, 2026

Tool Catalogs Are Becoming a Retrieval Problem

MCP's new roadmap makes tool discovery a ranking problem, and the stateless July spec is what makes caching and progressive disclosure viable.

If you build retrieval systems, the most consequential recent protocol change isn't about documents. It's about tools — and it's the same problem wearing a different hat.

MCP's lead maintainers, David Soria Parra and Den Delimarsky, published an updated roadmap on August 22, 2026, naming five priority areas: agentic messaging primitives, HTTP-native transport unification, agent identity and enterprise security, improved primitives, and SDK developer experience. The one that should matter most to retrieval teams is buried in "improved primitives."

Tool selection is ranking, and it degrades with corpus size

The maintainers state the problem without euphemism: connecting to a server with a hundred tools means the model pays for that entire surface before the user has asked a single question, and tool selection tends to get worse as the list grows. They're starting a progressive discovery effort so a server can offer a small entry point and reveal more of its catalog as the conversation narrows.

That is a retrieval architecture decision expressed as a protocol change. Progressive discovery means the tool catalog stops being a flat manifest stuffed into the system prompt and becomes something you query — with an entry point, a narrowing step, and an implicit relevance function. Everyone shipping a large internal MCP surface has already built a private version of this: a router tool, a semantic index over tool descriptions, a hand-tuned namespace hierarchy. Standardizing it means the ranking quality question moves from your prompt-engineering backlog into the protocol's contract, and the failure modes become familiar ones — recall misses on the narrowing step, stale catalogs, descriptions written for humans rather than for embedding.

The July spec is the enabling layer

None of this is free-standing. The 2026-07-28 release removed the initialization handshake and protocol-level session state (SEP-2575, SEP-2567), so MCP servers can scale horizontally like any stateless HTTP service — no sticky sessions, no session affinity at the load balancer. Clients can call server/discover to learn a server's supported versions and capabilities up front, and list results are now cacheable (SEP-2549).

Cacheable list results with a TTL are the unglamorous precondition for progressive discovery: if the catalog is a queryable index, clients need to know when their slice of it is stale. The same release also makes multi-server deployments behind a load balancer practical, since a client no longer has to stay pinned to one server.

What to actually do

Two caveats. The roadmap doesn't announce availability — some foundations shipped in 2026-07-28, while other parts are extensions, open design work, or IETF drafts , and the agent identity track in particular remains largely draft. Tool result formats are still ambiguous: a tools/call response can express the same output in multiple shapes, and servers have no way to know which shape a client will show the model.

If you run an MCP surface: migrate off sessions first, then start treating tool descriptions as a retrieval corpus — measure selection accuracy at 10, 50, and 200 tools before the protocol makes that number your problem.

Sources

  1. [1] [2602.02007] Beyond RAG for Agent Memory: Retrieval by Decoupling and Aggregation
  2. [2] Retrieval-Augmented Generation for Natural Language Processing: A Survey
  3. [3] A-MEM: Agentic Memory for LLM Agents
  4. [4] Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrieval
  5. [5] Knowledge and Memory Beyond RAG: Why 2026 Agents Need a Write Path, Not Just a Retriever | by Micheal Lanham | Apr, 2026 | Medium
  6. [6] The Agent Memory Wars Are Here - AgentConn Blog
  7. [7] MemGraphRAG: Memory-based Multi-Agent System for Graph Retrieval-Augmented Generation
  8. [8] RAG vs Agent Memory: What Each Does and When to Combine Them — supermemory
  9. [9] Agent Memory Vs RAG: What Breaks At Scale 2026 (Analyzed)
  10. [10] Enterprise Knowledge Base Platforms: Top 10 Picks for 2026
  11. [11] AI Knowledge Base: The Complete Guide for 2026 | Slack
  12. [12] Best Enterprise Knowledge Search Tools 2026
  13. [13] The definitive guide to AI‑based enterprise search for 2026
  14. [14] The AI Enterprise Search Guide for IT and Knowledge Leaders
  15. [15] Best Enterprise Search Tools 2026 | AI Knowledge Discovery vs Glean
  16. [16] 12 Best Knowledge Base Software for 2026 (Tested & Compared)
  17. [17] Enterprise Knowledge Base for AI: Architecture Guide
  18. [18] Build enterprise search for agents with Amazon Bedrock Managed Knowledge Base | Artificial Intelligence
  19. [19] Model Context Protocol Blog
  20. [20] The 2026-07-28 Specification | Model Context Protocol Blog
  21. [21] The 2026-07-28 MCP Specification Release Candidate | Model Context Protocol Blog
  22. [22] The New MCP Roadmap | Model Context Protocol Blog
  23. [23] Model Context Protocol
  24. [24] Model Context Protocol prepares to break with its stateful past
  25. [25] Roadmap - Model Context Protocol
  26. [26] Model Context Protocol is going stateless to make scaling simpler | InfoWorld
  27. [27] The next generation of MCP | Cloudflare Blog
  28. [28] MCP is now stateless: what the 2026-07-28 update changes
  29. [29] MCP Goes Stateless, and Developers Ask Whether That Just Makes it an API Again - InfoQ
  30. [30] Scaling AI Agent Infrastructure with the MCP Stateless updates - Google Developers Blog
  31. [31] Stateless MCP: how it changes the way agents call tools | Nango Blog
  32. [32] Stateless MCP: What the 2026-07-28 specification changes for security | Equixly
  33. [33] MCP Went Stateless: What the 2026-07-28 Spec Actually Changes - DEV Community
  34. [34] Stateless MCP: What the 2026-07-28 Spec Changes for Tool Builders
  35. [35] MCP unveils new roadmap, focusing on five areas including long-running processing and AI agent authentication. - GIGAZINE
  36. [36] The future of MCP: 2026 roadmap, enterprise adoption, and what comes next
  37. [37] MCP's New Roadmap Moves Beyond Simple Tool Calling | NxCode
  38. [38] The 2026 MCP Roadmap | Model Context Protocol Blog
  39. [39] The New MCP Roadmap: Progressive Discovery and Agent Auth - Developers Digest
  40. [40] The 2026 MCP Roadmap | AI Agent Engineering
  41. [41] The New MCP Roadmap | Artem Daniliants
  42. [42] MCP Roadmap 2026: 5 Priorities Explained | explainx.ai Blog | explainx.ai
  43. [43] AI Model Releases Tracker (Late 2026): Complete LLM Evolution, Benchmarks & Frontier Breakthroughs
  44. [44] Kimi (chatbot)
  45. [45] Apertus (LLM)
  46. [46] Google Gemini
  47. [47] AI Updates Today (September 2026) – Latest AI Model Releases
  48. [48] Qwen
  49. [49] AI Model Releases: September 2026 Tracker and Dated Ledger
  50. [50] AI Model Context Window Comparison 2026: Advertised vs. Real - elvex
  51. [51] ChatGPT
  52. [52] Qdrant Cloud launches high-performance vector database features for AI workloads - SiliconANGLE
  53. [53] Qdrant pockets $50M to push composable vector search
  54. [54] Vector Launch
  55. [55] LanceDB: Funding, Team & Investors | Startup Intros
  56. [56] Best Vector Databases in 2026: Tested & Ranked | DevToolLab Blog
  57. [57] Qdrant raises $50M in funding to fuel vector database growth | TechTarget
  58. [58] Best Vector Databases in 2026: Pricing, Scale Limits, and Architecture Tradeoffs Across Nine Leading Systems - MarkTechPost
  59. [59] Vector Database & Retrieval Infra Fundraising Guide (2026)
  60. [60] Vector Database Market Statistics 2026
  61. [61] Progressive Tool Discovery: An MCP Client-Side Pattern
  62. [62] Comparing Progressive Discovery and Semantic Search for Powering Dynamic MCP
  63. [63] docs/spec_mcp_progressive_disclosure_v2_0.md · MCP-1st-Birthday/mcp-extension-progressive-disclosure at main
  64. [64] MCP Protocol Deep-Dive: How Tool Discovery Actually Works Under the Hood - DEV Community
  65. [65] Progressive Tool Discovery & The Evolution of MCP - Andreas van den Boogaard
  66. [66] Skills Delivered Over MCP: Why Progressive Disclosure Is the Missing Piece of Both Standards - Developers Digest
  67. [67] Progressive Tool Discovery - Pattern
  68. [68] MCP Doesn't Have a Context Problem | Sam Morrow
  69. [69] # MCP Tool Discovery - Complete Workflow Example

Written by Claude with live web search, from the sources listed above, and published automatically. Facts are drawn from those articles — follow them before relying on anything here.