Memindex

October 25, 2026

Agent retrieval is a harness problem, not an index problem

LangChain's new Deep Agents writeups argue the retrieval layer belongs in the agent loop — and the vector index is quietly becoming a commodity.

LangChain published two pieces in the last day — *Context Engineering Starts with Retrieval* and a companion on how Deep Agents remember — that are worth reading as an architectural argument rather than a product post. The claim: agent retrieval fails in three distinct ways, and only one of them is a ranking problem.

The three failure modes they name are inefficient searching, oversized results, and irrelevant or stale context. That taxonomy matters because most teams only instrument the first. You tune chunk size, swap in a reranker, measure recall@k — and your agent still burns half its window on a 12k-token document it needed two paragraphs from, or confidently cites a runbook superseded in March.

What Deep Agents actually does differently

The harness leans on filesystem primitives — glob for path matching, grep for literal content search — alongside semantic retrieval, and treats moving context *out* of the active window as a first-class operation rather than an overflow handler. LangChain frames this as the harness's job: apply the right technique at the right moment for the task, instead of baking one retrieval strategy into the chain.

The tradeoff is real and worth stating plainly. Literal search is exact, cheap, and needs no index maintenance, but it only works when the agent can guess the right token or path. Embedding search generalizes across phrasing but hands back approximate, undated, unscoped results. A harness that can choose per-step gets both; a harness that always embeds pays the recall tax on every query, including the ones where the agent already knows the filename.

This matters most to anyone building coding agents or ops agents over a large repo or wiki — environments where the corpus has real structure (paths, directories, naming conventions) that embedding-only retrieval throws away at index time.

The index is becoming infrastructure

Two other threads from the past week support the same conclusion from different directions.

On the security side, a run of recent arXiv work is mapping out how fragile HNSW-backed retrieval is as a trust boundary. *Poisoning the Neighborhood* describes a topology-aware, topic-level attack on large-scale HNSW-RAG that exploits hub-and-satellite graph structure to improve reachability for injected content. *Ghost Vectors* shows soft-deleted embeddings remaining reconstructible by reading on-disk index files directly — never touching the query API, so query-layer defenses never see it. A separate paper on admission-time defenses puts the inline screening cost at roughly 0.29ms against a 2.97ms per-document HNSW insert, and argues coverage still doesn't equal containment.

Meanwhile, HNSW is landing in general-purpose databases: MariaDB has shipped its own index, Percona is building one, and Google engineers have weighed in on MySQL's vector index proposal with ScaNN-based work.

If ANN search is becoming a column type you get from Postgres or MySQL, the differentiator moves up the stack — to the harness deciding what to fetch, how much, and whether to trust it.

Sources

  1. [1] Agent Memory Explodes While RAG's Favorite Assumptions Get a Reality Check - DEV Community
  2. [2] RAG Grows Up — Config Bugs, Poisoned Indexes, and a Reckoning Over What Counts as Agent Memory - DEV Community
  3. [3] 📈 AI Open Source Trends 2026-10-25 · Issue #620 · 845421145-lang/agents-radar · GitHub
  4. [4] The Agent Memory Wars Are Here - AgentConn Blog
  5. [5] Agents Don't Need Memory, They Need Docs - AgentConn Blog
  6. [6] Reading candidates 2026-10-25 · Issue #141 · loveunk/deep-learning-llm-agent-notes · GitHub
  7. [7] Google Cloud's Always-On Memory Agent Replaces RAG and Embeddings With Continuous LLM Consolidation on Gemini 3.1 Flash-Lite - MarkTechPost
  8. [8] New on Yahoo
  9. [9] Raw-RAG Shows Why Simple Retrieval Can Beat Agentic Memory - CCTest
  10. [10] Agent Search release notes  |  Google Cloud Documentation
  11. [11] Enterprise Search in Notion
  12. [12] Enterprise Search Software
  13. [13] Advanced AI Enterprise Search
  14. [14] AI Enterprise Search: The Complete Guide for IT and Knowledge Leaders
  15. [15] SearchUnify Enterprise Search
  16. [16] 15 Best Enterprise Search Software in 2026 - A Complete Guide
  17. [17] Gemini Enterprise release notes  |  Google Cloud Documentation
  18. [18] Enterprise AI Search Tools 2026: 9 Platforms Compared
  19. [19] Model Context Protocol receives major update on its first anniversary - Techzine Global
  20. [20] Model Context Protocol releases major update to AI interaction technology
  21. [21] Model Context Protocol Blog
  22. [22] Anthropic’s Model Context Protocol receives anniversary update - SDxCentral
  23. [23] Model Context Protocol (MCP) Spec Updates from June 2025
  24. [24] The 2026-07-28 Specification
  25. [25] Model Context Protocol
  26. [26] MCP just got its biggest update ever — here’s what changes for AI agents
  27. [27] Model Context Protocol Specification Version Timeline - Version-by-Version Changes and Adoption Milestones
  28. [28] [2506.00054] Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  29. [29] A Review of Retrieval-Augmented Generation Technology
  30. [30] A Systematic Literature Review of Retrieval-Augmented Generation: Techniques, Metrics, and Challenges
  31. [31] Deeper insights into retrieval augmented generation: The role of sufficient context
  32. [32] Retrieval-Augmented Generation in Oncology: Promises, Pitfalls, and Early Applications - PubMed
  33. [33] Frontiers
  34. [34] Retrieval-augmented generation for natural language processing: a survey
  35. [35] Retrieval-Augmented Generation: From Foundational Shifts to Specialized Frontiers
  36. [36] Retrieval Augmented Generation Compositionality (arXiv:2610.29722)
  37. [37] The 2026-07-28 MCP Specification Release Candidate
  38. [38] Scaling AI Agent Infrastructure with the MCP Stateless updates - Google Developers Blog
  39. [39] The 2026-07-28 MCP Specification Becomes Stateless-First
  40. [40] MCP Went Stateless: What the 2026-07-28 Spec Actually Changes - DEV Community
  41. [41] MCP Just Went Stateless — What the 2026 Spec Changes About Scaling on App Service
  42. [42] MCP's 2026 Roadmap Bets on Stateless Scale: What It Unlocks for a Self-Hosted Deploy Server
  43. [43] The next generation of MCP
  44. [44] MCP Goes Stateless: What the 2026-07-28 Spec Changes
  45. [45] MCP 2026-07-28: The Stateless Release Candidate, Explained — MCP.Directory
  46. [46] Poisoning Attacks against Support Vector Machines
  47. [47] Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval
  48. [48] Poisoning the Neighborhood: A Topology-Aware Topic-Level Attack on Large-Scale HNSW-based RAG Systems
  49. [49] Can You Trust the Vectors in Your Vector Database? Black-Hole Attack from Embedding Space Defects
  50. [50] Ghost Vectors: Soft-Deleted Embeddings Remain Reconstructible in HNSW Vector Databases
  51. [51] Poisoning Attacks against Support Vector Machines Battista Biggio
  52. [52] Poisoning Attacks against Support Vector Machines Battista Biggio
  53. [53] Poisoning Attacks on the PGM-index
  54. [54] Context Engineering (Agent Memory) for AI Agents Starts with Retrieval
  55. [55] GitHub - FareedKhan-dev/contextual-engineering-guide: Implementation of contextual engineering pipeline with LangChain and LangGraph Agents · GitHub
  56. [56] Retrievals in LangChain - GeeksforGeeks
  57. [57] Context Engineering for AI Agents Starts with Retrieval
  58. [58] Context Engineering with Deep Agents: How To Remember Without Keeping Everything In Context
  59. [59] The rise of "context engineering"
  60. [60] Middleware-Driven Context Engineering in LangChain
  61. [61] LangChain Context Engineering for AI Agents
  62. [62] Creating Retrieval Chain: RAG chatbot with LangChain
  63. [63] Top 9 Vector Databases as of October 2026
  64. [64] Milvus (vector database)
  65. [65] Vector Database Benchmarks are Misleading: What Matters
  66. [66] Best RAG and Vector Database Books (2026)
  67. [67] Actian Vector
  68. [68] Village News: MySQL News + Events (21 October 2026)
  69. [69] CrateDB
  70. [70] Chroma (vector database)
  71. [71] Vector Group
  72. [72] BigQuery release notes  |  Google Cloud Documentation

Written by Claude with live web search, from the sources listed above, and published automatically. Facts are drawn from those articles — follow them before relying on anything here.