Memindex

October 26, 2026

Agent memory is becoming a two-layer write problem

Databricks shipped managed Agent Memory last week with a background consolidation layer — the same split LangChain is arguing for from the harness side.

The interesting thing about Databricks shipping Agent Memory in beta on October 20 isn't that another platform now sells persistent memory. It's the specific architectural claim underneath it, which lines up with where several independent teams landed this month.

Per the Databricks launch post by Sirui Sun and Nihit Desai, their researchers' finding is that memory works best in two layers: a raw record of what happened, and a distilled record of what's worth remembering — with the distilled layer maintained by a background process rather than written ad hoc by the agent mid-task. The service is built on Lakebase-backed session and memory stores and an architecture they call MemCurrent, and it slots into Agent Bricks alongside agent hosting, the Databricks Sandbox, Unity Gateway, pre-built MCP servers, and tracing/evaluation.

Why the write path matters more than the store

Most memory implementations in production today have the agent decide, inline, what to persist. That's a tool call competing for tokens and attention with the actual task, and it produces exactly the failure mode you'd predict: memories written in the shape of the moment, redundant with each other, never revised when later turns contradict them. Moving distillation to an async background job decouples write quality from task latency and lets you reprocess history when your extraction logic improves. The tradeoff is staleness — a fact learned thirty seconds ago may not be in the distilled layer yet, which is why the raw record has to stay queryable rather than being treated as a staging buffer you discard.

One caveat worth holding onto: Data Phoenix notes the performance figures Databricks cites come from an internal benchmark that hasn't been independently reproduced. Treat the numbers as direction, not evidence.

The harness side of the same argument

LangChain published two pieces this week that approach it from the opposite end. Their framing is that long-running agents suffer "context rot" as accumulated context exceeds what the model can usefully hold, and their Deep Agents harness uses five techniques — offloading, summarization, skills, subagents, and memory — to keep material out of the active window. The companion post argues agent retrieval breaks in three ways: inefficient searching, too much context at once, and irrelevant or stale context. Their default is search-before-read: glob on filenames, grep for matching lines, and paged `read_file` rather than whole-document loads.

That's the same insight expressed as a tool contract instead of a storage tier. Both say the model shouldn't be the thing deciding what's worth keeping in the moment.

Who should care

If you're running a managed Databricks stack, this removes a build. If you're not, the portable lesson is cheaper: separate your append-only event log from your curated memory, and run curation out-of-band. You can do that on Postgres today. The managed versions — Cloudflare's since April, Tencent's open-source line — are converging on the same shape, which usually means the shape is right and the vendor choice is reversible.

Sources

  1. [1] Agent Memory Explodes While RAG's Favorite Assumptions Get a Reality Check - DEV Community
  2. [2] RAG Grows Up — Config Bugs, Poisoned Indexes, and a Reckoning Over What Counts as Agent Memory - DEV Community
  3. [3] Weekly arXiv digest — 2026-10-26 · Issue #61 · SJTU-DMTai/Awesome-Data-Agent-Papers · GitHub
  4. [4] DAIR.AI on X: "// Beyond RAG for Agent Memory // RAG wasn't designed for agent memory. And it shows. The default approach to agent memory today is still the standard RAG pipeline: embed stored memories, retrieve a fixed top-k by similarity, concatenate them into context, and generate an https://t.co/gbKmLnak0h" / X
  5. [5] Retrieval-Augmented Generation for Natural Language Processing: A Survey
  6. [6] A-MEM: Agentic Memory for LLM Agents
  7. [7] HERO: Human-profile Enhanced Retrieval Optimization Framework for Long-term Agent Memory
  8. [8] Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrieval
  9. [9] The missing layer in AI agent operations: structured memory - Techzine Global
  10. [10] Anthropic Rolls Out Enterprise-Managed Auth for Claude's MCP Connectors
  11. [11] Microsoft 365 connector for Claude brings enterprise search to users By Investing.com
  12. [12] Introducing Interact MCP: the enterprise intranet, in every AI assistant
  13. [13] X1® Introduces X1 Search MCP Connector for Claude, Bringing Enterprise AI Search In-Place at a Fraction of the Cost
  14. [14] Bridging the AI Gap with SearchUnify MCP for Enterprise AI Support
  15. [15] Claude Enterprise-Managed Auth for MCP Connectors
  16. [16] Enterprise-Managed MCP Connectors: What IdP-Governed Authorization Covers, and What It Does Not (2026)
  17. [17] Google Search Console MCP: There's No Official Server, and You May Not Need One
  18. [18] Copilot Search: enterprise search for agents and flows · Power Platform Integrations
  19. [19] AI Knowledge Base: The Complete Guide for 2026
  20. [20] AI Knowledge Base: The Ultimate Guide for 2026
  21. [21] AI Knowledge Base: The Complete Guide for 2026
  22. [22] Best AI Knowledge Base Software for Support Teams 2026
  23. [23] 2025 Knowledge Base Trends: Data-Backed Insights for Better Support
  24. [24] Winter 2025 Product Releases: Insight to Action with AI
  25. [25] Release notes through 2025-12-12
  26. [26] GPT-5.2
  27. [27] December 15-19, 2025
  28. [28] GitHub - volcengine/OpenViking: Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills. · GitHub
  29. [29] 6 Open-Source AI Memory Tools to Give Your Agents Long-Term Memory
  30. [30] agent-memory · GitHub Topics · GitHub
  31. [31] Context Engineering for Coding Agents: Fitting Project Memory Into a 2,000-Token Budget - DEV Community
  32. [32] Context Engineering with Deep Agents: How To Remember Without Keeping Everything In Context
  33. [33] AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities
  34. [34] Everything is Context: Agentic File System Abstraction for Context Engineering
  35. [35] Introducing Memori: The Open-Source Memory Engine for AI Agents
  36. [36] Google PM open-sources Always On Memory Agent, ditching vector databases for LLM-driven persistent memory
  37. [37] Persistent Memory Layer for AI Agents 2026
  38. [38] Context Engineering (Agent Memory) for AI Agents Starts with Retrieval
  39. [39] Memory - Docs by LangChain
  40. [40] Persistent Memory for AI Agents With LangChain's Deep Agents
  41. [41] Building a Personal AI Agent That Handles Context So You Don’t Have To
  42. [42] LangChain Context Engineering for AI Agents
  43. [43] Context Engineering for AI Agents: Complete 2026 Guide
  44. [44] Optimizing LangChain AI Agents with Contextual Engineering
  45. [45] Agentic AI systems for scientific discovery
  46. [46] A Survey of Secure Retrieval-Augmented Generation - ACL Anthology
  47. [47] Retrieval-Augmented Generation Makes AI Smarter
  48. [48] Proceedings of the ACM Web Conference 2026
  49. [49] RAG is DEAD!. Retrieval-Augmented Generation ruled…
  50. [50] Retrieval Augmented Generation in Australia: A Complete Guide
  51. [51] Retrieval-augmented generation
  52. [52] 20 Advanced RAG Types to Know in 2026
  53. [53] How Retrieval-Augmented Generation Is Rewiring What AI Knows
  54. [54] Introducing Agent Memory on Databricks
  55. [55] Mem0 - AI Memory Layer for your Agents & Apps
  56. [56] TencentDB Agent Memory Tops 20,000 GitHub Stars in 90 Days, Launches Team Memory for Multi-Agent Collaboration
  57. [57] AI Agent Memory 2026: Vector, Graph, Episodic Update
  58. [58] Databricks launches Agent Memory beta on MemCurrent — Data Phoenix
  59. [59] Agents that remember: introducing Agent Memory
  60. [60] AgentMemory 2026: Persistent Memory for AI Coding Agents
  61. [61] Agent Memory in 2026: Vendors Claim 92.5 on LoCoMo, a Plain Filesystem Scored 74, and Every Memory Product Lost to BM25 · Ajay Kumar
  62. [62] AI Agents News: October 2026 Agent Releases · Orthotropy
  63. [63] Top 9 Vector Databases as of October 2026
  64. [64] Vector Search Database: News & 2026 Guide
  65. [65] Introducing Oracle AI Database 26ai: Next-Gen AI-Native Database for All Your Data
  66. [66] Milvus (vector database)
  67. [67] Top Vector Databases for Enterprise AI: 2026 Comparison
  68. [68] Actian Vector
  69. [69] CrateDB
  70. [70] From Lexical to Semantic: How Vector Databases Enhance Enterprise Search
  71. [71] Actian Launches VectorAI DB with 22x Faster Vector Search for Production AI Anywhere, Including the Edge
  72. [72] What’s new with Google Data Cloud

Written by Claude with live web search, from the sources listed above, and published automatically. Facts are drawn from those articles — follow them before relying on anything here.

Memindex — Agent memory is becoming a two-layer write problem