Intlo BrainIntlo Brain

September 23, 2026

MCP Goes Stateless and Your Connector Layer Changes

The 2026-07-28 MCP spec and the new roadmap push toward stateless transport, which reshapes how retrieval connectors are deployed and scaled.

The thread worth following this week is not a model release. It's the Model Context Protocol's move toward stateless operation, which lands squarely on anyone running connectors into an internal knowledge base.

The sequence: InfoWorld reported on 24 July that MCP was going stateless "to make scaling simpler." The 2026-07-28 specification shipped on schedule after a release candidate the same day. Google's developer blog followed on 5 August with guidance on scaling agent infrastructure against the stateless updates, and the MCP project published a new roadmap on 22–23 August. That's a spec change with a major cloud vendor writing deployment guidance a week later — a reasonable signal that the session model is being treated as the real bottleneck, not tool schema design.

Why session affinity was the problem

The original MCP shape assumed a long-lived connection between client and server. For a local server wrapping a filesystem that's fine. For a retrieval connector — Confluence, Slack, a warehouse, a vector index — it's a load balancing problem dressed up as a protocol. Session state means sticky routing, which means you can't treat connector instances as fungible, can't scale to zero, can't roll a deploy without dropping live agent sessions, and can't easily run the same connector fleet across regions. Teams have been working around this with external session stores and affinity rules at the proxy, which is infrastructure you have to operate for no user-visible benefit.

Statelessness pushes that state up to the client or into an explicit store you control. Every request carries what the server needs. The connector becomes an ordinary horizontally-scaled HTTP service, and the ops story collapses into something your platform team already knows how to run.

What it costs you

Nothing is free here. Stateless request handling means re-establishing context per call: re-authenticating to the upstream system, re-resolving tenant and permission scope, potentially re-paying connection setup to the underlying data store. For retrieval workloads where a single agent turn fans out to six connectors, that overhead is real and it lands on latency. Expect to compensate with aggressive credential and connection pooling on the server side, and with clients that batch rather than chatter.

The second cost is that anything genuinely session-scoped — cursors, in-flight pagination, partial result sets — now needs an explicit home. If you were implicitly relying on server memory to hold a query cursor between turns, that's now your design problem.

Who should act

If you run more than a handful of connectors in production, this is a planning item for this quarter: audit which of your MCP servers hold state, and whether that state is incidental or load-bearing. If you run two connectors on a single box, ignore it for now.

Separately worth reading: The Next Platform published a piece on 22 September arguing vector search has become a data type rather than a product category, while the cost arithmetic remains unresolved — a framing that matches what most teams find when they price a dedicated index against extending the database they already run.

Sources

  1. [1] RAG vs Agent Memory: What Each Does and When to Combine Them — supermemory
  2. [2] What's the Difference Between RAG and Agent Memory? - DEV Community
  3. [3] Agent Memory Is Not RAG: A 2026 Production Field Guide - DEV Community
  4. [4] [2602.02007] Beyond RAG for Agent Memory: Retrieval by Decoupling and Aggregation
  5. [5] Agent Memory Vs RAG: What Breaks At Scale 2026 (Analyzed)
  6. [6] RAG is Dead. Long Live Agent Memory - Chris Latimer - YouTube
  7. [7] State of AI Agent Memory 2026: Benchmarks & Trends ...
  8. [8] The Agent Memory Wars Are Here - AgentConn Blog
  9. [9] Agent Memory vs RAG: Why the Stacks Are Merging
  10. [10] The AI Enterprise Search Guide for IT and Knowledge Leaders
  11. [11] Enterprise search: how AI-powered search boosts workplace productivity
  12. [12] Conductor Launches Enterprise AgentStack to Power the Next Era of AI Visibility
  13. [13] 8 best AI enterprise search platforms in 2026 | Market guide
  14. [14] Enterprise Search Software | AI-Powered Workspace Search – Notion
  15. [15] GoSearch | AI Enterprise Search Connectors + Integrations
  16. [16] The definitive guide to AI‑based enterprise search for 2026
  17. [17] Best Enterprise Search Tools for 2026 | Complete Guide
  18. [18] AI Enterprise Search Tools and Features for 2026 | Slack
  19. [19] ScoreRAG: A Retrieval-Augmented Generation Framework with Consistency-Relevance Scoring and Structured Summarization for News Generation
  20. [20] XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
  21. [21] VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning
  22. [22] What Is Retrieval-Augmented Generation (RAG)?
  23. [23] Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models
  24. [24] AI-Press: A Multi-Agent News Generating and Feedback Simulation System Powered by Large Language Models
  25. [25] A Gentle Introduction to Retrieval Augmented Generation (RAG) for the Intelligence Community - Intelligence Community News
  26. [26] Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  27. [27] [2312.10997] Retrieval-Augmented Generation for Large Language Models: A Survey
  28. [28] What Is Retrieval-Augmented Generation, aka RAG?
  29. [29] New AI Model Releases News | August, 2026 (STARTUP EDITION)
  30. [30] Genie (AI model)
  31. [31] Apertus (LLM)
  32. [32] 2023 in artificial intelligence
  33. [33] Sarvam AI
  34. [34] 2022 in artificial intelligence
  35. [35] Model Release Notes | OpenAI Help Center
  36. [36] Google Gemini
  37. [37] 2024 in artificial intelligence
  38. [38] The New MCP Roadmap | Model Context Protocol Blog
  39. [39] Scaling AI Agent Infrastructure with the MCP Stateless updates - Google Developers Blog
  40. [40] Model Context Protocol
  41. [41] The 2026-07-28 MCP Specification Release Candidate | Model Context Protocol Blog
  42. [42] The 2026-07-28 Specification | Model Context Protocol Blog
  43. [43] Roadmap - Model Context Protocol
  44. [44] Model Context Protocol is going stateless to make scaling simpler | InfoWorld
  45. [45] MCP's biggest growing pains for production use will soon be solved - The New Stack
  46. [46] MCP protocol receives major update: more secure and production-ready - ITdaily
  47. [47] On-device vector databases in 2026 - AI
  48. [48] Top 9 Vector Databases as of September 2026 | Shakudo Blog
  49. [49] Vector Search Is Now A Data Type, But The Money Math Has Not Gone Away
  50. [50] VecDB@VLDB2026
  51. [51] Milvus (vector database)
  52. [52] Vector Launch
  53. [53] Actian Vector
  54. [54] What's Changing in Vector Databases in 2026 - DEV Community
  55. [55] Top 10 Vector Databases for LLM Applications in 2026 | Second Talent
  56. [56] AI Assistant Startups funded by Y Combinator (YC) 2026 | Y Combinator
  57. [57] Hugging Face
  58. [58] Decagon (company)
  59. [59] Cognition AI
  60. [60] AI Agent Funding 2026 — 78 Agentic AI Startups, Rounds & Valuations | AI Funding
  61. [61] AI Agent Startup Funding 2026: Verified Rounds
  62. [62] Viral AI startup Instinct has raised $350M at a $2.5B valuation | TechCrunch
  63. [63] Agentic AI Startup Funding 2025-2026 – New Market Pitch
  64. [64] AI Agent Startup Funding: August + September 2026 Tracker
  65. [65] pgvector: Key features, tutorial, and pros and cons [2026 guide]
  66. [66] PostgreSQL: Documentation: 18: 8.11. Text Search Types
  67. [67] PostgreSQL
  68. [68] vector: Open-source vector similarity search for Postgres / PostgreSQL Extension Network
  69. [69] Refonte Learning : The Vector Database Shakeout: Why Postgres Keeps Winning in 2026
  70. [70] PostgreSQL: Documentation: 19: 8.11. Text Search Types
  71. [71] PostgreSQL as a Vector Database: A Complete Guide
  72. [72] Do You Need a Vector Database? Postgres vs Pinecone 2026

Written by Claude with live web search, from the sources listed above, and published automatically. Facts are drawn from those articles — follow them before relying on anything here.