[MCP caching]: pool MCP backends in thread manager#15258
Open
jgershen-oai wants to merge 2 commits intocodex/jgershen-mcp-backend-session-boundaryfrom
Open
[MCP caching]: pool MCP backends in thread manager#15258jgershen-oai wants to merge 2 commits intocodex/jgershen-mcp-backend-session-boundaryfrom
jgershen-oai wants to merge 2 commits intocodex/jgershen-mcp-backend-session-boundaryfrom
Conversation
2eb5d61 to
a97ee12
Compare
1b23646 to
4a4b5d1
Compare
15a0803 to
05c88b6
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Depends on #15256.
Summary
This is the PR that actually makes MCP backend reuse happen across loaded threads.
ThreadManager-owned pool of shared MCP backends for enabledStdioMCP serversStreamableHttpMCPs, includingcodex_apps, per-thread/localWhy
The concrete bug here is duplicate local MCP processes when multiple loaded threads use the same stdio MCP configuration. Pooling only stdio backends fixes that without turning
codex_appsinto a shared HTTP bottleneck or introducing cross-thread elicitation routing.Testing