First-class multi-tenant runtime for per-connection bots
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 30/100
- Issue type
- Feature
- Clarity
- Needs clarification
- Activity status
- Quiet
- Tech stack
- typescript
Research direction
Start by reading the reference implementation at github.com/delphi-ai/multi-tenant-chat and comparing it with the SDK's webhook and Chat runtime entry points. The work is complete when connections resolve per webhook, runtimes isolate credentials and state, handlers receive connection context, and LRU eviction is covered by tests.
Written by the indexing model from the issue text.
Description
Problem Statement
The Chat SDK assumes one bot identity and one credential set per process. In a SaaS product, each customer connects their own Telegram bot, SMS number, or WhatsApp sender. We need many isolated bot runtimes on shared webhook routes without running one process per connection.
Proposed Solution
Add a built-in multi-tenant mode (or official helper) that:
- Resolves a connection from platform + connectionKey on each webhook
- Lazily creates a Chat instance per connection with its own adapter credentials
- Prefixes shared state keys so thread/subscription state does not collide
- Exposes connection context in message handlers (e.g. via AsyncLocalStorage)
- Caches runtimes with LRU eviction
Handlers would receive (ctx, thread, message) where ctx.connection identifies the tenant.
Alternatives Considered
- One global Chat and swap credentials per request: not safe for concurrent webhooks
- One Chat singleton per connection: too much memory at scale
- External wrapper package: works today, but belongs in the SDK long term
We ship option 3 as @delphi-ai/multi-tenant-chat until upstream support exists.
Use Case
Priority
Critical
Contribution
- I am willing to help implement this feature
Additional Context
We already built and use this pattern. Reference implementation: https://github.com/delphi-ai/multi-tenant-chat.
- Dominant language
- TypeScript
- Stars
- 2.5k
- Forks
- 355
- Avg merge
- 2d 15h
- Merged PRs (30d)
- 42
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from vercel/chat
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
Maintainers usually reply within 1 day
-
X and Twitch: paragraphs inside a block quote are joined with no spacePossibly taken @abhiramshaji-cyber claimed this 4 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 58/100
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 72/100
Maintainers usually reply within 1 day
Similar issues
-
db-d1-sqlite: upsert is aliased to updateOne, so payload.kv.set never inserts new keysPossibly taken @pcbeingused333 claimed this today. OpenBug db: d1-sqlite Payload OSS
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
payloadcms/payload#19766 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
device-management-toolkit/sample-web-ui#3711 ·
Maintainers usually reply within 1 day
-
bug impact:low Team: SecuritySolution Team:Defend Workflows v9.6.0
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
elastic/kibana#306401 · 3 comments ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
agentes-chat/agentes-chat#927 ·
Maintainers usually reply within 1 day
-
Closing a pinned tab jumps to the Tabs section instead of the next open pinned tabPossibly taken @seenimohamed claimed this today. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
ardia-browser/ardia#2769 ·
Maintainers usually reply within 1 day