[Bug] Static disaggregated worker addresses cannot round trip bracketed IPv6
Maintainers usually reply within 1 day
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 76/100
- Issue type
- Bug
- Clarity
- Clearly specified
- Activity status
- Active
- Tech stack
- python
- Domain
- backend, networking
Research direction
Start with tensorrt_llm.llmapi.disagg_utils and the reproduction in the issue: trace how extract_ctx_gen_cfgs parses static worker URLs and how get_ctx_gen_server_addrs formats them. The issue reports source regression cases for context and generation workers, IPv4, DNS, IPv6, zone IDs, configuration objects, and invalid input; use those cases to check the fix. Done means bracketed IPv6 round trips while IPv4 and DNS behavior is preserved and ambiguous unbracketed input is rejected.
Written by the indexing model from the issue text.
Description
Description
Static disaggregated worker addresses do not round trip bracketed IPv6 on main 9cb84a22bb8813a6dda42961723212f4b2765e8c.
from tensorrt_llm.llmapi.disagg_utils import (
CtxGenServerConfig, extract_ctx_gen_cfgs, get_ctx_gen_server_addrs,
)
extract_ctx_gen_cfgs("ctx", urls=["[::1]:8000"])
# ValueError: too many values to unpack (expected 2)
get_ctx_gen_server_addrs([
CtxGenServerConfig(type="ctx", hostname="::1", port=8000),
])
# (["::1:8000"], [])
The parser splits on every colon. The formatter omits the brackets needed around an IPv6 HTTP authority.
Proposed scope
Split the port from the right, normalize bracketed IPv6 hostnames, and restore brackets when formatting worker addresses. Preserve IPv4 and DNS behavior and reject ambiguous unbracketed input. This is a small address parsing fix. It does not add complete IPv6 support to disaggregated listeners or transports.
I have regression cases for context and generation workers, IPv4, DNS, IPv6, zone IDs, existing configuration objects, and invalid input. The isolated source tests fail on the IPv6 cases before the change and pass with the draft. Full package validation still needs the TensorRT-LLM build environment.
I checked #19544 and #19482. They cover listener binding and advertised host selection, rather than this static address round trip.
I will link a draft patch for scope feedback before requesting code review, per CONTRIBUTING.md.
Before submitting
- Searched related issues and open PRs.
- Included a minimal reproduction and proposed scope.
- Dominant language
- Python
- Stars
- 14.8k
- Forks
- 2.8k
- Avg merge
- 3d 21h
- Merged PRs (30d)
- 466
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from NVIDIA/TensorRT-LLM
-
[Performance]: Beam search re-materializes Result.output_token_ids from pybind once per beamPossibly taken A pull request linked to this issue is open or already merged. OpenGeneral perf
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
NVIDIA/TensorRT-LLM#20236 ·
Maintainers usually reply within 1 day
-
[Bug]: Kimi Linear / Kimi K3 fail to load from the release container: No module named 'fla'Possibly taken @lorenzozanee claimed this 3 days ago. OpenCustomized kernels
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
NVIDIA/TensorRT-LLM#19893 ·
Maintainers usually reply within 1 day
-
[Bug]: guided response_format is silently ignored without guided_decoding_backendPossibly taken @lorenzozanee claimed this 18 days ago. Openbug Inference runtime
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
NVIDIA/TensorRT-LLM#19635 ·
Maintainers usually reply within 1 day
-
[Bug] _load_bin_or_path_file hides the real torch.load error behind UnboundLocalErrorPossibly taken @David-Wu1119 claimed this 22 days ago. OpenCustomized kernels
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
NVIDIA/TensorRT-LLM#19564 · 1 comment ·
Maintainers usually reply within 1 day
-
[Bug]: AutoDeploy logger treats verbose and internal_error as infoPossibly taken @RahulDeoghare claimed this 23 days ago. OpenAutoDeploy bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
NVIDIA/TensorRT-LLM#19491 · 3 comments ·
Maintainers usually reply within 1 day
All issues in NVIDIA/TensorRT-LLM
Similar issues
-
documentation pkg: sphinx-needs
Difficulty 1/5 Under an hour Newbie friendliness 82/100
useblocks/sphinx-needs#2255 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 60/100
home-assistant/core#186538 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
btclib-org/btclib-secp256k1#1181 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
pyrite-wiki/pyrite#917 ·
Maintainers usually reply within 1 day