docs: document dual-protocol (REST/gRPC) routing for Standard mode
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 76/100
- Issue type
- Documentation
- Clarity
- Clearly specified
- Activity status
- Quiet
- Tech stack
- kubernetes
- Domain
- documentation
Research direction
Start with related PR #5451 and the website’s existing Gateway API documentation. Document REST and gRPC port detection, the ordered HTTPRoute matches, the shared-hostname constraint, and a Service example with both ports. Done means a newcomer can understand and configure dual-protocol routing in Standard mode.
Written by the indexing model from the issue text.
Description
Summary
KServe v0.19 added dual-protocol (REST + gRPC) routing support for InferenceService Standard mode when using the Gateway API. No documentation exists for this feature.
What needs to be documented
- How the HTTPRoute reconciler detects REST and gRPC ports from the backing Service
- gRPC detection: based on
appProtocol = kubernetes.io/h2cand/or port name heuristics (containing grpc/h2c) - Two HTTPRoute rules generated: gRPC match first (
application/grpc.*content-type header), REST/HTTP fallback second - Both protocols served behind the same hostname
- Why separate GRPCRoute + HTTPRoute for the same host doesn't work (Gateway API constraint)
- Example configuration showing a Service with both REST and gRPC ports
Related PR
Since
KServe v0.19
- Dominant language
- MDX
- Stars
- 113
- Forks
- 193
- Avg merge
- 5d 20h
- Merged PRs (30d)
- 3
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from kserve/website
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-2 days Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Difficulty 2/5 Half a day Newbie friendliness 74/100
Similar issues
-
user-reported
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
Kong/developer.konghq.com#7316 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
HarperFast/skills#96 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
infinispan/infinispan#18150 ·
-
bug triage:deciding
Difficulty 1/5 Under an hour Newbie friendliness 88/100
open-telemetry/otel-arrow#4132 ·
-
Ecosystem: ClawMetry — the Qwen Code reader is now free and open source (follow-up to #9294 / #9338) Opencategory/integration priority/P3 scope/documentation status/ready-for-human type/feature-request
Difficulty 1/5 Under an hour Newbie friendliness 84/100