kserve

Issues somebody may already be working on are listed last. List everything by date

• make deploy-dev fails on macOS

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 85/100

  kserve/kserve#6599 · Opened Nov 12, 2026

  Maintainers usually reply within 1 day

• [Feature] Guidance for integrating vLLM preload with KServe

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#6596 · Opened Nov 12, 2026

  Maintainers usually reply within 1 day

• llmisvc: self-signed cert Secret regenerated on every reconcile while a pod has no IP

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 35/100

  kserve/kserve#6580 · Opened Nov 9, 2026

  Maintainers usually reply within 1 day

• RFC: End-to-end attested TLS for confidential inference

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 10/100

  kserve/kserve#6577 · 8 comments · Opened Nov 9, 2026

  Maintainers usually reply within 1 day

• kserve-runtime-configs: make the LLMInferenceServiceConfig images configurable

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  kserve/kserve#6560 · 1 comment · Opened Nov 4, 2026

  Maintainers usually reply within 1 day

• [Feature Request] Provide a lightweight client-only install extra for the kserve Python package

  May be free again @akshat-lakhera claimed this 13 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  kserve/kserve#6533 · 1 comment · Opened Oct 30, 2026

  Maintainers usually reply within 1 day

• llmisvc charts: support helm-template-based GitOps (Argo CD) for selfSignedCerts webhook mode

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 38/100

  kserve/kserve#6412 · Opened Oct 17, 2026

  Maintainers usually reply within 1 day

• Master CI: TestAgent watcher specs fail after SSRF loopback blocking (cf14d1fa2)

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  stale-warning-1

  Difficulty 4/5 3-5 days Newbie friendliness 52/100

  kserve/kserve#6364 · 1 comment · Opened Oct 8, 2026

  Maintainers usually reply within 1 day

• Add E2E Tests to KernelCache Feature - Sub-issue: Deletion test

  May be free again @Rudra-G-23 claimed this 36 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  kserve/kserve#6340 · 2 comments · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• Add E2E Tests to KernelCache Feature - Sub-issue: Add README

  May be free again @aminehd claimed this 34 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 84/100

  kserve/kserve#6336 · 2 comments · 1 assignee · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• Add E2E Tests to KernelCache Feature

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  stale-warning-1 stale-warning-2

  Difficulty 4/5 3-5 days Newbie friendliness 52/100

  kserve/kserve#6335 · 2 comments · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• Hardware-aware selection of published inference configurations

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#6277 · 1 comment · Opened Sep 23, 2026

  Maintainers usually reply within 1 day

• [SGLang Runtime] Follow-up: address gaps in KServe + SGLang integration

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#6250 · 2 comments · Opened Sep 21, 2026

  Maintainers usually reply within 1 day

• [Proposal] MLServer Fork as KServe-Governed Predictive Multi-Model Runtime

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#6129 · 9 comments · 4 reactions · Opened Sep 3, 2026

  Maintainers usually reply within 1 day

• feat: KServe Agent Skills — agent skills plugin for workload, platform, and infra

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  ignore-stale

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  kserve/kserve#6059 · 4 comments · Opened Aug 23, 2026

  Maintainers usually reply within 1 day

• docs: document latency predictor sidecar and LoRA affinity scorer auto-injection

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  kserve/website#740 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add standalone distributed tracing guide for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-2 days Newbie friendliness 72/100

  kserve/website#739 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: document storageContainerName field for explicit CSC selection

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  kserve/website#738 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: document OCI native ImageVolume mounting (oci+native://)

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 3-5 days Newbie friendliness 30/100

  kserve/website#736 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add vLLM as standalone runtime documentation

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  kserve/website#735 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add canary rollout documentation for RawDeployment mode

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 35/100

  kserve/website#734 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add Managed DRA guide for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 70/100

  kserve/website#733 · 2 comments · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add upgrade notes for llm-d version migrations

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 76/100

  kserve/website#731 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: document model name-based routing for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  kserve/website#730 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add LocalModelCache support for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 78/100

  kserve/website#727 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add HuggingFace token classification offset_mapping documentation

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 78/100

  kserve/website#725 · 1 comment · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: document OpenAI Responses API and Anthropic Messages API routing

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  kserve/website#723 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• docs: add multi-node inference without Ray (mp backend) guide

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 76/100

  kserve/website#722 · Opened Aug 15, 2026

  Maintainers usually reply within 4 days

• LLMInferenceService API graduation: `v1alpha2` to `v1beta1`

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  ignore-stale

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  kserve/kserve#5922 · 7 comments · Opened Jul 29, 2026

  Maintainers usually reply within 1 day

• docs: add standalone vLLM tokenizer render deployment for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  kserve/website#713 · 1 comment · Opened Jul 24, 2026

  Maintainers usually reply within 4 days

• docs: add distributed tracing documentation for LLMInferenceService

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 55/100

  kserve/website#710 · 1 comment · Opened Jul 24, 2026

  Maintainers usually reply within 4 days

• RFC: Model artifact integrity verification for non-OCI storage URIs

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  kserve/kserve#5789 · 7 comments · Opened Jul 8, 2026

  Maintainers usually reply within 1 day

• Onboarding: complete KServe .project setup

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  metadata onboarding

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  kserve/.project#1 · 14 comments · Opened Jun 21, 2026

• REQUEST: Promotion to Approver for gavrissh

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 1/5 1-3 hours Newbie friendliness 25/100

  kserve/community#74 · 10 comments · 2 reactions · Opened Jun 4, 2026

• Provide gateway optionality for LLM inference routing

  May be free again @fantasy-lotus claimed this 161 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  ignore-stale

  kserve/kserve#5518 · 10 comments · 1 reaction · 1 assignee · Opened May 11, 2026

  Maintainers usually reply within 1 day

• [Security] Local Model Cache : dynamic storage with CSI driver instead of local node storage

  May be free again @spolti claimed this 194 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  kserve/kserve#5359 · 13 comments · 2 reactions · 1 assignee · Opened Apr 8, 2026

  Maintainers usually reply within 1 day

• Support `canaryTrafficPercent` for `RawDeployment` mode via Gateway API HTTPRoute weights

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  ignore-stale

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#5335 · 9 comments · 2 reactions · Opened Apr 2, 2026

  Maintainers usually reply within 1 day

• storageUris: pvc:// uris mount the claim root and ignore the path in the uri

  Possibly taken @dundysm claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 25/100

  kserve/kserve#6597 · 1 comment · Opened Nov 12, 2026

  Maintainers usually reply within 1 day

• storage-initializer saves a gzipped single file from an http uri as <name>.gz.tar

  Possibly taken @dundysm claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 1/100

  kserve/kserve#6594 · Opened Nov 12, 2026

  Maintainers usually reply within 1 day

• Pre-existing nil-container handling gaps in CustomPredictor reconcile path (follow-up to #5522)

  Possibly taken A pull request linked to this issue is open or already merged. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  kind/bug

  Difficulty 4/5 3-5 days Newbie friendliness 55/100

  kserve/kserve#6585 · Opened Nov 10, 2026

  Maintainers usually reply within 1 day

• Support pandas>=3.0 (relax `pandas<3.0.0` upper bound)

  Possibly taken @VISHNU0906 claimed this 2 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 25/100

  kserve/kserve#6583 · Opened Nov 10, 2026

  Maintainers usually reply within 1 day

• huggingfaceserver only routes the first --served-model-name; the other names return 404

  Possibly taken @0z5a claimed this 3 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 25/100

  kserve/kserve#6576 · Opened Nov 9, 2026

  Maintainers usually reply within 1 day

• huggingfaceserver (vLLM backend) ignores --tensor-parallel-size and always uses every visible GPU

  Possibly taken @0z5a claimed this 3 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 25/100

  kserve/kserve#6575 · Opened Nov 9, 2026

  Maintainers usually reply within 1 day

• vLLM runtime probes fail when API key authentication is enabled

  Possibly taken @xrwang8 claimed this 10 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 42/100

  kserve/kserve#6545 · Opened Nov 2, 2026

  Maintainers usually reply within 1 day

• vLLM runtime fails to start with official v0.32.0 image

  Possibly taken @xrwang8 claimed this 10 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  kserve/kserve#6543 · 1 comment · 1 assignee · Opened Nov 2, 2026

  Maintainers usually reply within 1 day

• feat(python): warn when synchronous predict blocks the event loop

  Possibly taken @anencore94 claimed this 10 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 30/100

  kserve/kserve#6541 · Opened Nov 1, 2026

  Maintainers usually reply within 1 day

• Structured CloudEvent without the optional `time` attribute is passed to the model as raw JSON

  Possibly taken @RaphaelFakhri claimed this 10 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  kserve/kserve#6540 · Opened Nov 1, 2026

  Maintainers usually reply within 1 day

• llmisvc: publisher path edge cases after #6530

  Possibly taken @bartoszmajsak claimed this 13 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  kserve/kserve#6532 · 2 assignees · Opened Oct 30, 2026

  Maintainers usually reply within 1 day

• Expose ClusterServingRuntime resources in the runtime-configs Helm chart

  Possibly taken @Dani32002 claimed this 13 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 25/100

  kserve/kserve#6531 · 1 comment · Opened Oct 30, 2026

  Maintainers usually reply within 1 day

• HTTP storageUri SSRF fix blocks in-cluster and private model hosts with no admin opt-in

  Possibly taken @Tsengbrian92 claimed this 13 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  kserve/kserve#6525 · Opened Oct 30, 2026

  Maintainers usually reply within 1 day