nebari-dev/llm-serving-pack
Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.
Is nebari-dev/llm-serving-pack beginner-friendly?
The maintainers of nebari-dev/llm-serving-pack usually reply to a pull request within 3 days. 2 beginner-friendly issues are open now.
- Stars
- 3
- Forks
- 3
- Open beginner issues
- 2
- Indexed issues
- 47
- Avg merge
- 19h 39m
- Merged PRs (30d)
- 9
- Dominant language
- Go
- License
- Apache-2.0
- Last GitHub push
- Sep 18, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- good first issue
How to contribute to nebari-dev/llm-serving-pack
- Read the contributing guide first: it says how the maintainers want changes proposed, tested and reviewed.
- Read its code of conduct: it covers issues and pull requests as well as chat.
- Your contributions will be published under the project's Apache-2.0 license.
- Pick one of the 2 open beginner-friendly issues below and comment that you want to work on it before you start.
Issues somebody may already be working on are listed last. List everything by date
-
priority: low 🌱 type: enhancement 💅🏼
Difficulty 2/5 Half a day Newbie friendliness 84/100
nebari-dev/llm-serving-pack#199 ·
Maintainers usually reply within 3 days
-
Difficulty 5/5 Over a week Newbie friendliness 32/100
nebari-dev/llm-serving-pack#196 ·
Maintainers usually reply within 3 days
-
Difficulty 5/5 Over a week Newbie friendliness 45/100
nebari-dev/llm-serving-pack#195 ·
Maintainers usually reply within 3 days
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#194 ·
Maintainers usually reply within 3 days
-
needs: discussion 💬 priority: low 🌱 type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#193 ·
Maintainers usually reply within 3 days
-
Difficulty 3/5 1-2 days Newbie friendliness 65/100
nebari-dev/llm-serving-pack#191 ·
Maintainers usually reply within 3 days
-
Add nodeSelector, tolerations and imagePullSecrets for the EPP under spec.advanced.inferencePoolOpenneeds: discussion 💬
Difficulty 4/5 3-5 days Newbie friendliness 68/100
nebari-dev/llm-serving-pack#176 ·
Maintainers usually reply within 3 days
-
type: deprecation ⚰️
Difficulty 4/5 3-5 days Newbie friendliness 64/100
nebari-dev/llm-serving-pack#175 · 2 comments ·
Maintainers usually reply within 3 days
-
type: bug 🐛
Difficulty 4/5 3-5 days Newbie friendliness 68/100
nebari-dev/llm-serving-pack#174 ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ UI/UX/DX
Difficulty 5/5 Over a week Newbie friendliness 45/100
nebari-dev/llm-serving-pack#152 · 1 comment ·
Maintainers usually reply within 3 days
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#148 ·
Maintainers usually reply within 3 days
-
priority: high 🔥 security type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#136 ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ security type: enhancement 💅🏼
Difficulty 3/5 1-2 days Newbie friendliness 58/100
nebari-dev/llm-serving-pack#135 ·
Maintainers usually reply within 3 days
-
priority: high 🔥 security type: enhancement 💅🏼
Difficulty 5/5 Over a week Newbie friendliness 25/100
nebari-dev/llm-serving-pack#134 ·
Maintainers usually reply within 3 days
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#124 ·
Maintainers usually reply within 3 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
nebari-dev/llm-serving-pack#123 ·
Maintainers usually reply within 3 days
-
Per-model API-key scoping broken when one user has keys for multiple models (colliding client IDs)Open
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
nebari-dev/llm-serving-pack#122 ·
Maintainers usually reply within 3 days
-
Difficulty 1/5 Under an hour Newbie friendliness 25/100
nebari-dev/llm-serving-pack#121 ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ type: bug 🐛
Difficulty 3/5 1-2 days Newbie friendliness 75/100
nebari-dev/llm-serving-pack#110 · 1 comment ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 72/100
nebari-dev/llm-serving-pack#109 ·
Maintainers usually reply within 3 days
-
good first issue priority: low 🌱 type: enhancement 💅🏼 UI/UX/DX
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#106 ·
Maintainers usually reply within 3 days
-
area: documentation 📖 priority: medium ⚡ type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#104 ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#87 ·
Maintainers usually reply within 3 days
-
priority: high 🔥 type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#86 ·
Maintainers usually reply within 3 days
-
AI Gateway webhook cert becomes untrusted after pod rescheduling, blocking envoy proxy creationOpenneeds: investigation 🔍 priority: high 🔥 type: bug 🐛
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#84 · 3 comments ·
Maintainers usually reply within 3 days
-
epic
Difficulty 5/5 Over a week Newbie friendliness 30/100
nebari-dev/llm-serving-pack#81 ·
Maintainers usually reply within 3 days
-
epic
Difficulty 4/5 3-5 days Newbie friendliness 38/100
nebari-dev/llm-serving-pack#80 ·
Maintainers usually reply within 3 days
-
epic
Difficulty 4/5 3-5 days Newbie friendliness 42/100
nebari-dev/llm-serving-pack#79 ·
Maintainers usually reply within 3 days
-
epic
Difficulty 5/5 Over a week Newbie friendliness 25/100
nebari-dev/llm-serving-pack#78 ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#69 · 1 comment ·
Maintainers usually reply within 3 days
-
area: ci 👷🏽♀️ area: testing ✅ priority: medium ⚡ type: maintenance 🛠
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#68 ·
Maintainers usually reply within 3 days
-
priority: high 🔥 type: enhancement 💅🏼
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#67 ·
Maintainers usually reply within 3 days
-
priority: high 🔥 type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#66 ·
Maintainers usually reply within 3 days
-
needs: follow-up 📥 needs: PR 📬 priority: high 🔥 type: enhancement 💅🏼
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#55 ·
Maintainers usually reply within 3 days
-
area: documentation 📖 needs: documentation 📖 needs: follow-up 📥 priority: medium ⚡ type: maintenance 🛠
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
nebari-dev/llm-serving-pack#54 ·
Maintainers usually reply within 3 days
-
area: developer experience 👩🏻💻 needs: follow-up 📥 priority: low 🌱 type: maintenance 🛠
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nebari-dev/llm-serving-pack#53 ·
Maintainers usually reply within 3 days
-
area: testing ✅ good first issue needs: follow-up 📥 priority: low 🌱 type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#52 ·
Maintainers usually reply within 3 days
-
area: documentation 📖 needs: follow-up 📥 priority: medium ⚡ type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#51 ·
Maintainers usually reply within 3 days
-
area: documentation 📖 needs: follow-up 📥 needs: investigation 🔍 priority: medium ⚡ type: bug 🐛
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#50 ·
Maintainers usually reply within 3 days
-
area: developer experience 👩🏻💻 good first issue needs: follow-up 📥 priority: medium ⚡ type: maintenance 🛠
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
nebari-dev/llm-serving-pack#49 ·
Maintainers usually reply within 3 days
-
area: developer experience 👩🏻💻 good first issue needs: follow-up 📥 priority: low 🌱 type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 78/100
nebari-dev/llm-serving-pack#48 ·
Maintainers usually reply within 3 days
-
Implement envoyAIGateway.install flag in Helm chartMay be free again @marcelovilla claimed this 32 days ago, and no pull request is open. Openpriority: medium ⚡ type: enhancement 💅🏼
nebari-dev/llm-serving-pack#44 · 3 comments · 1 assignee ·
Maintainers usually reply within 3 days
-
priority: medium ⚡ type: enhancement 💅🏼
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#43 ·
Maintainers usually reply within 3 days
-
priority: low 🌱 type: enhancement 💅🏼
Difficulty 5/5 Over a week Newbie friendliness 30/100
nebari-dev/llm-serving-pack#42 ·
Maintainers usually reply within 3 days
-
priority: low 🌱 type: maintenance 🛠
Difficulty 3/5 1-2 days Newbie friendliness 58/100
nebari-dev/llm-serving-pack#40 ·
Maintainers usually reply within 3 days
-
epic
Difficulty 5/5 Over a week Newbie friendliness 30/100
nebari-dev/llm-serving-pack#1 ·
Maintainers usually reply within 3 days
-
Add user-configurable service-level concurrency control for self-hosted modelsPossibly taken @ns-mkusper claimed this 1 day ago. Open
nebari-dev/llm-serving-pack#198 · 1 assignee ·
Maintainers usually reply within 3 days