aiq/routingarea/agenthelp wantedkind/enhancementkind/featurepriority/p2status/bot-triaged
仓库指标
- Star
- (103,992 star)
- PR 合并指标
- (平均合并 4天 2小时) (30 天内合并 55 个 PR)
描述
What would you like to be added?
I would like to have much more control over routing. For numerical routing, this would mean controlling what levels get sent to which models, for example something like:
- <10 -> local gemma
- <30 -> 2.5 flash
- <80 -> 3 flash
- >80 -> 3 pro
Why is this needed?
Currently, the only routing available is to choose between the flash and pro models for the current major version. This is quite restrictive, especially as even 3 flash is quite capable (and quite quota- and rate-limited).
Additional context
No response