10 expensive OpenAI models ship without a price, because the $10,000 request cap was sized for Anthropic's rates
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
调研方向
The decision sits between the $10,000 cost cap and the bundled pricing table; start with pricing.BundleableRate and TestMaxPlausibleRequestCostMicros_Derivation, which fails whenever a dear model is bundled. Read docs/pricing.md for the unpriced-traffic signal. The issue offers three options (raise the cap, make the margin rule per-model, or lower the 100× requirement) and none is chosen, so 'done' starts with a maintainer recording the decision before any code changes.
由索引模型根据 Issue 内容生成。
描述
Context for this: Cortex now bundles OpenAI's rates alongside Anthropic's, so OpenAI traffic gets a cost instead of showing blank. Ten of the dearest models are deliberately left out. This explains why, and what it would take to include them.
The short version
Cortex refuses to believe any single request cost more than $10,000 — above that it assumes a glitch rather than a bill, because a gateway can report a cost in an HTTP header and one nonsense value would land permanently in your spend history.
That $10,000 is not a round number someone picked. It is calculated, and the calculation assumes no model costs more than about $75 per million tokens — which was true when Anthropic was the only vendor in the table.
OpenAI sells ten models far dearer than that:
| Model | Price |
|---|---|
o1-pro, o1-pro-2025-03-19 |
$600 / million tokens |
gpt-5.5-pro (+ dated) |
$180 |
gpt-5.4-pro (+ dated) |
$180 |
gpt-5.2-pro (+ dated) |
$168 |
gpt-5-pro (+ dated) |
$120 |
Include those and the $10,000 limit stops having the safety margin it was built with. So the generator leaves them out.
Why the margin matters
The rule is that the cap should sit at least 100× above a realistically large request, so that a vendor raising prices does not suddenly cause Cortex to reject real bills.
| Dearest bundled model | A large real request costs | Margin under the $10,000 cap |
|---|---|---|
claude-opus-4 — $75/Mtok |
$79.80 | 125× ✅ |
o1-pro — $600/Mtok |
$638.40 | 15.7× ❌ |
That check is in TestMaxPlausibleRequestCostMicros_Derivation, and it fails if a dear model is bundled. It uses list prices and a real context window — no inflated assumptions — so it is a genuine statement about margin, not an artifact.
What this costs today: nothing
Those ten models have no price right now either, because the bundled table has only ever held Anthropic models. So nobody is worse off than before, while 142 OpenAI models gain prices they did not have (the table goes from 33 entries to 175).
They are not silently wrong, either. An unpriced model is reported as priceable but unpriced and named in unpricedBy, which is the designed signal — see Finding traffic that is not priced.
Workaround if you need one of them priced
Four lines in ~/.cortex/config.yaml, and your own entry always beats the bundled table:
pricing:
endpoints:
- hosts: ["api.openai.com"]
models:
"o1-pro":
input_cost_per_million: 600.00
output_cost_per_million: 600.00
To include them properly, pick one
- Raise the cap so the margin rule is satisfied with a $600/Mtok model — roughly $64,000 instead of $10,000. Simple, and nothing needs skipping. The cost is a 6× looser bound on a figure that exists to catch garbage.
- Make the margin rule per-model, comparing each model against the tokens it can actually accept rather than one global figure.
o1-proonly takes 300,000 tokens, so its worst real call is $180 and its margin is 55× — better, but still under 100×, so the threshold would need revisiting too. - Lower the 100× requirement with a written argument for the new number. It is a judgement call, not a derivation, and 15× is still a wide margin by most readings.
No action needed unless someone actually runs one of these models through Cortex. Filed so the decision is recorded rather than rediscovered.
Note on the generator's rule
The skip is written on the rate, never the vendor — so the first Anthropic model past the bound is dropped on identical terms. It is not an OpenAI carve-out. See pricing.BundleableRate.
Separately: Codex's own model is still unpriced
Worth knowing if that is why you are reading this. gpt-6-luna, which Codex uses, is not affected by the skip — at $0.50/Mtok it is 1,200× clear of the bound. It is missing for an unrelated reason: the bundled table is pinned to a LiteLLM commit that predates that model's addition upstream. Pricing it needs a commit bump, which is its own change because it also moves Anthropic's rates.
Related: #1365 (Codex parity), #942.
Assisted-By: Claude (Anthropic AI) [email protected]
- 主要语言
- Go
- 星标
- 16
- 派生
- 41
- 平均合并
- 11 小时 23 分钟
- 30 天内合并 PR
- 275
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
rossoctl/cortex 的其他 Issue
-
UI shows costs for all sessions even when drilled into a session可能已有人在做 @esnible 于 2 天前认领。 未关闭
难度 2/5 1-3 小时 新手友好度 70/100
rossoctl/cortex#1116 · 2 条评论 · 已指派 1 人 ·
维护者通常 1 天内回复
-
难度 5/5 一周以上 新手友好度 22/100
维护者通常 1 天内回复
-
Add a coding-agent demo with cpex policy enforcement可能已有人在做 @araujof 今天认领。 未关闭
rossoctl/cortex#1428 · 已指派 1 人 ·
维护者通常 1 天内回复
-
Release cortex-cpex binaries and add installer support可能已有人在做 @araujof 今天认领。 未关闭
rossoctl/cortex#1427 · 已指派 1 人 ·
维护者通常 1 天内回复
-
Update the hr-cpex demo for CPEX 0.3可能已有人在做 @araujof 今天认领。 未关闭
rossoctl/cortex#1426 · 已指派 1 人 ·
维护者通常 1 天内回复
相似的 Issue
-
Named Tuple element with a space in its name fails to parse可能已有人在做 @spicysharkco 今天认领。 未关闭
难度 2/5 1-3 小时 新手友好度 72/100
ClickHouse/clickhouse-go#2073 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 72/100
-
ci: nothing regenerates the Go contract types, so a hand-edit to types.gen.go passes可能已有人在做 @shaiknoorullah 今天认领。 未关闭
难度 2/5 1-3 小时 新手友好度 68/100
shaiknoorullah/hg-mono#993 · 2 条评论 ·
维护者通常 1 天内回复
-
type:bug
难度 2/5 1-3 小时 新手友好度 72/100
CarlosDanielDev/aiacc#78 · 1 条评论 ·
维护者通常 1 天内回复
-
enhancement
难度 2/5 1-3 小时 新手友好度 68/100