Hacktoberfest 2026:维护者为十月标记出来的 issue,仍然开放、适合新手。 浏览 Hacktoberfest issue

10 expensive OpenAI models ship without a price, because the $10,000 request cap was sized for Anthropic's rates

未关闭
#1,406 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
5/5
预计耗时
一周以上
新手友好度
15/100
Issue 类型
功能
描述清晰度
需要澄清
活跃度
活跃
技术栈
go
领域
backend

调研方向

The decision sits between the $10,000 cost cap and the bundled pricing table; start with pricing.BundleableRate and TestMaxPlausibleRequestCostMicros_Derivation, which fails whenever a dear model is bundled. Read docs/pricing.md for the unpriced-traffic signal. The issue offers three options (raise the cap, make the margin rule per-model, or lower the 100× requirement) and none is chosen, so 'done' starts with a maintainer recording the decision before any code changes.

由索引模型根据 Issue 内容生成。

描述

Context for this: Cortex now bundles OpenAI's rates alongside Anthropic's, so OpenAI traffic gets a cost instead of showing blank. Ten of the dearest models are deliberately left out. This explains why, and what it would take to include them.

The short version

Cortex refuses to believe any single request cost more than $10,000 — above that it assumes a glitch rather than a bill, because a gateway can report a cost in an HTTP header and one nonsense value would land permanently in your spend history.

That $10,000 is not a round number someone picked. It is calculated, and the calculation assumes no model costs more than about $75 per million tokens — which was true when Anthropic was the only vendor in the table.

OpenAI sells ten models far dearer than that:

Model Price
o1-pro, o1-pro-2025-03-19 $600 / million tokens
gpt-5.5-pro (+ dated) $180
gpt-5.4-pro (+ dated) $180
gpt-5.2-pro (+ dated) $168
gpt-5-pro (+ dated) $120

Include those and the $10,000 limit stops having the safety margin it was built with. So the generator leaves them out.

Why the margin matters

The rule is that the cap should sit at least 100× above a realistically large request, so that a vendor raising prices does not suddenly cause Cortex to reject real bills.

Dearest bundled model A large real request costs Margin under the $10,000 cap
claude-opus-4 — $75/Mtok $79.80 125× ✅
o1-pro — $600/Mtok $638.40 15.7× ❌

That check is in TestMaxPlausibleRequestCostMicros_Derivation, and it fails if a dear model is bundled. It uses list prices and a real context window — no inflated assumptions — so it is a genuine statement about margin, not an artifact.

What this costs today: nothing

Those ten models have no price right now either, because the bundled table has only ever held Anthropic models. So nobody is worse off than before, while 142 OpenAI models gain prices they did not have (the table goes from 33 entries to 175).

They are not silently wrong, either. An unpriced model is reported as priceable but unpriced and named in unpricedBy, which is the designed signal — see Finding traffic that is not priced.

Workaround if you need one of them priced

Four lines in ~/.cortex/config.yaml, and your own entry always beats the bundled table:

pricing:
  endpoints:
    - hosts: ["api.openai.com"]
      models:
        "o1-pro":
          input_cost_per_million:  600.00
          output_cost_per_million: 600.00

To include them properly, pick one

  • Raise the cap so the margin rule is satisfied with a $600/Mtok model — roughly $64,000 instead of $10,000. Simple, and nothing needs skipping. The cost is a 6× looser bound on a figure that exists to catch garbage.
  • Make the margin rule per-model, comparing each model against the tokens it can actually accept rather than one global figure. o1-pro only takes 300,000 tokens, so its worst real call is $180 and its margin is 55× — better, but still under 100×, so the threshold would need revisiting too.
  • Lower the 100× requirement with a written argument for the new number. It is a judgement call, not a derivation, and 15× is still a wide margin by most readings.

No action needed unless someone actually runs one of these models through Cortex. Filed so the decision is recorded rather than rediscovered.

Note on the generator's rule

The skip is written on the rate, never the vendor — so the first Anthropic model past the bound is dropped on identical terms. It is not an OpenAI carve-out. See pricing.BundleableRate.

Separately: Codex's own model is still unpriced

Worth knowing if that is why you are reading this. gpt-6-luna, which Codex uses, is not affected by the skip — at $0.50/Mtok it is 1,200× clear of the bound. It is missing for an unrelated reason: the bundled table is pinned to a LiteLLM commit that predates that model's addition upstream. Pricing it needs a commit bump, which is its own change because it also moves Anthropic's rates.

Related: #1365 (Codex parity), #942.

Assisted-By: Claude (Anthropic AI) [email protected]

主要语言
Go
星标
16
派生
41
平均合并
11 小时 23 分钟
30 天内合并 PR
275

环境准备

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 阅读贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

rossoctl/cortex 的其他 Issue

查看 rossoctl/cortex 的全部 Issue

相似的 Issue

更多 Go Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。