comfy generate: stale Gemini model enum and incomplete GPT Image 2 output/edit support

未关闭
#613 3 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
4/5
预计耗时
3-5 天
新手友好度
48/100
Issue 类型
缺陷
描述清晰度
基本清楚
活跃度
冷清
技术栈
openapi, python
领域
ai, api, cli

调研方向

从 nano-banana fallback enum、通用结果提取、OpenAIImageEditRequest 以及请求 https://api.comfy.org/openapi.yml 的 refresh 命令开始。复现 schema、GPT Image 2 生成/编辑命令和 refresh 命令,然后检查相关 catalog 和 response 处理。完成的标准是:当前 Gemini 名称能够通过验证,b64_json 图像能够下载,编辑图像输入能够被接受,并且 refresh 使用可工作的 catalog endpoint。

由索引模型根据 Issue 内容生成。

描述

bug

comfy generate: stale Gemini image model enum and incomplete GPT Image 2 output/edit support

Describe the bug

comfy generate does not currently expose or fully handle several image models that are available through the current ComfyUI Partner Nodes:

  1. The nano-banana adapter uses a fixed Gemini model enum. It accepts the legacy gemini-3-pro-image-preview name, which the server resolves successfully to gemini-3-pro-image, but it rejects the current stable gemini-3-pro-image name and Nano Banana 2 (gemini-3.1-flash-image) before making a request.
  2. GPT Image 2 generation is accepted by the server through dalle --model gpt-image-2, but the response contains data[].b64_json. The CLI reports that no image URLs were found and --download does not save the image.
  3. The dalle-edit schema does not include an image input, so GPT Image 2 editing cannot be submitted: --image is rejected as an unknown flag.
  4. comfy generate refresh currently requests https://api.comfy.org/openapi.yml, which returns HTTP 404, so it cannot refresh the local catalog.

I also checked the current main branch. The Gemini fallback enum, URL-only generic result extraction, and OpenAIImageEditRequest without an image property are still present there.

To Reproduce

Environment:

comfy-cli 1.12.0
Python 3.12
macOS x86_64
Authentication: COMFY_API_KEY environment variable (no browser login)

Inspect the Nano Banana schema:

comfy generate schema nano-banana --json

The model enum is:

gemini-2.5-flash-image
gemini-2.5-flash-image-preview
gemini-3-pro-image-preview

Current stable model names are rejected locally:

comfy generate nano-banana \
  --prompt "A blue ceramic cube on a white background" \
  --model gemini-3-pro-image \
  --json

comfy generate nano-banana \
  --prompt "A blue ceramic cube on a white background" \
  --model gemini-3.1-flash-image \
  --json

Both return:

--model: '<model>' is not one of [...]

However, the legacy Pro name succeeds:

comfy generate nano-banana \
  --prompt "A blue ceramic cube on a white background" \
  --model gemini-3-pro-image-preview \
  --json

The successful server response reports:

{
  "modelVersion": "gemini-3-pro-image"
}

GPT Image 2 generation reaches the server successfully:

comfy generate dalle \
  --model gpt-image-2 \
  --prompt "A red glass sphere on a light gray background" \
  --n 1 \
  --quality low \
  --size 1024x1024 \
  --output_format png \
  --download gpt-image-2.png

The command exits successfully but does not save the image:

No image URLs found in response. Pass --json to inspect.
--download requested but no image URLs found in response.

The JSON response uses data[].b64_json. Trying to force a URL does not work:

comfy generate dalle \
  --model gpt-image-2 \
  --prompt "A green glass sphere on a light gray background" \
  --response_format url \
  --download gpt-image-2.png

The API returns:

API error 400
Unknown parameter: 'response_format'.

GPT Image 2 editing is blocked by the local schema:

comfy generate dalle-edit \
  --model gpt-image-2 \
  --prompt "Replace the circle with a star" \
  --image input.png \
  --download edited.png

Result:

Unknown flag: '--image'.

Finally:

comfy generate refresh

returns:

Failed to fetch https://api.comfy.org/openapi.yml: 404 Not Found

Expected behavior

  • nano-banana should accept the current Partner Node model identifiers, including gemini-3-pro-image and gemini-3.1-flash-image, or obtain the enum dynamically from the active catalog.
  • --download should decode and save OpenAI data[].b64_json image responses, similar to the existing Gemini inline-image decoder.
  • dalle-edit should expose the required image input(s), and optional mask input where supported, so GPT Image 2 editing can be submitted.
  • comfy generate refresh should fetch the current authenticated/public OpenAPI catalog from a working endpoint.
  • comfy generate list / schema should reflect models currently supported by the official ComfyUI Partner Nodes.

Nice to have

  • Terminal output
  • Screenshots

Additional context

  • Nano Banana Pro generation and image editing both succeeded when using gemini-3-pro-image-preview; the response identified the actual model as gemini-3-pro-image.
  • No API keys, account identifiers, generated base64 payloads, or private URLs are included in this report.
主要语言
Python
星标
1k
派生
176
平均合并
1 天 11 小时
30 天内合并 PR
87

环境准备

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 阅读贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

Comfy-Org/comfy-cli 的其他 Issue

查看 Comfy-Org/comfy-cli 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。