Hacktoberfest 2026:维护者为十月标记出来的 issue,仍然开放、适合新手。 浏览 Hacktoberfest issue

May I ask if the gguf inference for wan2.2-i2v is supported?

未关闭
#193 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

还没有人认领这个 Issue。

评估

难度
4/5
预计耗时
3-5 天
新手友好度
35/100
Issue 类型
缺陷
描述清晰度
需要澄清
活跃度
停滞
技术栈
python, pytorch

调研方向

Start in pipelines/wan_video.py at from_pretrained and _from_state_dict, then inspect models/wan/wan_dit.py at from_state_dict and the failing load_state_dict call. Compare the checkpoint's patch_embedding shape with the model configuration to determine whether Wan2.2-I2V GGUF is supported or the usage is mismatched; done means the supported configuration or required correction is documented.

由索引模型根据 Issue 内容生成。

描述

May I ask if the gguf inference for wan2.2-i2v is supported?
use model QuantStack/Wan2.2-T2V-A14B-GGUF

`model_path = [
"/model_files/Wan2.2-I2V-A14B-GGUF/LowNoise/Wan2.2-I2V-A14B-LowNoise-Q4_K_S.gguf",
"/model_files/Wan2.2-I2V-A14B-GGUF/HighNoise/Wan2.2-I2V-A14B-HighNoise-Q4_K_S.gguf"
]
t5_path = "/model_files/wan2.1-umt5/umt5.safetensors"
vae_path = "/model_files/muse/wan2.2-vae/__version/vae.safetensors"

config = WanPipelineConfig(
model_path=model_path,
t5_path=t5_path,
vae_path=vae_path,
device="cuda:0",
offload_mode="cpu_offload"
)
pipe = WanVideoPipeline.from_pretrained(config)`

It seems that it cannot be operated.
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 506, in from_pretrained
return cls.from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 520, in from_state_dict
pipe = cls._from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 566, in _from_state_dict
dit = WanDiT.from_state_dict(
File "miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/wan/wan_dit.py", line 417, in from_state_dict
model.load_state_dict(state_dict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/base.py", line 20, in load_state_dict
super().load_state_dict(state_dict, strict=strict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2581, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for WanDiT:
size mismatch for patch_embedding.weight: copying a param with shape torch.Size([5120, 36, 1, 2, 2]) from checkpoint, the shape in current model is torch.Size([5120, 16, 1, 2, 2])

Is it my usage method that has the problem?
Thank you very much for being able to clarify my doubts.

主要语言
Python
星标
432
派生
51
平均合并
3 天 5 小时
30 天内合并 PR
1

贡献指南

这个仓库没有索引到贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

modelscope/DiffSynth-Engine 的其他 Issue

查看 modelscope/DiffSynth-Engine 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。