May I ask if the gguf inference for wan2.2-i2v is supported?
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 35/100
- Issue 类型
- 缺陷
- 描述清晰度
- 需要澄清
- 活跃度
- 停滞
- 技术栈
- python, pytorch
调研方向
Start in pipelines/wan_video.py at from_pretrained and _from_state_dict, then inspect models/wan/wan_dit.py at from_state_dict and the failing load_state_dict call. Compare the checkpoint's patch_embedding shape with the model configuration to determine whether Wan2.2-I2V GGUF is supported or the usage is mismatched; done means the supported configuration or required correction is documented.
由索引模型根据 Issue 内容生成。
描述
May I ask if the gguf inference for wan2.2-i2v is supported?
use model QuantStack/Wan2.2-T2V-A14B-GGUF
`model_path = [
"/model_files/Wan2.2-I2V-A14B-GGUF/LowNoise/Wan2.2-I2V-A14B-LowNoise-Q4_K_S.gguf",
"/model_files/Wan2.2-I2V-A14B-GGUF/HighNoise/Wan2.2-I2V-A14B-HighNoise-Q4_K_S.gguf"
]
t5_path = "/model_files/wan2.1-umt5/umt5.safetensors"
vae_path = "/model_files/muse/wan2.2-vae/__version/vae.safetensors"
config = WanPipelineConfig(
model_path=model_path,
t5_path=t5_path,
vae_path=vae_path,
device="cuda:0",
offload_mode="cpu_offload"
)
pipe = WanVideoPipeline.from_pretrained(config)`
It seems that it cannot be operated.
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 506, in from_pretrained
return cls.from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 520, in from_state_dict
pipe = cls._from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 566, in _from_state_dict
dit = WanDiT.from_state_dict(
File "miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/wan/wan_dit.py", line 417, in from_state_dict
model.load_state_dict(state_dict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/base.py", line 20, in load_state_dict
super().load_state_dict(state_dict, strict=strict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2581, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for WanDiT:
size mismatch for patch_embedding.weight: copying a param with shape torch.Size([5120, 36, 1, 2, 2]) from checkpoint, the shape in current model is torch.Size([5120, 16, 1, 2, 2])
Is it my usage method that has the problem?
Thank you very much for being able to clarify my doubts.
- 主要语言
- Python
- 星标
- 432
- 派生
- 51
- 平均合并
- 3 天 5 小时
- 30 天内合并 PR
- 1
贡献指南
这个仓库没有索引到贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
modelscope/DiffSynth-Engine 的其他 Issue
-
难度 4/5 3-5 天 新手友好度 55/100
modelscope/DiffSynth-Engine#266 ·
-
难度 5/5 一周以上 新手友好度 25/100
modelscope/DiffSynth-Engine#238 · 1 条评论 ·
-
难度 5/5 一周以上 新手友好度 20/100
modelscope/DiffSynth-Engine#235 ·
-
难度 4/5 3-5 天 新手友好度 35/100
modelscope/DiffSynth-Engine#224 · 2 条评论 ·
-
难度 3/5 1-2 天 新手友好度 32/100
modelscope/DiffSynth-Engine#223 · 2 条评论 ·
查看 modelscope/DiffSynth-Engine 的全部 Issue
相似的 Issue
-
bug confirmed issue
难度 2/5 1-3 小时 新手友好度 75/100
open-webui/open-webui#30750 · 1 条评论 ·
-
难度 2/5 1-3 小时 新手友好度 75/100
-
enhancement
难度 2/5 1-3 小时 新手友好度 75/100
OpenwaterHealth/openmotion-bloodflow-app#604 · 1 条评论 ·
-
难度 2/5 1-3 小时 新手友好度 70/100
-
good first issue
难度 1/5 1 小时以内 新手友好度 90/100