May I ask if the gguf inference for wan2.2-i2v is supported?
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- python, pytorch
- Domain
- machine-learning
Research direction
Start in pipelines/wan_video.py at from_pretrained and _from_state_dict, then inspect models/wan/wan_dit.py at from_state_dict and the failing load_state_dict call. Compare the checkpoint's patch_embedding shape with the model configuration to determine whether Wan2.2-I2V GGUF is supported or the usage is mismatched; done means the supported configuration or required correction is documented.
Written by the indexing model from the issue text.
Description
May I ask if the gguf inference for wan2.2-i2v is supported?
use model QuantStack/Wan2.2-T2V-A14B-GGUF
`model_path = [
"/model_files/Wan2.2-I2V-A14B-GGUF/LowNoise/Wan2.2-I2V-A14B-LowNoise-Q4_K_S.gguf",
"/model_files/Wan2.2-I2V-A14B-GGUF/HighNoise/Wan2.2-I2V-A14B-HighNoise-Q4_K_S.gguf"
]
t5_path = "/model_files/wan2.1-umt5/umt5.safetensors"
vae_path = "/model_files/muse/wan2.2-vae/__version/vae.safetensors"
config = WanPipelineConfig(
model_path=model_path,
t5_path=t5_path,
vae_path=vae_path,
device="cuda:0",
offload_mode="cpu_offload"
)
pipe = WanVideoPipeline.from_pretrained(config)`
It seems that it cannot be operated.
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 506, in from_pretrained
return cls.from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 520, in from_state_dict
pipe = cls._from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 566, in _from_state_dict
dit = WanDiT.from_state_dict(
File "miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/wan/wan_dit.py", line 417, in from_state_dict
model.load_state_dict(state_dict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/base.py", line 20, in load_state_dict
super().load_state_dict(state_dict, strict=strict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2581, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for WanDiT:
size mismatch for patch_embedding.weight: copying a param with shape torch.Size([5120, 36, 1, 2, 2]) from checkpoint, the shape in current model is torch.Size([5120, 16, 1, 2, 2])
Is it my usage method that has the problem?
Thank you very much for being able to clarify my doubts.
- Dominant language
- Python
- Stars
- 432
- Forks
- 51
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 1
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from modelscope/DiffSynth-Engine
-
Difficulty 4/5 3-5 days Newbie friendliness 55/100
modelscope/DiffSynth-Engine#266 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/DiffSynth-Engine#238 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
modelscope/DiffSynth-Engine#235 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
modelscope/DiffSynth-Engine#224 · 2 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 32/100
modelscope/DiffSynth-Engine#223 · 2 comments ·
All issues in modelscope/DiffSynth-Engine
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
learningequality/ricecooker#747 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
BSData/horus-heresy-3rd-edition#3171 ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
run-llama/llama_index#23199 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
KhronosGroup/glTF-Blender-IO#2769 ·