May I ask if the gguf inference for wan2.2-i2v is supported?
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 35/100
- Tipo de issue
- Error
- Claridad
- Necesita aclaración
- Estado de actividad
- Estancado
- Stack tecnológico
- python, pytorch
- Área
- machine-learning
Línea de trabajo
Start in pipelines/wan_video.py at from_pretrained and _from_state_dict, then inspect models/wan/wan_dit.py at from_state_dict and the failing load_state_dict call. Compare the checkpoint's patch_embedding shape with the model configuration to determine whether Wan2.2-I2V GGUF is supported or the usage is mismatched; done means the supported configuration or required correction is documented.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
May I ask if the gguf inference for wan2.2-i2v is supported?
use model QuantStack/Wan2.2-T2V-A14B-GGUF
`model_path = [
"/model_files/Wan2.2-I2V-A14B-GGUF/LowNoise/Wan2.2-I2V-A14B-LowNoise-Q4_K_S.gguf",
"/model_files/Wan2.2-I2V-A14B-GGUF/HighNoise/Wan2.2-I2V-A14B-HighNoise-Q4_K_S.gguf"
]
t5_path = "/model_files/wan2.1-umt5/umt5.safetensors"
vae_path = "/model_files/muse/wan2.2-vae/__version/vae.safetensors"
config = WanPipelineConfig(
model_path=model_path,
t5_path=t5_path,
vae_path=vae_path,
device="cuda:0",
offload_mode="cpu_offload"
)
pipe = WanVideoPipeline.from_pretrained(config)`
It seems that it cannot be operated.
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 506, in from_pretrained
return cls.from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 520, in from_state_dict
pipe = cls._from_state_dict(state_dicts, config)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/pipelines/wan_video.py", line 566, in _from_state_dict
dit = WanDiT.from_state_dict(
File "miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/wan/wan_dit.py", line 417, in from_state_dict
model.load_state_dict(state_dict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/diffsynth_engine/models/base.py", line 20, in load_state_dict
super().load_state_dict(state_dict, strict=strict, assign=assign)
File "/miniconda3/envs/diffSynth-engine/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2581, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for WanDiT:
size mismatch for patch_embedding.weight: copying a param with shape torch.Size([5120, 36, 1, 2, 2]) from checkpoint, the shape in current model is torch.Size([5120, 16, 1, 2, 2])
Is it my usage method that has the problem?
Thank you very much for being able to clarify my doubts.
- Lenguaje dominante
- Python
- Estrellas
- 432
- Forks
- 51
- Merge medio
- 3 d 5 h
- PR fusionados (30 d)
- 1
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de modelscope/DiffSynth-Engine
-
Dificultad 4/5 3-5 días Aptitud para principiantes 55/100
modelscope/DiffSynth-Engine#266 ·
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 25/100
modelscope/DiffSynth-Engine#238 · 1 comentario ·
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 20/100
modelscope/DiffSynth-Engine#235 ·
-
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
modelscope/DiffSynth-Engine#224 · 2 comentarios ·
-
Dificultad 3/5 1-2 días Aptitud para principiantes 32/100
modelscope/DiffSynth-Engine#223 · 2 comentarios ·
Todos los issues de modelscope/DiffSynth-Engine
Issues similares
-
enhancement
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
canonical/paas-charm#368 · 1 comentario ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
-
tech debt
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
-
addition to tracking list Abierto
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
StevenBlack/hosts#3256 ·
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
qualcomm/qai-appbuilder#275 ·