[Bug]: CLIPLoader error

Open
#339 10 comments 2 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
25/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale

Research direction

Start by reproducing the workflow from the attached JSON and reviewing the CLIPLoader error alongside the Llama2 state-dictionary shapes in the debug log. Determine which model configuration the workflow expects and verify the selected checkpoint matches it. Done means the workflow loads the model without size-mismatch errors.

Written by the indexing model from the issue text.

Description

Potential Bug
ComfyUI and Frontend Versions
Image
Description

Just installed this using the Json and installed all the models etc however, I am getting this error

Image
Steps to Reproduce

1

Debug Logs
Error(s) in loading state_dict for Llama2:
	size mismatch for model.embed_tokens.weight: copying a param with shape torch.Size([151936, 2560]) from checkpoint, the shape in current model is torch.Size([128256, 4096]).
	size mismatch for model.layers.0.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.0.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.0.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.0.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.0.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.0.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.0.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.0.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.0.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.1.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.1.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.1.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.1.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.1.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.1.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.1.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.1.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.1.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.2.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.2.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.2.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.2.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.2.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.2.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.2.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.2.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.2.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.3.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.3.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.3.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.3.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.3.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.3.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.3.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.3.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.3.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.4.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.4.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.4.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.4.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.4.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.4.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.4.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.4.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.4.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.5.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.5.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.5.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.5.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.5.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.5.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.5.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.5.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.5.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.6.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.6.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.6.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.6.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.6.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.6.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.6.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.6.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.6.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.7.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.7.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.7.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.7.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.7.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.7.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.7.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.7.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.7.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.8.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.8.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.8.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.8.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.8.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.8.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.8.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.8.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.8.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.9.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.9.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.9.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.9.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.9.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.9.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.9.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.9.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.9.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.10.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.10.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.10.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.10.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.10.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.10.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.10.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.10.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.10.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.11.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.11.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.11.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.11.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.11.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.11.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.11.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.11.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.11.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.12.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.12.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.12.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.12.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.12.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.12.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.12.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.12.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.12.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.13.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.13.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.13.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.13.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.13.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.13.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.13.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.13.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.13.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.14.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.14.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.14.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.14.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.14.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.14.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.14.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.14.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.14.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.15.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.15.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.15.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.15.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.15.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.15.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.15.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.15.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.15.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.16.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.16.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.16.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.16.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.16.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.16.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.16.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.16.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.16.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.17.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.17.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.17.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.17.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.17.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.17.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.17.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.17.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.17.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.18.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.18.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.18.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.18.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.18.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.18.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.18.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.18.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.18.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.19.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.19.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.19.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.19.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.19.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.19.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.19.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.19.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.19.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.20.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.20.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.20.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.20.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.20.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.20.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.20.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.20.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.20.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.21.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.21.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.21.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.21.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.21.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.21.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.21.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.21.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.21.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.22.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.22.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.22.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.22.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.22.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.22.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.22.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.22.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.22.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.23.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.23.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.23.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.23.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.23.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.23.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.23.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.23.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.23.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.24.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.24.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.24.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.24.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.24.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.24.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.24.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.24.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.24.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.25.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.25.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.25.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.25.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.25.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.25.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.25.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.25.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.25.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.26.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.26.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.26.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.26.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.26.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.26.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.26.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.26.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.26.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.27.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.27.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.27.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.27.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.27.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.27.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.27.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.27.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.27.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.28.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.28.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.28.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.28.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.28.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.28.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.28.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.28.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.28.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.29.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.29.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.29.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.29.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.29.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.29.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.29.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.29.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.29.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.30.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.30.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.30.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.30.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.30.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.30.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.30.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.30.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.30.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.31.self_attn.q_proj.weight: copying a param with shape torch.Size([4096, 2560]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.31.self_attn.k_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.31.self_attn.v_proj.weight: copying a param with shape torch.Size([1024, 2560]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
	size mismatch for model.layers.31.self_attn.o_proj.weight: copying a param with shape torch.Size([2560, 4096]) from checkpoint, the shape in current model is torch.Size([4096, 4096]).
	size mismatch for model.layers.31.mlp.gate_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.31.mlp.up_proj.weight: copying a param with shape torch.Size([9728, 2560]) from checkpoint, the shape in current model is torch.Size([14336, 4096]).
	size mismatch for model.layers.31.mlp.down_proj.weight: copying a param with shape torch.Size([2560, 9728]) from checkpoint, the shape in current model is torch.Size([4096, 14336]).
	size mismatch for model.layers.31.input_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.layers.31.post_attention_layernorm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096]).
	size mismatch for model.norm.weight: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([4096])
Browser Logs

.

Setting JSON

image_z_image_turbo.json

What browsers do you use to access the UI ?

No response

Dominant language
TypeScript
Stars
1.5k
Forks
270
Avg merge
7h 23m
Merged PRs (30d)
65

Getting set up

This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from Comfy-Org/workflow_templates

All issues in Comfy-Org/workflow_templates

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.