help wantednew model
倉庫指標
- Star
- (4,990 star)
- PR 合併指標
- (PR 指標待抓取)
描述
The model to consider.
a 2.6B camera-controlled, 720p, 1 minute-long video generation model, ICLR 2026 from Nvidia
Code: https://github.com/NVlabs/Sana Website: https://nvlabs.github.io/Sana/WM/
cc: @TKONIY Related to: https://github.com/vllm-project/vllm-omni/issues/1987
The closest model vllm-omni already supports.
LTX-2.
What's your difficulty of supporting the model you want?
It needs a text encoder (Gemma), a DiT backbone, a camera control (dual branch) module, a LTX2 video VAE tokenizer.
The new parts needed: for camera control, need to create a new processor in stage_input_processors. Also need to add a (Gated DeltaNet) attention backend in diffusion/attention/backends/.
The parts we already have: LTX2 video tokenizer, DiT, gemma text encoder
Use case and motivation
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.