deforum/sd-webui-deforum

Use Inpainting for Consistency on Single Prompt Animations

開放

#120 建立於 2022年11月29日

 (3 則留言) (0 個反應) (0 位負責人)Python (408 個分叉)auto 404
2D3Dduplicateenhancementhelp wanted

倉庫指標

星標
 (2,854 顆星)
PR 合併指標
 (30 天內沒有已合併 PR)

描述

I believe that Deforum videos of a single prompt would be more consistent if there was a mode that instead of generating a new frame, inpainted the missing details. For example for a 2D camera that is zooming in what it would do is keep all of the image the exact same (maybe with noise scheduling settings) except for the center which it would inpaint at a strength proportional to the zooming speed, so that the zoomed area would be in proper resolution. For a 3D rotating camera as another example, it would find the areas that MiDaS shows weren't in view last frame.

貢獻者指南