deforum/sd-webui-deforum

Use Inpainting for Consistency on Single Prompt Animations

开放

#120 创建于 2022年11月29日

 (3 条评论) (0 个反应) (0 位负责人)Python (408 个派生)auto 404
2D3Dduplicateenhancementhelp wanted

仓库指标

星标
 (2,854 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

I believe that Deforum videos of a single prompt would be more consistent if there was a mode that instead of generating a new frame, inpainted the missing details. For example for a 2D camera that is zooming in what it would do is keep all of the image the exact same (maybe with noise scheduling settings) except for the center which it would inpaint at a strength proportional to the zooming speed, so that the zoomed area would be in proper resolution. For a 3D rotating camera as another example, it would find the areas that MiDaS shows weren't in view last frame.

贡献者指南