Investigate: vertically coherent disocclusion fill

Aperta
  • Qualcosa non va?
#1 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
5/5
Tempo stimato
Più di una settimana
Idoneità per principianti
25/100
Tipo di issue
Bug
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
rust
Ambito
computer-graphics

Direzione di ricerca

Start with smooth_holes_vertically in src/stereo.rs and the test wide_hole_fill_varies_smoothly_between_rows, then render a case with examples/stereo_from_depth.rs to see the streak. Before writing anything, agree on the replacement fill (push-pull or background-only blur) with the maintainer, because the issue leaves the choice open. Done means a committed before/after crop, a passing unit test on a synthetic depth step with a wide hole, and per-frame cost within the video budget.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Wide disocclusion holes in the right eye still look like a smear. This is what remains after the work already shipped.

Already shipped (not part of this issue)

  • Holes are filled from the farther (background) side, mirroring its texture.
  • smooth_holes_vertically in src/stereo.rs averages filled hole pixels with the filled pixels above and below them, so the fill no longer changes row to row. wide_hole_fill_varies_smoothly_between_rows tests it.
  • Photos refine depth with a joint weighted median plus 1 px foreground dilation (src/depth_refine.rs); video uses the guided filter.

What remains

Holes wider than the smoothing radius still repeat one background column across the hole, which shows as a vertical streak. Replace the mirror-and-smooth fill with a bounded background-only fill, for example push-pull from background pixels or a small 2D blur over hole pixels only (iw3 blur_blend). It must stay cheap enough to run per video frame.

Acceptance criteria

  • A reproducible case (a generated or freely licensed photo plus its depth map, rendered with examples/stereo_from_depth.rs) where the current fill shows a wide-hole streak, committed or linked
  • The new fill removes the streak on that case, shown as a before/after crop
  • Cost per frame stays within the existing video budget; no new model or network dependency
  • A unit test on a synthetic depth step with a wide hole
Lingua principale
Rust
Stelle
0
Fork
0
Merge medio
3m
PR unite (30g)
3

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di mrgnw/spatial-maker

Tutte le issue di mrgnw/spatial-maker

Issue simili

Altre issue su Rust

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.