lance-format/lance

Remove duplicate datafusion code

Open

#5.671 geöffnet am 9. Jan. 2026

Auf GitHub ansehen
 (2 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Rust (695 Forks)github user discovery
good first issue

Repository-Metriken

Stars
 (6.582 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 6T 1h) (219 gemergte PRs in 30 T)

Beschreibung

OneShotPartitionStream is defined in two places

  • rust/lance-datafusion/src/exec.rs
  • rust/lance/src/datafusion/dataframe.rs

In addition to this struct, there is a SessionContextExt defined in each of these. From a dependency graph it looks like lance-datafusion is the place we should have a single definition of these and then remove references to the other. The one issue I see is that the SessionContextExt in lance is more complete than the one in lance-datafusion.

Contributor Guide