lance-format/lance

Remove duplicate datafusion code

Open

#5671 aperta il 9 gen 2026

Vedi su GitHub
 (2 commenti) (0 reazioni) (1 assegnatario)Rust (695 fork)github user discovery
good first issue

Metriche repository

Star
 (6582 star)
Metriche merge PR
 (Merge medio 6g 1h) (219 PR mergiate in 30 g)

Descrizione

OneShotPartitionStream is defined in two places

  • rust/lance-datafusion/src/exec.rs
  • rust/lance/src/datafusion/dataframe.rs

In addition to this struct, there is a SessionContextExt defined in each of these. From a dependency graph it looks like lance-datafusion is the place we should have a single definition of these and then remove references to the other. The one issue I see is that the SessionContextExt in lance is more complete than the one in lance-datafusion.

Guida contributor