lance-format/lance

[DuckDB] Implement replacement scan function for Lance Scan in DuckDB

Open

#641 geöffnet am 25. Feb. 2023

Auf GitHub ansehen
 (0 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Rust (695 Forks)github user discovery
duckdbgood first issuehelp wantedrust

Repository-Metriken

Stars
 (6.582 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 6T 1h) (219 gemergte PRs in 30 T)

Beschreibung

Problem Statement

DuckDB has a concept of replacement scan when the URL of dataset matches to certain pattern, the URL itself can be used to indicate which scan function to call,

For example,

SELECT * FROM s3://foo/bar/zoo.lance
-- Replace
SELECT * FROM lance_scan("s3://foo/bar/zoo.lance")

Reference of the old (c++) implementation

https://github.com/eto-ai/lance/blob/78e5af7dec1a9602823797ba18eafc632ba727c3/integration/duckdb/src/lance/duckdb/lance-extension.cc#L65

Desired Behavior

Re-enable the scan replacement of lance scan in the rust-based duckdb extension.

Contributor Guide