lance-format/lance

Allow issue vector search in batch mode

Open

#876 geöffnet am 17. Mai 2023

Auf GitHub ansehen
 (3 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Rust (695 Forks)github user discovery
A-indexA-pythonenhancementgood first issuehelp wantedrust

Repository-Metriken

Stars
 (6.582 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 6T 1h) (219 gemergte PRs in 30 T)

Beschreibung

Problem Statement

Instead of query one vector a time, allows user to issue multiple queries in the same request, exposing more opportunity for internal parallisms.

enable vector searching for a batch of queries. Currently Lance only allows 1D queries, but allowing 2D queries (parallelized) would be useful. Use case #1 is: at query time to run multiple simultaneous queries 'around' the root query to diversify search results, and #2 is useful for ETL operations (like the above deduplication) Agree it would be amazing that lance support this api directly to minimize read requests to object store. Recent work to cache the index already helps

Contributor Guide