Storia-AI/sage

[FEATURE REQUEST] Add progress bar when indexing

Offen

#59 geöffnet am 06.10.2024

 (9 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Python (116 Forks)auto 404
good first issuehacktoberfest🔥 difficulty: 1

Repository-Metriken

Stars
 (1.267 Sterne)
PR-Merge-Metriken
 (PR-Metriken ausstehend)

Beschreibung

Is your feature request related to a problem? Please describe. Indexing (especially local) can take a long time, which causes users to give up.

Describe the solution you'd like We should display a progress bar (e.g. via tqdm).

Additional context Each embedder will have a different way of calculating progress. For instance, with the OpenAIBatchEmbedder, we could have two bars: the first one for chunking + issuing indexing jobs, and the second one based on the status of indexing jobs. For the other synchronous embedders (e.g. Voyage, Gemini, Marqo), we'd just have one.

Contributor Guide