Storia-AI/sage

[FEATURE REQUEST] Add progress bar when indexing

Ouverte

#59 ouverte le 6 oct. 2024

 (9 commentaires) (0 réaction) (0 personne assignée)Python (116 forks)auto 404
good first issuehacktoberfest🔥 difficulty: 1

Métriques du dépôt

Stars
 (1 267 étoiles)
Métriques de merge PR
 (Métriques PR en attente)

Description

Is your feature request related to a problem? Please describe. Indexing (especially local) can take a long time, which causes users to give up.

Describe the solution you'd like We should display a progress bar (e.g. via tqdm).

Additional context Each embedder will have a different way of calculating progress. For instance, with the OpenAIBatchEmbedder, we could have two bars: the first one for chunking + issuing indexing jobs, and the second one based on the status of indexing jobs. For the other synchronous embedders (e.g. Voyage, Gemini, Marqo), we'd just have one.

Guide contributeur