arc53/DocsGPT

Feature: Add graph retriever

Open

Aperta il 27 giu 2024

Vedi su GitHub
 (5 commenti) (0 reazioni) (1 assegnatario)Python (13.691 star) (1359 fork)batch import
applicationbackendhelp wantedpython

Descrizione

I think we can make upload / training process more advanced, maybe let users choose some "advanced" options on upload in the UI.

This way we can for example prepare data for graph + vector database. And when user creates a query it will automatically figure out where which retriever type needs to be used for that source. So I guess its a two part issue:

  • Edit structure of source docs in general (clean up a bit, and add retriever type field)

  • Add new graph retriever, add graph ingest, add UI to choose ingestion method maybe

Guida contributor

Tech stack
pythonreactjavascript
Dominio
full stackai
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
4
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-2 days
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
blocked
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
mostly clear
Prerequisiti
PythonReactGraph databasesVector databases
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
20
Direzione di ricerca
The issue proposes adding a graph retriever and advanced upload options. The existing codebase uses Python for backend and likely React for frontend. The contributor should examine the current document upload and retrieval flow in the 'api' and 'frontend' directories. There is an assignee, so coordinate with them first. Look into graph database integration (e.g., Neo4j) and how to extend the existing retriever classes. The UI changes involve adding a dropdown for ingestion method. Implementation should start with the backend changes to source document structure.