arc53/DocsGPT

Feature: Add graph retriever

Open

#1,015 建立於 2024年6月27日

在 GitHub 查看
 (5 留言) (0 反應) (1 負責人)Python (13,691 star) (1,359 fork)batch import
applicationbackendhelp wantedpython

描述

I think we can make upload / training process more advanced, maybe let users choose some "advanced" options on upload in the UI.

This way we can for example prepare data for graph + vector database. And when user creates a query it will automatically figure out where which retriever type needs to be used for that source. So I guess its a two part issue:

  • Edit structure of source docs in general (clean up a bit, and add retriever type field)

  • Add new graph retriever, add graph ingest, add UI to choose ingestion method maybe

貢獻者指南

技術棧
pythonreactjavascript
領域
full stackai
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
4
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
1-2 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
blocked
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
mostly clear
前置要求
PythonReactGraph databasesVector databases
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
20
研究方向
The issue proposes adding a graph retriever and advanced upload options. The existing codebase uses Python for backend and likely React for frontend. The contributor should examine the current document upload and retrieval flow in the 'api' and 'frontend' directories. There is an assignee, so coordinate with them first. Look into graph database integration (e.g., Neo4j) and how to extend the existing retriever classes. The UI changes involve adding a dropdown for ingestion method. Implementation should start with the backend changes to source document structure.