arc53/DocsGPT

🚀 Feature Extract and process images from source uploads

Open

#1,451 opened on 2024幎11月23日

GitHub で芋る
 (8 comments) (3 reactions) (3 assignees)Python (1,359 forks)batch import
applicationbackendenhancementhacktoberfesthelp wantedpython

Repository metrics

Stars
 (13,691 stars)
PR merge metrics
 (平均マヌゞ 8d 11h) (30d で 35 merged PRs)

説明

🔖 Feature description

@dartpain Basically allow our AI's to eat images. good place to start is just open ai llms, even docsgpt free service should work

🎀 Why is this feature needed ?

Accept image and encoded base64

  • Maybe user wants to send a message with an image when chatting with AI

✌ How do you aim to achieve this?

  • When a source has an image, for example there is a link (publicly accessible) in markdown file that was ingested, we can pass it to llm inside classic rag retriever when its generating an answer.

🔄 Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

コントリビュヌタヌガむド