microsoft/markitdown

LLM Integration

Open

#12 建立於 2024年12月13日

在 GitHub 查看
 (16 留言) (9 反應) (0 負責人)Python (123,207 star) (8,330 fork)batch import
enhancementgood first issue

描述

As a feature suggestion, I would love if this could allow you to plug in an LLM (such as GPT-4o) where images that are included in the content could be sent to the LLM for further understanding. For example, if it was say a bar chart or graph, it would be sent to convert that to a Markdown table and be integrated in the final Markdown output.

貢獻者指南

技術棧
python
領域
backendcli
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
4
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
over 1 week
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
active
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
needs investigation
前置要求
Python programmingHTTP API callsFamiliarity with markitdown
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
20
研究方向
Review the markitdown source code for current image handling, likely in the conversion logic. Investigate integrating an LLM API like OpenAI's GPT 4o for image to text conversion. Consider how to pass images, handle API keys, and format results into Markdown tables. Also check the issue comments for any additional constraints or desired flexibility.