Hacktoberfest 2026：维护者为十月标记出来的 issue，仍然开放、适合新手。 浏览 Hacktoberfest issue

OneNote: read handwriting, images and SharePoint notebooks

未关闭
  • 哪里不对？
#1,284 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
5/5
预计耗时
一周以上
新手友好度
30/100
Issue 类型
功能
描述清晰度
描述清楚
活跃度
活跃
技术栈
typescript
领域
ai, backend-api-design

调研方向

Start with intl/microsoft-onenote.json and connectors/binary-response.util.ts to understand the existing content and binary response paths. The proposal also requires tracing the connector layer and response-transform.util.ts opt-in pattern, then checking Microsoft Graph permissions and calibrating InkML coordinates on real pages. Done means resource retrieval, SharePoint and group notebook access, and optional page images with ink work within the stated response limits.

由索引模型根据 Issue 内容生成。

描述

enhancement
Problem

The OneNote adapter (intl/microsoft-onenote.json) reads a page through GET /me/onenote/pages/{id}/content, which returns HTML without ink. Many OneNote users write by hand with a pen (meeting notes, sketches, calculations), so the AI sees nothing of those pages. Embedded pictures and PDF printouts reach the AI only as <img> links to Graph that need the user's sign-in, so it cannot read them either.

Two smaller gaps in the same adapter:

  • Notebooks stored on SharePoint team sites (/sites/{id}/onenote, /groups/{id}/onenote) are not reachable; only /me/onenote is.
  • There is no tool to fetch a single page resource (image or printout).
Proposed Solution
  1. microsoft_onenote_get_resource (adapter JSON only): GET /me/onenote/resources/{id}/$value with the existing binary handling (connectors/binary-response.util.ts), so an image comes back as an MCP image content block that the model can read.
  2. SharePoint and group notebooks (adapter JSON only): list notebooks, sections and pages under /sites/{site-id}/onenote and /groups/{group-id}/onenote. Check which delegated permission Graph needs for these (likely Notes.Read.All / Notes.ReadWrite.All, admin consent) and document it in the adapter instructions.
  3. microsoft_onenote_get_page_image (engine change): render a page as PNG including ink.
    • Fetch content?includeinkML=true (HTML plus InkML).
    • Parse the InkML traces (fast-xml-parser, already a dependency) and draw each trace as an SVG path with its brush colour and width, scaled to page coordinates.
    • Fetch the page's images with the user's token and place them at their absolute positions.
    • Rasterise with @resvg/resvg-js (MPL-2.0, no browser needed); split tall pages into tiles of about 1,500 px on the long edge.
    • Return the typed text as text (as today) plus the image(s). Typed text is not drawn into the PNG; that would need a headless browser in the image.
    • Opt-in per tool through a config key (e.g. "render": "onenote-page"), following the opt-in pattern of decode / images in response-transform.util.ts, but run in the connector layer because it needs further authenticated Graph calls.
Alternatives Considered
  • Handwriting recognition on our side: not needed; current models read handwriting from images well, and Graph exposes no recognised text for ink.
  • Rendering the full page in headless Chromium: higher fidelity for typed text, but adds about 300 MB to the image and a lot of memory per render on the shared Cloud.
  • Returning raw InkML: the model cannot use stroke coordinates meaningfully.
Area

Connectors / adapters (Microsoft OneNote), REST engine.

Additional Context
  • Cloud and self-hosted behave the same; the new dependency ships in the backend image for both.
  • Size limits: the 10 MB tool response cap and the per-tool binary.maxBytes apply; tiles keep each image well below them.
  • InkML coordinate units need calibrating against real pages with pen input before release.
主要语言
TypeScript
星标
856
派生
82
平均合并
7 小时 57 分钟
30 天内合并 PR
290

环境准备

这个项目没有提供开发容器、Dockerfile 或贡献指南，环境需要你自己搭建：先看它的 README，通用步骤见我们的新手贡献指南。

从这里开始

  1. 先读完整个 Issue，再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库，在一个分支上完成修改。
  4. 提交 Pull Request，并在描述里引用这个 Issue 编号。

HelpCode-ai/anythingmcp 的其他 Issue

查看 HelpCode-ai/anythingmcp 的全部 Issue

相似的 Issue

更多 TypeScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。