filesystem: realistic examples in search_files' description stop small models refusing to search (measured; follow-up to #896 / #3419)

未關閉 適合新手
#5,553 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視

維護者通常 1 天內回覆

還沒有人認領這個 Issue。

評估

難度
2/5
預估耗時
1-3 小時
新手友好度
68/100
Issue 類型
功能
描述清晰度
描述清楚
活躍度
活躍
技術堆疊
node.js, typescript
領域
tooling

研究方向

找出檔案系統伺服器的 search_files 描述,並將目前的範例與 issue 中的具體模式比較,例如 '/*.json' 和 '/invoice'。閱讀連結的案例研究,了解測量過的變體。新增實際的搜尋範例;若要處理選用的空結果提示,請檢查 search_files 如何格式化 'No matches found';當描述反映這些範例,且提示說明遞迴模式時,即完成。

由索引模型根據 Issue 內容生成。

描述

enhancement server-filesystem v2
Which server?

filesystem (@modelcontextprotocol/server-filesystem)

Protocol era

Both, or not era-specific

MCP client

No response

The problem

Server: @modelcontextprotocol/server-filesystem, measured on 2.0.0 and 2.2.0 (checked: 2.3.0 ships the same search_files description and the same empty result). Run with npx -y @modelcontextprotocol/server-filesystem@<version> <dir>, stdio, Node 24, macOS.

Thanks for the rewrite from #896 / #3419. We measured it, and it clearly fixes how agents search: a small model that does search now finds files reliably.

What it doesn't fix: on questions like "How many orders are there in total?", the model usually doesn't search at all. It answers on step 1, "I don't have access to any database or system that would contain order information", while the data sits one tool call away. In a controlled test the example patterns in the description decided this:

search_files description (server 2.0.0, 4 tasks x 3 runs, answers checked in code) Pass
2.0.0 original 2/12
2.2.0 / 2.3.0 text 2/12
precise rules + generic examples '**/*.ext', '**/name' 3/12
precise rules + concrete examples '**/*.json', '**/*invoice*' 9/12 (reproduced in 3 separate runs)

The only difference between the last two rows is the two example patterns. On the two affected tasks they went from 0/6 to 6/6, and with the concrete examples the model searched **/*order* and found the data.

Case study (method, all tables, caveats): https://github.com/Tanishq67m/AgentGrade/blob/main/docs/CASE_STUDY.md
Raw reports: https://github.com/Tanishq67m/AgentGrade/tree/main/results

Solution you have in mind (optional)
  1. Add one or two realistic examples next to the generic ones, e.g. '**/*.json', '**/*report*'. Small models seem to read abstract placeholders as "this is a file utility", not "the user's data is here".
  2. Replace the bare No matches found with a hint, e.g. "No matches for '' under ''. Patterns are relative to path; use '**/' to search subdirectories." In earlier runs agents repeated non-recursive patterns up to 9 times after a bare empty result.
Which MCP feature does it demonstrate? (optional)

No response

Alternatives or workarounds you have tried
  • Agent-side prompt advice ("Explore with the tools before saying information is unavailable"): 3/12 vs 1/12, still mostly refusals.
  • Advising "look at the folder layout first" in the description: no effect (1/12).
  • Removing search_files entirely: no effect (1/12); the refusal happens before any tool is chosen.
  • A larger model (gpt-oss-120b) solved 11/12 even on 2.0.0, so this mainly affects small, cheap models. One small model and synthetic data, 12 runs per row: indicative, not universal.
Already built it locally?

No server code was changed. Each description was tested by having the client show the model only a different search_files description, with the server binary unchanged and the same tasks and repeats. Verified by code-checked answers, 12 runs per variant. The exact texts are in the case study.

Before you submit
  • I searched existing issues and this is not a duplicate.
  • This is a request for this repository or one of its servers, not a new server, the MCP specification or an SDK.
主要語言
TypeScript
星號
92k
分支
12k
平均合併
3 小時 12 分鐘
30 天內合併 PR
174

環境準備

從這裡開始

  1. 先讀完整個 Issue,再讀專案的貢獻指南。
  2. 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
  3. Fork 儲存庫,在一個分支上完成修改。
  4. 送出 Pull Request,並在描述裡引用這個 Issue 編號。

modelcontextprotocol/servers 的其他 Issue

查看 modelcontextprotocol/servers 的全部 Issue

相似的 Issue

更多 TypeScript Issue

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。