[Bug][Grafana/Dashboards] Multi-AI Tool Comparison dashboard omits Claude Code and has incomplete panel layout
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 68/100
- Issue 类型
- 缺陷
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- grafana
调研方向
Start with the MySQL and PostgreSQL multi-ai-comparison.json dashboards and compare the existing Copilot, Kiro, and Cursor panels, variables, queries, and grid coordinates. Review the Claude Code tables named in the issue and verify their available fields, then test both dashboards in Grafana with cursor and claude_code data. Done means both variants include Claude Code metrics, filters, documentation, and a filled Assistant Activity slot without layout gaps.
由索引模型根据 Issue 内容生成。
描述
Search before asking
- I had searched in the issues and found no similar issues.
What happened
The Multi-AI Tool Comparison dashboard (multi-ai-comparison.json)
benchmarks AI tool adoption and activity across organizations. In
PR #9017, the dashboard was expanded from Copilot and Kiro to
also include Cursor (Multi-AI Tool Comparison: Copilot vs Kiro vs
Cursor).
However, Claude Code (introduced in PR #8808 via
backend/plugins/claude_code) is completely missing from this
multi-tool comparison dashboard:
- Missing Metrics & Tool Incomplete Comparison:
• Weekly Active Users: Compares Kiro, Copilot, and Cursor,
but omits Claude Code active users (which are collected in
_tool_claude_code_activity_summary and
_tool_claude_code_user_activity).
• Lines of Code (LOC) Added: Aggregates Kiro returned lines,
Copilot LOC added, and Cursor LOC added, but omits Claude
Code cc_lines_added.
• Acceptance Rate Comparison: Compares Copilot and Cursor
acceptance rates, but does not include Claude Code tool
action acceptance rate ((edit + write + multiedit accepted) /
total).
• Connection & Scope Variables: Templating list lacks
variables for Claude Code connections and scopes. - Unbalanced Grid Layout:
• In the Assistant Activity row, panel 13 (Cursor: Tab
Completions) is assigned grid position {h: 8, w: 12, x: 0, y:
21}.
• The adjacent right grid position {h: 8, w: 12, x: 12, y:
21} is left completely empty, resulting in a blank gap in the
dashboard before the next row begins at y: 29. - Dashboard Parity:
• In addition, the PostgreSQL version
(multi-ai-comparison.json) was never updated when Cursor was
added, so it remains out of sync and lacks both Cursor and
Claude Code.
What do you expect to happen
- multi-ai-comparison.json (both MySQL and PostgreSQL variants)
should include Claude Code metrics alongside Copilot, Kiro, and
Cursor:
• WAU: Include Claude Code active users from
_tool_claude_code_user_activity or
_tool_claude_code_activity_summary.
• Assistant Activity: Fill the empty slot at {x: 12, y: 21,
w: 12, h: 8} with a panel for Claude Code tool activity (e.g.
Claude Code: Tool Actions (Accepted vs Rejected) or Sessions
& Tool Modifications).
• Lines of Code Added: Include SUM(cc_lines_added) from
_tool_claude_code_user_activity.
• Acceptance Rate: Include Claude Code tool acceptance rate
(edit_tool_accepted, write_tool_accepted, etc. vs rejected).
• Templating Variables: Add claude_code_connection_id and
claude_code_scope_id template dropdowns. - The "Semantic boundary" documentation at the top of the
dashboard should be updated to clarify the boundary for Claude
Code (i.e. agentic tool actions and CLI sessions vs. inline IDE
autocompletions).
How to reproduce
- Deploy DevLake with both cursor and claude_code plugins
enabled and collect data for both. - Open Grafana and navigate to the Multi-AI Tool Comparison
dashboard (/d/multi_ai_comparison). - Notice that:
• There are no connection/scope filters or panels for Claude
Code.
• There is a 12-column empty gap to the right of the Cursor
Tab Completions panel in the Assistant Activity row.
Anything else
No response
Version
main (commit a18194b96b5b332a60a74b23d51bacbb4262234d)
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
- 主要语言
- Go
- 星标
- 3.1k
- 派生
- 812
- 平均合并
- 2 天 8 小时
- 30 天内合并 PR
- 50
环境准备
我们还没有检查这个项目的环境配置文件。先看它的 README,通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
apache/devlake 的其他 Issue
-
type/bug
难度 1/5 1 小时以内 新手友好度 95/100
维护者通常 1 天内回复
-
难度 3/5 1-2 天 新手友好度 68/100
维护者通常 1 天内回复
-
[Bug][jenkins] Incremental collection skips the stages of builds that finish after the next sync未关闭
难度 3/5 1-2 天 新手友好度 76/100
维护者通常 1 天内回复
-
[Feature][Plugins] Add YouTrack plugin可能已有人在做 @tpam28 于 3 天前认领。 未关闭
难度 5/5 一周以上 新手友好度 32/100
apache/devlake#9168 · 1 条评论 · 已指派 1 人 ·
维护者通常 1 天内回复
-
[Bug][Jira/DORA] Extra JQL does not isolate projects sharing the same Jira board可能已有人在做 @veetmoradiya3628 于 8 天前认领。 未关闭
难度 5/5 一周以上 新手友好度 35/100
apache/devlake#9151 · 2 条评论 · 已指派 1 人 ·
维护者通常 1 天内回复
相似的 Issue
-
automation models
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 72/100
txn2/mcp-data-platform#1984 ·
维护者通常 1 天内回复
-
agentic-workflows
难度 2/5 1-3 小时 新手友好度 68/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 88/100
维护者通常 1 天内回复
-
kind/docs prio/P2
难度 1/5 1 小时以内 新手友好度 95/100
agent-substrate/substrate#1986 ·
维护者通常 1 天内回复