Copilot desktop app activity stopped being attributed to `copilot_app` in usage metrics
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Bug
- Clarity
- Clearly specified
- Activity status
- Active
- Tech stack
- github
- Domain
- analytics
Research direction
No source file or test is identified in the issue. Start by reproducing the organization users-1-day report for a desktop app user and compare the app and CLI attribution fields; the issue is done when desktop activity is attributed to copilot_app, retaining CLI attribution only when both surfaces are involved.
Written by the indexing model from the issue text.
Description
Short summary
After a Copilot desktop app update, organization usage reports stopped attributing activity from some desktop app users to the copilot_app surface.
Affected version or release
1.1.21
Installation context
All people in the org using Github Copilot app.
What happened?
After a Copilot desktop app update, organization usage reports stopped attributing activity from some desktop app users to the copilot_app surface.
Before the update, desktop app sessions produced all expected signals:
used_copilot_app: truetotals_by_copilot_app- A
copilot_appentry intotals_by_feature - In some cases, simultaneous CLI attribution because the app uses the CLI runtime internally
After the update, the same users’ activity continued to be reported, but only as CLI activity:
used_cli: truetotals_by_clipresentcopilot_clifeature activity presentused_copilot_app: falsetotals_by_copilot_appabsent- No
copilot_appfeature entry
❗ Comparing weekdays before and after the transition:
- Reported Copilot App active users fell 78%
- Copilot App requests fell 94%
- Copilot App generations fell 96%
- CLI active users increased 42%
- CLI requests increased 97%
- CLI prompts increased 215%
- CLI-only attribution increased 196%
- Simultaneous app-and-CLI attribution fell 89%
The organization-level report reconciles exactly with the per-user rows, so this is not a downstream dashboard or aggregation problem. The incorrect attribution originates in GitHub’s telemetry or reporting pipeline.
Steps to reproduce
- Use the GitHub Copilot desktop app through an organization-managed Copilot license.
- Download the organization
users-1-dayusage report. - Locate the user’s activity for that day.
- Observe that desktop app activity is reported under
used_cliandtotals_by_cli. - Observe that
used_copilot_appisfalse, whiletotals_by_copilot_appand thecopilot_appfeature row are absent.
Expected behavior
Activity initiated in the GitHub Copilot desktop app must be attributed to the copilot_app surface, even if the app uses the Copilot CLI runtime internally.
If both surfaces are intentionally involved, the report should retain both signals, as it did previously and as GitHub’s documented example schema supports.
Additional context
‼️ This is not acceptable for a paid organization product. We rely on these metrics to measure Copilot App adoption and justify substantial licensing and AI-credit expenditure. Reporting desktop app usage as CLI-only materially misrepresents product adoption and makes the organization metrics unreliable.
- Dominant language
- No language data
- Stars
- 2.1k
- Forks
- 157
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from github/app
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 64/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
chore P3 plotly-internal size: 3 task
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
-
Urgent request: Due to vulnerabilities move to API version 12.6.1 (12.6.2 eventually) or 13.1.1 Open
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
jbkunst/highcharter#849 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
equinor/energyvision#4027 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
bancolombia/sentinel#23 ·