Copilot desktop app activity stopped being attributed to `copilot_app` in usage metrics
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 4/5
- Tempo stimato
- 3-5 giorni
- Idoneità per principianti
- 35/100
- Tipo di issue
- Bug
- Chiarezza
- Specificata chiaramente
- Stato di attività
- Attiva
- Stack tecnologico
- github
- Ambito
- analytics
Direzione di ricerca
No source file or test is identified in the issue. Start by reproducing the organization users-1-day report for a desktop app user and compare the app and CLI attribution fields; the issue is done when desktop activity is attributed to copilot_app, retaining CLI attribution only when both surfaces are involved.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Short summary
After a Copilot desktop app update, organization usage reports stopped attributing activity from some desktop app users to the copilot_app surface.
Affected version or release
1.1.21
Installation context
All people in the org using Github Copilot app.
What happened?
After a Copilot desktop app update, organization usage reports stopped attributing activity from some desktop app users to the copilot_app surface.
Before the update, desktop app sessions produced all expected signals:
used_copilot_app: truetotals_by_copilot_app- A
copilot_appentry intotals_by_feature - In some cases, simultaneous CLI attribution because the app uses the CLI runtime internally
After the update, the same users’ activity continued to be reported, but only as CLI activity:
used_cli: truetotals_by_clipresentcopilot_clifeature activity presentused_copilot_app: falsetotals_by_copilot_appabsent- No
copilot_appfeature entry
❗ Comparing weekdays before and after the transition:
- Reported Copilot App active users fell 78%
- Copilot App requests fell 94%
- Copilot App generations fell 96%
- CLI active users increased 42%
- CLI requests increased 97%
- CLI prompts increased 215%
- CLI-only attribution increased 196%
- Simultaneous app-and-CLI attribution fell 89%
The organization-level report reconciles exactly with the per-user rows, so this is not a downstream dashboard or aggregation problem. The incorrect attribution originates in GitHub’s telemetry or reporting pipeline.
Steps to reproduce
- Use the GitHub Copilot desktop app through an organization-managed Copilot license.
- Download the organization
users-1-dayusage report. - Locate the user’s activity for that day.
- Observe that desktop app activity is reported under
used_cliandtotals_by_cli. - Observe that
used_copilot_appisfalse, whiletotals_by_copilot_appand thecopilot_appfeature row are absent.
Expected behavior
Activity initiated in the GitHub Copilot desktop app must be attributed to the copilot_app surface, even if the app uses the Copilot CLI runtime internally.
If both surfaces are intentionally involved, the report should retain both signals, as it did previously and as GitHub’s documented example schema supports.
Additional context
‼️ This is not acceptable for a paid organization product. We rely on these metrics to measure Copilot App adoption and justify substantial licensing and AI-credit expenditure. Reporting desktop app usage as CLI-only materially misrepresents product adoption and makes the organization metrics unreliable.
- Lingua principale
- Nessun dato sulla lingua
- Stelle
- 2.1k
- Fork
- 157
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Guida per i contributori
Apri la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di github/app
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
Issue simili
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
pydata/pydata-sphinx-theme#2503 ·
-
bug triage_needed
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
-
P3 size: 1 task
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
-
🦾 ai-candidate
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100