perf(cli): establish built help and version startup baselines

Aperta
#2,482 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
22/100
Tipo di issue
Funzionalità
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
cli, nodejs, typescript
Ambito
cli, performance

Direzione di ricerca

Start with scripts/measure-cold-start.mjs and the built CLI's help and version entry points, but the build must first succeed: TypeScript and the locked dependency restore are currently blocked, and dist is absent. Add focused runner tests for missing dist, nonzero child exit, timeout and invalid samples, using deterministic inputs for quantile and output-shape checks. Done means three rounds of at least 20 fresh processes per command with raw observations, SHA, Node/platform details and p50/p95 published, with no performance claim.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Summary

Split the packaged CLI startup measurement out of the broader benchmark request github/squad#2476. This is a measurement-only issue for two commands: the built CLI's help and version entry points. It does not authorize startup optimization or a new benchmark framework.

Parent: github/squad#2481.

Proposed primary owner: cli-dev.

Existing evidence and blocker

At audited revision 47082a81799710c3e457b594123d190c00596ebf, scripts/measure-cold-start.mjs exists, but built CLI startup could not be measured. TypeScript was unavailable, locked dependency restoration returned a configured-feed E404 for hono-4.13.17.tgz, and dist was absent. There is no established startup latency or RSS result yet, and no startup bottleneck/speedup is claimed.

Use the existing built/shipping CLI entry point and runner after the documented restore/build succeeds. Source-loader or SDK-import probes are not substitutes, as illustrated by the packaged-path correction in microsoft/aspire#16704.

Scope

  • In: help/version process-start-to-exit wall time and process maximum RSS, existing runner output/error handling, portable reproduction instructions and raw artifacts.
  • Out: interactive shell/session resume, model calls, config/charter/memory/backend benchmarks, lazy-import changes, CI gates, cross-platform rollout and solving package-feed infrastructure in product code.

Measurable acceptance and tests

  • For each command, collect three rounds of at least 20 fresh child processes on the same recorded SHA/build/environment. Record first observations separately and label OS filesystem-cache state; do not describe warm-filesystem fresh processes as cold storage.
  • Publish every raw elapsed/RSS observation, exit status, exact command, SHA, Node/platform/build mode and per-round p50/p95. RSS must be labeled as process maximum RSS, not allocation volume or total agent-session memory.
  • Run without inference/network workload or user-home mutation. Verify expected help/version output and successful exit on every measured invocation; keep output equivalent to the unmodified built CLI.
  • Focused runner tests prove missing dist, child nonzero exit, timeout and missing/invalid measurement data fail explicitly rather than emit a successful zero/NaN sample. Quantile/output-shape tests use deterministic inputs.
  • Publish a portable command and shared results artifact; no dependency on a private Copilot session path. If restore remains blocked, retain the exact blocker and leave measurement acceptance incomplete.

Done means

A reproducible, correctly labeled baseline for these two commands and failure-sensitive runner tests. No performance improvement is required or claimed by this measurement issue. Any identified startup optimization requires its own narrowly scoped, measured follow-up. The rollup github/squad#2481 tracks this result.

Lingua principale
TypeScript
Stelle
3.4k
Fork
516
Merge medio
1g 15h
PR unite (30g)
116

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di github/squad

Tutte le issue di github/squad

Issue simili

Altre issue su TypeScript

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.