[heft-typescript-plugin] Watch-mode type checking runs synchronously on Heft's main thread and stalls every other task (first watch build ~2x slower)
Les mainteneurs répondent en général sous 1 jour
Personne n'a encore pris cette issue.
Évaluation
- Difficulté
- 5/5
- Temps estimé
- Plus d'une semaine
- Accessibilité débutants
- 45/100
- Type d'issue
- Bug
- Clarté
- Clairement spécifiée
- Activité
- Active
- Stack technique
- node.js, typescript
- Domaine
- build-system, tooling
Piste de recherche
Start in heft-plugins/heft-typescript-plugin/src/TypeScriptBuilder.ts, especially _runWatchAsync, #getCreateBuilderProgram, and the existing #queueTranspileInWorker path. Trace how createWatchProgram and pendingOperations block the main thread, then compare the worker-thread plumbing. Done means an opt-in typeCheckInWorker configuration keeps independent tasks running while diagnostics and declaration emit complete correctly in watch mode.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
🤖 Filed by GitHub Copilot acting for @namankanakiya (light review only).
Target: rushstack GitHub issues (package folder heft-plugins/heft-typescript-plugin)
Summary
In heft run-watch, the TypeScript task builds and checks its program with one synchronous call on the main
thread. Heft runs all tasks of a phase in that same process, so while the program is built (several seconds for a
large project) no other task can make progress, even tasks that do not depend on TypeScript. In our setup the type
check only produces diagnostics and declarations (JavaScript comes from a separate transpile task), and the bundler
task depends only on the transpile task. The bundler still waits for the type check: either it starts only after
the type check finishes, or, if it started first, its JavaScript side is paused for the duration. The first watch
build takes roughly the type check time plus the bundle time instead of the longer of the two.
Versions
- @rushstack/heft 1.3.2, @rushstack/heft-typescript-plugin 1.3.24 (same version as on
maintoday) - TypeScript 5.3.3 (type check only;
isolatedModules: true) - @rushstack/heft-isolated-typescript-transpile-plugin 1.2.29 (SWC emits the JavaScript)
- @rushstack/heft-rspack-plugin 0.3.30 with @rspack/core 1.7.7 (the webpack5 plugin runs in the same process and should behave the same; not measured)
- Node.js 22.16, Linux, 16 cores
Repro
A build phase whose bundler task does NOT depend on the typescript task:
// config/heft.json (abridged)
{
"phasesByName": {
"build": {
"tasksByName": {
"typescript": { "taskPlugin": { "pluginPackage": "@rushstack/heft-typescript-plugin" } },
"transpile": {
"taskPlugin": { "pluginPackage": "@rushstack/heft-isolated-typescript-transpile-plugin" }
},
"webpack": {
"taskDependencies": ["transpile"],
"taskPlugin": { "pluginPackage": "@rushstack/heft-rspack-plugin" }
}
}
}
}
}
Use a project large enough that program creation takes a few seconds (ours has 8,198 files in the program), then run:
heft --debug run-watch --only build -- --clean
and compare the timestamps of the [build:typescript], [build:transpile] and [build:webpack] lines.
Measured impact
Five consecutive runs of the command above, each stopped after the first build, warm OS file cache. Times are
seconds since start:
| Run | Task order | TS task start | TS compile (Starting compilation -> Finished, end - start) |
TS task duration (Heft's Finished incremental task execution) |
Bundler start | Bundler duration | First build done |
|---|---|---|---|---|---|---|---|
| 2 | bundler first | 1.18 | 1.30 -> 9.17 (7.87 s) | 7.98 s | 1.20 | 14.96 s | 16.49 |
| 3 | bundler first | 1.20 | 4.17 -> 11.91 (7.74 s) | 10.71 s | 1.22 | 14.80 s | 16.31 |
| 4 | TS first | 1.17 | 1.20 -> 8.91 (7.71 s) | 7.74 s | 8.91 | 7.02 s | 16.23 |
| 5 | TS first | 1.25 | 1.27 -> 8.95 (7.68 s) | 7.70 s | 8.95 | 6.79 s | 16.04 |
no --clean |
TS first | 1.16 | 1.19 -> 8.23 (7.04 s) | 7.08 s | 8.24 | 7.01 s | 15.54 |
In run 3 the TypeScript task started at 1.20 s but printed Starting compilation only at 4.17 s: the bundler's
JavaScript work, which started at 1.22 s, held the shared main thread for those 3 s. The two directions interfere.
TypeScript's own breakdown for one run: I/O read 0.28 s and parse 2.24 s over 8,198 files, Program (incl. read and
parse) 4.97 s, bind 1.03 s, check 0.68 s, emit 0.43 s.
- When the bundler starts first, its duration doubles (14.8-15.0 s instead of 6.8-7.0 s): it is paused while the
synchronous program build holds the event loop. - When TypeScript starts first, the bundler (which depends only on the transpile task) starts at 8.9 s. The
transpile task finishes its 28 files in 27 ms of work but reports completion only when the type check returns. - Either way, the first watch build takes ~16 s. If the type check did not block the main thread, it would take
about max(7.7, 1.2 + 7.0) ≈ 8.2-8.5 s, roughly half.
Root cause (main)
heft-plugins/heft-typescript-plugin/src/TypeScriptBuilder.ts:
_runWatchAsync(line 325) creates the watch program withtool.watchProgram = ts.createWatchProgram(compilerHost)
(line 361). That single synchronous call builds the program and runs the first semantic check and emit through the
watch host (#buildWatchCompilerHost, lines 1053-1075).- Later watch iterations run the queued TypeScript operations synchronously in the same function (the
pendingOperationsloop, lines 365-372). - The existing
useTranspilerWorkeroption (in the watch path,#getCreateBuilderProgram: TypeScriptBuilder.ts lines 934-942;#queueTranspileInWorkerat lines 1212-1223, which creates the Worker at line 1223) moves only the
JavaScript transpile to a worker. Program creation and type checking stay on the main thread.
Suggested fix
Add an opt-in option (for example "typeCheckInWorker": true in config/typescript.json) that hosts the watch
program in a worker_threads worker. The worker builds the program, type-checks and emits declarations; the main
thread awaits a promise and receives the diagnostics and emit results as messages. The plumbing is like the existing
transpiler worker (#queueTranspileInWorker). With this option the main thread stays free, so independent tasks
(transpile, generators, the bundler) run while the check proceeds. The first watch build drops to about the longer of
the type check and the bundle. Incremental watch iterations of a large program would no longer stall the bundler
either (not measured here).
- Langage dominant
- TypeScript
- Étoiles
- 6.5k
- Forks
- 710
- Merge moyen
- 1 j 21 h
- PR mergées (30 j)
- 46
Préparer son environnement
Lance le conteneur de développement du projet dans votre navigateur, avec votre propre compte GitHub.
- Aucun Dockerfile ni fichier Docker Compose
- Propose un modèle de pull request
- Aucun guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de microsoft/rushstack
-
[rush] Upgrade the pnpm-sync-lib dependency to 0.3.5.Peut-être pris @martinnaj l’a pris il y a 7 jours. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
microsoft/rushstack#5971 · 2 commentaires ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 65/100
microsoft/rushstack#5902 · 1 réaction ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 68/100
microsoft/rushstack#5839 · 1 réaction ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 70/100
microsoft/rushstack#5683 · 3 commentaires ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 3/5 1-2 jours Accessibilité débutants 48/100
Les mainteneurs répondent en général sous 1 jour
Toutes les issues de microsoft/rushstack
Issues similaires
-
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
nats-io/nats.docs.v2#101 ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 1/5 Moins d'une heure Accessibilité débutants 72/100
profullstack/ugig.net#601 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 1/5 Moins d'une heure Accessibilité débutants 90/100
github/codeql-action#4202 ·
Les mainteneurs répondent en général sous 1 jour
-
agents: formatReport/reportOrigin only importable through an entry that loads every runtime (~1.5 s)Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 68/100
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
Les mainteneurs répondent en général sous 1 jour