Workspace search index: post-turn rescans still walk large non-git project roots for 15 minutes after a search

Abierto
#39,541 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
48/100
Tipo de issue
Error
Claridad
Bien especificado
Estado de actividad
Activo
Stack tecnológico
typescript
Área
backend, desktop

Línea de trabajo

Start with RunFinalizationService.refresh, WorkspaceEntries.refresh, and WorkspaceSearchIndex.refresh in apps/server, then trace how finder.scanFilesAsync() and watchAsync interact with WORKSPACE_INDEX_IDLE_TTL and WORKSPACE_INDEX_SCAN_TIMEOUT. Reproduce with a large non-git project and observe scans after searches and completed turns. Done means post-turn refreshes avoid repeated overlapping full scans while keeping the index updated.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

[!NOTE]
Written by Claude Opus 5.5 (Claude Code) on behalf of the account owner. Numbers are from one Windows install; the code references are from the bundled server of 0.1.11-nightly.20261119.4941.

Before submitting
  • I searched existing issues and did not find a duplicate of the remaining disk activity.
  • I included enough detail to investigate the problem.
Area

apps/server (workspace search index)

Steps to reproduce
  1. Open a large non-git folder as a project on Windows.
  2. Search for a file from the composer, then run multiple agent threads in that project.
  3. Observe filesystem activity after turns finish, during the 15 minutes following the search.
What happens

After a file search in a project, every finished turn in that project triggers a full rescan of the whole project folder for the next 15 minutes:

  • RunFinalizationService.refresh calls workspaceEntries.refresh(cwd) after each run.
  • WorkspaceEntries.refresh calls WorkspaceSearchIndex.refresh(), which calls finder.scanFilesAsync(), whenever an index exists for that cwd and was searched within WORKSPACE_INDEX_IDLE_TTL (15 minutes).

For a project whose root is a large folder that is not a git repository (so no .gitignore applies), each scan walks hundreds of thousands of files. The scan hits WORKSPACE_INDEX_SCAN_TIMEOUT (15 s), so the index stays incomplete, and the next turn starts another full scan. With many agent threads in one project, the rescans overlap.

What we measured on Windows 11 (32 cores, NVMe), with about 50 agent sessions:

  • A file search from the composer at 00:07 (about 30 projects.searchEntries requests in 30 s, several at 15.5 s).
  • At 00:10 the server process was doing 25,642 file-system operations a second, by our walker probe.
  • From 00:10 to 00:25, every new process on the machine took 1.4-3.4 s to start, against 0.03-0.1 s normally. Short-lived hook processes (Claude Code hooks with a 10 s limit) timed out, and agents' tool calls were refused.
  • Back to normal by 00:30, about 15 minutes after the last search.
Expected behavior

One of these, any of which would avoid repeated full walks:

  • Update an existing index from the file watcher (watchAsync is already set up) instead of scanFilesAsync() after each turn.
  • Or, after a turn, rescan at most once per interval per index, and never while a scan is running.
  • Or skip post-turn refreshes for an index whose last scan did not complete (timed out).

A setting to turn post-turn index refresh off would also help.

Impact

Major degradation or frequent failure.

Related reports

Issue #22586 reported the same rescan trigger and server event-loop blocking. PR #35460 moved the calls off the event loop; PR #38585 stops refreshes after the index has been unused for 15 minutes. This report concerns the remaining filesystem load during that 15-minute window on the newer release.

Version or commit

0.1.11-nightly.20261119.4941.

Environment
  • T3 Code (Nightly) 0.1.11-nightly.20261119.4941, desktop app with the bundled server, Windows 11 Pro.
  • Project root: a non-git folder with several hundred thousand files, most of them in nested folders with their own data.
Lenguaje dominante
TypeScript
Estrellas
24.8k
Forks
6.4k
Merge medio
4 h 29 min
PR fusionados (30 d)
488

Preparar el entorno

Abrir en Codespaces

Inicia el contenedor de desarrollo del proyecto en tu navegador, con tu propia cuenta de GitHub.

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de pingdotgg/t3code

Todos los issues de pingdotgg/t3code

Issues similares

Más issues de TypeScript

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.