Design safe offline subset reuse and remaining managed-cache recovery contracts
Les mainteneurs répondent en général sous 1 jour
Personne n'a encore pris cette issue.
Évaluation
- Difficulté
- 5/5
- Temps estimé
- Plus d'une semaine
- Accessibilité débutants
- 5/100
- Type d'issue
- Fonctionnalité
- Clarté
- À clarifier
- Activité
- Active
- Stack technique
- electron, typescript
- Domaine
- data-engineering
Piste de recherche
This is a multi-part design issue, not a starting task: the work spans Electric snapshot cursors, the persisted cache wrapper, SQLite durability and legacy storage. Read the linked PR #2069 and issue #2056 first to see the boundary text they establish. Done means a separate, reviewed design per item with its oracle and test coverage, not a single patch.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
Problem
PR #2069 makes an invalid on-demand cache safe: it rotates the persisted cache generation and reacquires active subsets. This prevents stale rows from entering a new run, but it does not make a partial Electric cache an authoritative offline snapshot. A later cold start can need the network again. The PR also deliberately leaves several provider, upgrade, and settlement boundaries explicit. Track those product improvements together so each can get a separate design and implementation PR without weakening the safety law.
Work to design and implement
- Certify reusable Electric subsets. Define durable evidence for which predicate/window a source snapshot covers, whether it is exhausted, and which deletes or invalidations have been applied. Specify how overlapping subsets combine, how resume metadata ties to that evidence, and when evidence is revoked. On an offline cold start, publish only rows justified by still-valid coverage. Preserve the current rule that an uncertified partial cache rotates and fetches demanded subsets. Include warm and expired peer runs, empty snapshots, deletes, changed shape identity, and overlapping demands.
- Harden provider-controlled recovery hooks. PR #2069 now lets a custom on-demand source omit
restartAfterScopedRecovery: the persistence wrapper retires its old callbacks, cleans up that source session, rotates the cache, and reenterssync. Its controlled oracle and a real SQLite expiry test cover that path. For providers that implement their own hook, define and test when they retire callbacks, settle or reject outstanding demands, start new acquisitions, and fence late results after rotation. Include multi-tab and native-host receiving histories. - Choose a cross-version policy for legacy storage. The first new-format generation uses a different physical ID, so an older tab can still write to legacy tables. Specify the supported mixed-version window and the evidence that makes legacy storage safe to reclaim. Test an old writer racing an upgrade and a later cleanup, including process/tab crashes. Do not infer safety from a schema-version bump alone.
- Resolve publication versus durability after claim expiry. A claim can expire after core publishes a source row but before SQLite accepts its durable write; the receipt then rejects and the Collection fails terminally. Decide whether that fail-stop result is the contract or whether durability-first publication or a defined rollback/reload is required. If recovery is promised, specify caller settlement and public-row observations, then prove the chosen boundary with a real SQLite schedule.
- Enable parallel Electric snapshots only with independent cursor authority. The installed SDK currently shares a mutable snapshot cursor, so serialization is required for correctness. Design separate cursor/session ownership or change the SDK protocol before allowing concurrent snapshots. Test stalled and overlapping requests, cancellation, and late responses against the installed SDK.
- Reduce recovery code weight. Review the claim, wrapper, and provider recovery states against their oracle laws, remove redundant branches and helpers where a simpler existing boundary can carry the same guarantee, and keep review-evidence artifacts only where they remain useful to maintainers. Measure production and test/documentation diffs separately. Preserve the retirement, lease, and durable-authority witnesses when simplifying.
Completion criteria
- Record the chosen laws and vocabulary in the cache design, glossary, and user-facing Electric documentation. Distinguish product promises from bounded test evidence.
- For each changed law, extend the primary independent oracle and a receiving test at the provider/SQLite or host boundary. Include a hostile wrong-design control and state remaining unproved schedules in
docs/contributing/oracle-coverage.md. - Preserve eager and progressive Collection behavior and the warm peer's valid rows. No stale row may be published or written under a retired claim.
- Update the PR #2069 boundary text when a follow-up actually lands; this issue does not imply those behaviors already exist.
Related: #2056 and PR #2069.
- Langage dominant
- TypeScript
- Étoiles
- 3.9k
- Forks
- 272
- Merge moyen
- 1 j 48 min
- PR mergées (30 j)
- 238
Préparer son environnement
- Aucun Dockerfile ni fichier Docker Compose
- Propose un modèle de pull request
- Lire le guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de TanStack/db
-
Difficulté 5/5 Plus d'une semaine Accessibilité débutants 12/100
Les mainteneurs répondent en général sous 1 jour
-
Ordered, limited live query over a string key commits `loading` first (and `orderBy().findOne()` since 0.11.1)Peut-être pris @KyleAMathews l’a pris aujourd’hui. Ouverte
Difficulté 4/5 3-5 jours Accessibilité débutants 18/100
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 5/5 Plus d'une semaine Accessibilité débutants 18/100
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 4/5 3-5 jours Accessibilité débutants 18/100
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 5/5 Plus d'une semaine Accessibilité débutants 8/100
Les mainteneurs répondent en général sous 1 jour
Toutes les issues de TanStack/db
Issues similaires
-
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
Les mainteneurs répondent en général sous 1 jour
-
needs triage
Difficulté 2/5 1-3 heures Accessibilité débutants 76/100
homarr-labs/homarr#7191 ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 62/100
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 74/100
AvaProtocol/ava-sdk-js#276 ·
Les mainteneurs répondent en général sous 1 jour
-
useFragment does not require `variables` when the fragment's variables type has required fieldsOuverte
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
apollographql/apollo-client#13493 ·
Les mainteneurs répondent en général sous 1 jour