Persistence: a follower shows its leader's rows after a cache-claim rotation
Maintainer antworten meist innerhalb von 1 Tag
Dieses Issue hat noch niemand übernommen.
Bewertung
- Schwierigkeit
- 5/5
- Geschätzter Aufwand
- Über eine Woche
- Anfängerfreundlichkeit
- 5/100
- Issue-Typ
- Bug
- Klarheit
- Muss geklärt werden
- Aktivitätsstatus
- Aktiv
- Tech-Stack
- sqlite, typescript
- Bereich
- databases
Rechercherichtung
Start on the branch fix/persisted-follower-rotation (03b8c15ee) and read persisted.ts around scoped recovery and the commit-notice handling. The oracle lanes are in packages/db-sqlite-persistence-core/tests/persisted-oracle.test.ts, which you can run to see which mutant cells fail. Done means the open questions are resolved, the six mutants are still killed, and persisted.ts is reduced in code weight.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Beschreibung
Summary
A follower tab whose persisted cache claim rotates can fail to show its leader's rows. #2128 fixes the follower's load ordering. Its review rounds also found a group of follower bugs that occur only around a cache-claim rotation. That work is too large to ship with #2128, so it moved to this issue. The work so far is on the branch fix/persisted-follower-rotation (03b8c15ee).
The problem
When a follower's cache claim rotates, the follower enters scoped recovery. Scoped recovery assumes that the Collection's own source supplies fresh rows, so it:
- refuses durable rows (
loadSubsetRowsUnsafereturns[]during scoped recovery). - turns every commit notice into another refetch (
invalidateFromCommittedTxUnsafecallsrefreshScopedSubsets).
A follower has no source of its own. Its rows arrive from the leader as durable commits and notices, and scoped recovery refuses both. The follower therefore never shows the leader's rows. Against a leader that commits on every ensure, each refetch causes another commit and another notice, so the follower loops. On main, the probe showed 10 ensures in 50 ms and no rows.
The design on the branch
The maintainer chose a root-cause design over threading an "owner evidence" flag through every reload path:
- While a rotated follower's reacquisition ensures are in flight, it holds the new generation's commit notices.
- When every active demand reacquires, it ends scoped recovery for that generation and applies the held notices through the normal path.
- If a reacquisition fails, scoped recovery stays, and the source reports the failure.
- Each scoped recovery owns its own reacquisition record. A newer recovery finishes the older record.
- Recovery can end only if this recovery rotated into a fresh generation and the node follows a leader.
- A demand that is released or aborted during reacquisition is ignored, and its
AbortErroris not reported. - A load that starts during reacquisition waits until reacquisition ends and its commits apply.
This design needs no getLeaderId() on the coordinator, so it has no public API change.
Bugs that the review rounds found and that the branch fixes
- The reconciliation reload, the seq-gap recovery, and the reset-term fence dropped the notice's evidence, so the follower looped or took an extra refetch round.
- A recovery with no rotation and no active demand ended scoped recovery at once and trusted the old cache again.
- A second rotation during reacquisition, with a leadership change, could leave notices held forever.
- A demand released during reacquisition kept scoped recovery in place and reported a false sync error.
- A load during reacquisition could settle while the leader's commits were still held.
- A queue flush could process held notices during reacquisition. In one topology the follower spun without yielding, on
mainas well.
Open questions
- A new demand after a superseded rotation as leader. In the cell "superseded as leader", a new demand
cloads and settles. It ends with no row. The node stays in scoped recovery after it rotates as leader, and the owner wrotecinto the superseded generation. The branch changed the cell to check only that the load settles. This is unproven. Before anyone accepts that expectation, decide whether it follows from the law or is a bug. - No retry after a failed reacquisition. Scoped recovery stays until a later rotation or cleanup. The lane prose records this as a limit. Decide whether this is the intended behavior.
- Code weight.
persisted.tson the branch is +119 net code lines againstmain. Look for reductions before review.
Oracle coverage on the branch
packages/db-sqlite-persistence-core/tests/persisted-oracle.test.ts has these lanes:
persistence.follower-generation-notice: commit before or after rotation, then a leader update, a gap notice, a reconciliation notice, or a peer notice.- Rotated reacquisition: two demands reacquire in either order, and an owner update can arrive between them. Any reacquisition can fail or be released. A new demand can start during reacquisition, and a rotation can be superseded as leader.
The branch kills these mutants:
| Mutant | Cells that fail |
|---|---|
| Notices are not held | 19 |
| Scoped recovery never ends | 21 |
| Recovery ends before every reacquisition settles | 19 |
| Recovery ends after a failure | 25 |
| A load does not wait during reacquisition | 20 |
| A superseded record never finishes | 18 |
#2128 keeps these lanes and pins the cells that its cut-down scope does not satisfy, with a comment that points to this issue.
Next steps
- Rebase or merge
fix/persisted-follower-rotationontomainafter #2128 merges. - Resolve the open questions above.
- Run a code review and an oracle review that reruns the mutants independently.
- Reduce code weight, then open the pull request.
Related: #2128, #2115.
- Vorherrschende Sprache
- TypeScript
- Sterne
- 3.9k
- Forks
- 272
- Ø Merge
- 1 T. 1 Std.
- Gemergte PRs (30 T.)
- 235
Entwicklungsumgebung
- Kein Dockerfile und keine Docker-Compose-Datei
- Hat eine Pull-Request-Vorlage
- Beitragsleitfaden lesen
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus TanStack/db
-
Schwierigkeit 3/5 Ein halber Tag Anfängerfreundlichkeit 62/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 8/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 3/5 Ein halber Tag Anfängerfreundlichkeit 58/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 25/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 35/100
Maintainer antworten meist innerhalb von 1 Tag
Ähnliche Issues
-
Contrib indemnité de départ à la retraite : faire le pont avec le simulateur sur la page génériqueOffenP1
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 62/100
SocialGouv/code-du-travail-numerique#7561 ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 85/100
kubernetes-sigs/headlamp#7950 ·
Maintainer antworten meist innerhalb von 3 Tagen
-
README for cliEvtl. vergeben @Janvi-kapoor hat das heute übernommen. OffenOSCI'26
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 70/100
GauravKarakoti/SecureFlow#1308 · 1 Kommentar ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
Maintainer antworten meist innerhalb von 1 Tag
-
documentation
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 62/100
vitest-dev/vitest#11577 ·
Maintainer antworten meist innerhalb von 1 Tag