SQLite persistence silently serializes Temporal values as {}, breaking hydration and subset queries
Maintainer antworten meist innerhalb von 1 Tag
Bewertung
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Anfängerfreundlichkeit
- 50/100
- Issue-Typ
- Bug
- Klarheit
- Klar beschrieben
- Aktivitätsstatus
- Aktiv
- Tech-Stack
- sqlite, typescript
- Bereich
- databases
Rechercherichtung
Start by reading the shared serializer in @tanstack/db-sqlite-persistence-core and tracing how SQLiteCorePersistenceAdapter.applyCommittedTx writes and restores values. Run the standalone reproduction linked in the issue with Node 22.13 or newer to confirm the failing cases. Done means Temporal values retain their types and values through rows, metadata, and replay, and the listed subset queries return the expected keys.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Beschreibung
- I've validated the bug against the latest version of DB packages
Describe the bug
@tanstack/db-sqlite-persistence-core silently stores Temporal.Instant and Temporal.PlainDate as {}. After reopening the SQLite database, the original values and types are lost. This also affects nested values, row metadata, collection metadata, and transaction replay payloads.
We encountered this in an Expo application. The reproduction uses the shared core with real SQLite on Node, so it requires no application code or Expo setup.
To reproduce
Reproduction: standalone test and instructions, on branch codex/repro-temporal-persistence in robertf224/db.
git clone --branch codex/repro-temporal-persistence https://github.com/robertf224/db.git
cd db/reproductions/temporal-persistence
pnpm install --frozen-lockfile
pnpm test
Use Node 22.13 or newer. The reproduction writes two different dates using SQLiteCorePersistenceAdapter.applyCommittedTx, closes and reopens the SQLite file, then checks hydration, metadata, replay, and subset queries. The command intentionally exits 1 because its assertions describe the expected behavior.
The persisted row JSON includes:
{
"instant": {},
"plainDate": {},
"nested": { "dates": [{}] }
}
For rows early (2026-01-02) and late (2026-01-03):
| Query | Expected keys | Actual keys |
|---|---|---|
plainDate = Temporal.PlainDate.from('2026-01-02') |
['early'] |
[] |
plainDate > Temporal.PlainDate.from('2026-01-02') |
['late'] |
[] |
ORDER BY plainDate ASC LIMIT 1 |
['early'] |
['late'] |
These results occur both without and with a persisted expression index installed. The query failures follow value corruption; this does not establish a separate compiler defect on correctly encoded Temporal values.
Verified result: 3 passing controls, 10 failing cases. Date round-tripping, a Date range predicate, and ISO string preservation pass. Temporal's own JSON.stringify returns ISO strings, so the {} loss occurs in persistence's recursive encoding before JSON serialization.
Expected behavior
Supported Temporal values should preserve their type and value across persistence, including nested values and metadata. Subset predicates, sorting, pagination, and persisted index expressions should agree with those values. If Temporal is unsupported, an explicit error would be preferable to silently destroying the data.
Environment
- macOS, Node 24.19.0, pnpm 11.19.0
@tanstack/db0.11.3@tanstack/db-sqlite-persistence-core0.4.3 (npm latest checked October 5, 2026)temporal-polyfill0.3.2- No patches; real file-backed SQLite through
node:sqlite
Additional context
The shared serializer recursively enumerates objects but has no Temporal handling. These Temporal instances have no enumerable own state, so different values collapse to the same empty object.
@tanstack/offline-transactions 1.0.61 already preserves these Temporal values when global constructors are registered; the reproduction includes that as a passing control. This report concerns the remaining SQLite persistence gap.
Native Temporal support or an extensible codec would help. A codec contract would need to cover row values, metadata, replay, query literals, and compatible index/comparison semantics. We currently wrap writes and reads in an application codec, but already-corrupted {} timestamps need cache invalidation or refetching.
- Vorherrschende Sprache
- TypeScript
- Sterne
- 3.9k
- Forks
- 268
- Ø Merge
- 1 T. 3 Std.
- Gemergte PRs (30 T.)
- 193
Entwicklungsumgebung
- Kein Dockerfile und keine Docker-Compose-Datei
- Hat eine Pull-Request-Vorlage
- Beitragsleitfaden lesen
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus TanStack/db
-
Schwierigkeit 3/5 1-2 Tage Anfängerfreundlichkeit 72/100
Maintainer antworten meist innerhalb von 1 Tag
-
Debounce and throttle paced mutations allow concurrent persistence despite the documented single-flight contractEvtl. vergeben @KyleAMathews hat das heute übernommen. Offen
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 35/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 3/5 1-2 Tage Anfängerfreundlichkeit 68/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 48/100
TanStack/db#1972 · 2 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 45/100
Maintainer antworten meist innerhalb von 1 Tag
Ähnliche Issues
-
enhancement
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
Maintainer antworten meist innerhalb von 1 Tag
-
[Bug] remember() with special characters in namespace hangs until timeout instead of returning 400Offenbug
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 72/100
MystenLabs/MemWal#1133 · 1 Kommentar ·
Maintainer antworten meist innerhalb von 1 Tag
-
bug user-priority/P2
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 92/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 2/5 Unter einer Stunde Anfängerfreundlichkeit 88/100
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 88/100
Effect-TS/effect#8881 · 1 Kommentar ·
Maintainer antworten meist innerhalb von 1 Tag