dexie/Dexie.js

Performance issue when fetching/reading large data list using Table.get()

Open

#1,170 opened on Nov 13, 2020

View on GitHub
 (4 comments) (0 reactions) (0 assignees)JavaScript (10,304 stars) (625 forks)batch import
Help wanted

Description

Good day Sirs!

I'm a newbie in terms of using Dexie.js. So my issue is almost identical with #1167

I'm using v.3.0.1 and also in React.

In my case I need to read almost 50,000 items, which causes my whole page to be unresponsive for almost 10 secs. Is there a better solution against this? const data = db[table].get({ id: row }); //I'll just refer to the code of #1167 since I'm also using db.table.get()

Thank you so much in advance!

Contributor guide

Tech stack
javascript
Domain
frontenddatabaseperformance
Issue type
performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
Familiarity with Dexie.js APIUnderstanding of IndexedDB
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
45
Research direction
The issue reports a performance problem when fetching 50,000 items using Table.get() in Dexie.js. It references a similar issue #1167. Investigate whether the problem can be mitigated by using alternatives like Table.toArray() with pagination or using a cursor and batch processing. Check the comments in the issue for any suggested workarounds or discussions about the underlying IndexedDB limitations.