dexie/Dexie.js

Performance issue when fetching/reading large data list using Table.get()

Open

#1,170 opened on Nov 13, 2020

View on GitHub
 (4 comments) (0 reactions) (0 assignees)JavaScript (625 forks)batch import
Help wanted

Repository metrics

Stars
 (10,304 stars)
PR merge metrics
 (Avg merge 2d 5h) (3 merged PRs in 30d)

Description

Good day Sirs!

I'm a newbie in terms of using Dexie.js. So my issue is almost identical with #1167

I'm using v.3.0.1 and also in React.

In my case I need to read almost 50,000 items, which causes my whole page to be unresponsive for almost 10 secs. Is there a better solution against this? const data = db[table].get({ id: row }); //I'll just refer to the code of #1167 since I'm also using db.table.get()

Thank you so much in advance!

Contributor guide

Research direction
Optimize the fetch by using pagination or batch reading with limit and cursor. Investigate if the issue is due to the number of items read in one go, and consider using Table.where() with a range or primary key lookups instead of Table.get() for many items.
Tech stack
javascript
Domain
frontend
Issue type
Performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
JavaScript
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60