simonw/datasette-lite

Could this use the SQLite range header trick?

Open

#28 opened on May 4, 2022

View on GitHub
 (10 comments) (5 reactions) (0 assignees)CSS (39 forks)github user discovery
help wantedresearch

Repository metrics

Stars
 (402 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

https://twitter.com/BardakciBaba/status/1521927918603145216

Impressive! Does it download the whole database or only the bits sqlite actually needs - possibly via http range requests a la https://phiresky.github.io/blog/2021/hosting-sqlite-databases-on-github-pages/

Right now Datasette Lite downloads the whole SQLite database. But could it work with the range trick?

This would be difficult to pull off, because it would involve compiling a custom build of Python's sqlite3 module. Could probably use https://github.com/coleifer/pysqlite3 as a starting point for that.

I'm going to leave this open as a "research" and "help wanted" issue, in case anyone else is inspired to try and figure it out!

Contributor guide

Research direction
Explore compiling a custom build of Python's sqlite3 module using pysqlite3 to support HTTP range requests for SQLite databases in the Pyodide environment.
Tech stack
pythonsqlite
Domain
backendweb dev
Issue type
Research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
PythonSQLiteWebAssembly
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20