Cache payload should be compressed before storing

Open
#1 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
42/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
backend

Research direction

Start by locating the Python package's on-disk cache write and read paths, then review how cached payloads are serialized. Implement zip compression for stored payloads and verify that compressed entries can still be retrieved correctly and that cache size is reduced.

Written by the indexing model from the issue text.

Description

Experiments show that an on disk cache compresses very well.

A 105MB cached payload compressed to 272KB with zip and 79KB with bzip2.

zip compression was much faster so seems like a good thing to implement.

The total cache size was 1.5GB and it came down to about 4MB after zip compression which is very manageable.

Dominant language
Python
Stars
6
Forks
2
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.