Reduce memory overhead of `_deserialize_from_store`
@ozer550 is already working on this.
Since Mar 23, 2026.
Assessment
This issue has not been assessed yet.
Description
Observed behavior
When syncing large amounts of data and upon successful transfer, that data is deserialized into the store (_deserialize_from_store), memory usage often spikes.
Expected behavior
The behavior of _deserialize_from_store should reduce its memory usage by loading only the necessary data / models into memory.
User-facing consequences
In some online deployments with strict resource constraints, OOM killer may kill the process that is handling the deserialization.
- Dominant language
- Python
- Stars
- 15
- Forks
- 23
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 4
Getting set up
- Ships a Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from learningequality/morango
-
Difficulty 3/5 1-2 days Newbie friendliness 58/100
learningequality/morango#349 ·
-
Model hierarchies using self-referential non-deferrable FKs can cause deletions to fail deserializationMay be free again @bjester claimed this 95 days ago, and no pull request is open. OpenDEV: backend P0 - critical
learningequality/morango#340 · 1 assignee ·
-
P1 - important
Difficulty 3/5 1-2 days Newbie friendliness 45/100
learningequality/morango#308 · 1 comment ·
-
Serialization into store does not update _self_ref_fk for existing recordsMay be free again @bjester claimed this 95 days ago, and no pull request is open. OpenDEV: backend P0 - critical
learningequality/morango#305 · 1 assignee ·
-
DEV: backend TAG: performance
Difficulty 5/5 Over a week Newbie friendliness 25/100
learningequality/morango#291 ·
All issues in learningequality/morango
Similar issues
-
ACK_WAITING HELP_WANTED UPDATE_CS
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
OWASP/CheatSheetSeries#2458 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
BasedHardware/omi#19711 ·
Maintainers usually reply within 1 day
-
Qwen3_5MoeModel no longer returns router_logits, breaking aux loss with output_router_logits=TrueOpen
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
huggingface/transformers#49172 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
vllm-project/vllm-metal#885 ·
Maintainers usually reply within 1 day