google/brotli

using brotli compression on embedded iot with limited RAM

Open

#1,018 创建于 2023年6月6日

在 GitHub 查看
 (1 评论) (0 反应) (0 负责人)TypeScript (12,671 star) (1,237 fork)batch import
help wanted

描述

hello brotli i want to use the brotli compression which gave good compression rates on the type of data i need to compress (tested with the cli tool) . but before digging on how to use brotli compression in my (zephyr OS based) application i want to make sure its possible. in total the RAM of my device is 64k (ARM cortex M4 64Mhz), so with all the rest of the application i would say that max footprint can be ~4k, preferably smaller (including buffer for input by chunks of 256/512 bytes max). i do not care so much for speedy compression but rather have compress rate high as possible.

can brotli work in this conditions ? are the windows and other allocation sizes configurable ? i read that it uses a dictionary - what size of dictionary will it use for ~32kbyte of data ?

hope to read you soon best regards Ziv

贡献者指南

技术栈
c
领域
performance
议题类型
research
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-3 hours
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
needs maintainer response
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
basic understanding of Cembedded systems memory constraintsbrotli compression concepts
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
30
研究方向
Investigate brotli's memory requirements, specifically the dictionary size and internal buffer allocations. Check if there are compile time flags to reduce memory usage. Look into the brotli encoder and decoder source code in the repository (especially encoder.c and decoder.c) for configurable parameters. Consider whether a smaller dictionary or streaming mode could fit within 4kB RAM.