Add INT3 and INT2 group codecs with packing
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 58/100
- Issue type
- Feature
- Clarity
- Clearly specified
- Activity status
- Active
- Domain
- machine-learning
Research direction
Start by reading the existing 4-bit and 8-bit packing code in src/bitsmith/packing/ and how their codecs are exposed to gptq_quantize and bitsmith sqnr. Add known-layout and round trip coverage for the 3-bit and 2-bit formats, including the stated layout of eight 3-bit values in three bytes. Done means both codecs work with GPTQ and appear in bitsmith sqnr.
Written by the indexing model from the issue text.
Description
Only 4- and 8-bit integers are packed today. 3-bit and 2-bit weights (used with GPTQ in
some low-memory setups) need their own packing: for example 8 three-bit values in 3 bytes.
Task: add pack_int3/unpack_int3 and pack_int2/unpack_int2 in
src/bitsmith/packing/, codecs int3 and int2, and make gptq_quantize usable with them.
Done when known-layout and round trip tests pass and bitsmith sqnr shows both.
- Dominant language
- Python
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from yashwanthdevavarapu/bitsmith
-
area: benchmarks good first issue help wanted
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
area: benchmarks good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
-
area: cli area: formats good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 92/100
-
area: cli good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
area: benchmarks good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
All issues in yashwanthdevavarapu/bitsmith
Similar issues
-
Difficulty 1/5 1-3 hours Newbie friendliness 88/100
aws-samples/sample-per-model-bedrock#857 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 70/100
521xueweihan/HelloGitHub#4328 ·
-
documentation maintainer-managed
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
awslabs/visual-asset-management-system#1418 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day