awslabs/keys_values

View on GitHub

Stars: 18
Forks: 8
Open beginner issues: 0
Indexed issues: 29

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

28 open issues indexed

Refactor main fine-tuning script Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 48/100

awslabs/keys_values#151 · Opened Sep 3, 2026
Chunked backward fails when a generated region spans 3+ chunks (autograd_hooks annotation adjacency) Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

awslabs/keys_values#148 · 3 comments · Opened Aug 17, 2026
Allocate KV cache buffers in pages Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#137 · Opened Jul 8, 2026
Replace Lightning Fabric by elementary setup Open

enhancement

awslabs/keys_values#135 · 2 comments · 1 assignee · Opened Jul 1, 2026
Consider query-only test time training Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#132 · 1 comment · Opened Jun 18, 2026
Consider modern RoPE variants Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#131 · Opened Jun 18, 2026
Dashboards for training and evaluation loss Open

enhancement good first issue

awslabs/keys_values#104 · 1 comment · 1 assignee · Opened May 6, 2026
Implement LoRA improvements Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#86 · Opened Apr 10, 2026
Create auto-tuning script to find best parameter combinations Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#79 · 6 comments · Opened Apr 1, 2026
Roll back small number of KV cache updates Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

awslabs/keys_values#76 · 4 comments · Opened Mar 27, 2026
Backward CPU offloading: Asynchronous transfer Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#62 · 16 comments · Opened Mar 14, 2026
Configuration of fine-tuning scripts by YAML file Open

enhancement good first issue

Difficulty 4/5 3-5 days Newbie friendliness 42/100

awslabs/keys_values#50 · 1 comment · Opened Mar 6, 2026
KV cache seems not reset before applied to new sequence Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 38/100

awslabs/keys_values#45 · 1 comment · Opened Mar 2, 2026
Evaluation script fails when started independently >2 times Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

awslabs/keys_values#42 · 1 comment · Opened Feb 27, 2026
Can KV reordering be avoided with `flex_attention`? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#39 · 5 comments · Opened Feb 24, 2026
Clean up `flex_attention` integration, `extend_kv=False` case Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#34 · 3 comments · Opened Feb 19, 2026
Refactor node annotations in autograd_hooks.py Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 32/100

awslabs/keys_values#31 · 1 comment · Opened Feb 16, 2026
Try to use PyTorch DataLoader again Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#27 · Opened Feb 10, 2026
Implement speculative decoding Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#22 · Opened Feb 1, 2026
Complete code for GPU memory estimation. Use for decision making Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

awslabs/keys_values#20 · Opened Feb 1, 2026
Implement context parallelism (RingAttention) as `KVCache` Open

enhancement

awslabs/keys_values#19 · 5 comments · 1 assignee · Opened Jan 31, 2026
Implement FastGen as meta policy Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#17 · Opened Jan 31, 2026
Implement test to quantify the impact of different features on gradient approximation Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#15 · Opened Jan 31, 2026
Do finetune scripts work with AMP? Open

question

Difficulty 4/5 3-5 days Newbie friendliness 35/100

awslabs/keys_values#14 · Opened Jan 31, 2026
Support dynamic RoPE scaling during inference call Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

awslabs/keys_values#12 · Opened Jan 31, 2026
Identify and fix issues with `bnb-quantized*` quantization Open

enhancement good first issue

Difficulty 4/5 3-5 days Newbie friendliness 35/100

awslabs/keys_values#11 · Opened Jan 31, 2026
Support different cache types for each layer. Gradient computations when all or some caches are of type `DenseKVCache` Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

awslabs/keys_values#10 · 1 comment · Opened Jan 31, 2026
Improve recovery from OOM errors mechanism Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

awslabs/keys_values#8 · Opened Jan 31, 2026

awslabs/keys_values

Get new issues in your inbox