meta-pytorch/torchforge

View on GitHub

PyTorch-native post-training at scale

Stars: 703
Forks: 105
Open beginner issues: 0
Indexed issues: 63

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Apr 23, 2026
Latest indexed: Sep 21, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

63 open issues indexed

Any support for torch 2.10 and higher vllm？ Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

meta-pytorch/torchforge#776 · 1 comment · Opened May 22, 2026
[RFC] Fine-tuning on Intel hardware in the PyTorch ecosystem — where to invest? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#773 · 1 comment · 1 reaction · Opened Apr 16, 2026
feat: DNS-based service discovery for Monarch actor pools Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

meta-pytorch/torchforge#771 · Opened Mar 30, 2026
Should we use `world_size` or `world_size_across_dp` in generator Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

meta-pytorch/torchforge#770 · Opened Mar 13, 2026
How to colocate generator and actor on the same device Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

meta-pytorch/torchforge#769 · 2 comments · Opened Mar 12, 2026
Add K8s Support to Launcher Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

meta-pytorch/torchforge#768 · 1 comment · Opened Mar 11, 2026
Update monarch to the latest version Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

meta-pytorch/torchforge#766 · Opened Mar 2, 2026
Any demo with no requirement to miniconda? Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

meta-pytorch/torchforge#765 · Opened Feb 27, 2026
SFT example fails on saving checkpoint after evaluation Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

meta-pytorch/torchforge#759 · Opened Feb 16, 2026
ROCm CI support to Torchforge Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#754 · 2 comments · Opened Feb 6, 2026
Networking error in Docker due to host IP detection (workaround: set VLLM_HOST_IP) Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

meta-pytorch/torchforge#743 · 6 comments · Opened Jan 29, 2026
Environment variable setup issue ("Environment variable 'USER' not found") in Docker Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

meta-pytorch/torchforge#742 · 2 comments · Opened Jan 29, 2026
[ROCm] Upgrade vLLM Version Used in ROCm to v0.13.0 Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

meta-pytorch/torchforge#741 · 1 comment · Opened Jan 28, 2026
Titan Nightly Implementation in Forge Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

meta-pytorch/torchforge#730 · Opened Jan 26, 2026
forge repo is > 400 MB Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#727 · Opened Jan 23, 2026
[BUG] Checkpoint Save Fails When Overlapping with Evaluation in Distributed Training Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

meta-pytorch/torchforge#721 · 1 reaction · Opened Jan 21, 2026
Qwen3-1.7B-Base model doesn't work in GRPO app Open

meta-pytorch/torchforge#703 · 3 comments · 1 assignee · Opened Jan 16, 2026
[Main] Generator Perf Benchmark Open

high priority Tracking Issue

Difficulty 4/5 3-5 days Newbie friendliness 25/100

meta-pytorch/torchforge#673 · 1 comment · Opened Dec 24, 2025
[Feature] Real-Time Generation-Based Evaluation for SFT (Supervised Fine-Tuning) Open

enhancement

meta-pytorch/torchforge#665 · 5 comments · 1 assignee · Opened Dec 22, 2025
[CI] Ping specific torchstore & torchtitan nightly version Open

meta-pytorch/torchforge#656 · 1 comment · 1 reaction · 1 assignee · Opened Dec 18, 2025
Replace HF_TRANSER with XET Open

meta-pytorch/torchforge#643 · 1 assignee · Opened Dec 10, 2025
How to avoid mistakenly resuming from ckpt? Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

meta-pytorch/torchforge#631 · Opened Dec 8, 2025
Create test in torchtitan to prevent backward incompatible changes to `torchtitan/experiments/forge` folder Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

meta-pytorch/torchforge#627 · 1 comment · Opened Dec 6, 2025
On AWS EC2: "failed to create extended queue pair (QP): Operation not supported" Open

meta-pytorch/torchforge#626 · 4 comments · 1 assignee · Opened Dec 5, 2025
[Main] Nightly build mega-issue Open

high priority Tracking Issue

meta-pytorch/torchforge#625 · 1 comment · 1 assignee · Opened Dec 5, 2025
[Trainer] refactor/consolidate trainer implementations Open

best practices better engineering

meta-pytorch/torchforge#624 · 1 assignee · Opened Dec 5, 2025
[Main] Comprehensive Checkpointing Open

high priority Tracking Issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#619 · Opened Dec 3, 2025
[Main] launcher/allocator rewrite Open

enhancement Tracking Issue

meta-pytorch/torchforge#611 · 4 comments · 1 assignee · Opened Dec 1, 2025
[Metric Logging] Make it obvious that extra args passed in the config will be added to wandb.init Open

Difficulty 1/5 Under an hour Newbie friendliness 50/100

meta-pytorch/torchforge#594 · 1 reaction · Opened Nov 19, 2025
[Main] Observability Gap Tracking Open

high priority Tracking Issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#569 · 1 reaction · Opened Nov 13, 2025
[Documentation] Add more examples to forge Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

meta-pytorch/torchforge#562 · Opened Nov 12, 2025
[RFC Request] How to do eval? Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

meta-pytorch/torchforge#547 · 2 comments · Opened Nov 10, 2025
Packing logic for SFT incorrectly passed to TitanTrainer Open

bug high priority

meta-pytorch/torchforge#546 · 1 comment · 1 assignee · Opened Nov 10, 2025
torchforge repo take 400MB+, mostly from ./.git/objects/pack which needs to be cleaned up Open

best practices

Difficulty 4/5 3-5 days Newbie friendliness 30/100

meta-pytorch/torchforge#540 · 2 comments · 1 reaction · Opened Nov 8, 2025
Coder actor may cause infinite hang or OOM, switch to OpenEnv instead Open

bug

Difficulty 5/5 Over a week Newbie friendliness 35/100

meta-pytorch/torchforge#521 · 1 comment · Opened Nov 3, 2025
forge can not run two training job at the same time in same node due to port 36121 not available Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

meta-pytorch/torchforge#520 · 1 comment · Opened Nov 3, 2025
Enable AMP for fp16 training - train/inference mismatch Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

meta-pytorch/torchforge#513 · Opened Oct 31, 2025
Please explain the process of GPU allocation , when it comes to Trainer, Ref model and the rollout generator? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

meta-pytorch/torchforge#510 · 4 comments · Opened Oct 29, 2025
No support for SampleAccumulator Open

enhancement

meta-pytorch/torchforge#508 · 1 comment · 1 assignee · Opened Oct 29, 2025
[Feature Request] LORA Support for fine-tuning and LORA update for RL Open

enhancement

meta-pytorch/torchforge#506 · 3 reactions · 1 assignee · Opened Oct 28, 2025
[Algo] Truncated important sampling for off-policy mitigation Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#503 · 2 reactions · Opened Oct 24, 2025
[GRPO app] Add graceful shutdown when errors raised Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

meta-pytorch/torchforge#500 · 3 comments · 1 reaction · Opened Oct 23, 2025
[Feature] Add support for in-flight weight updates Open

meta-pytorch/torchforge#496 · 10 reactions · 1 assignee · Opened Oct 23, 2025
Replace conda with uv for installation Open

meta-pytorch/torchforge#494 · 2 comments · 5 reactions · 1 assignee · Opened Oct 23, 2025
RFC: Checkpointing Beyond Model Weights (Why we can’t do it now, and what we’ll do next) Open

discussion enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#433 · 12 comments · 2 reactions · Opened Oct 15, 2025
Integration test mega-issue Open

better engineering Tracking Issue

Difficulty 5/5 Over a week Newbie friendliness 20/100

meta-pytorch/torchforge#411 · 3 comments · Opened Oct 14, 2025
Simplified Wandb View/pruning Open

better engineering

meta-pytorch/torchforge#403 · 5 comments · 2 reactions · 1 assignee · Opened Oct 14, 2025
[feature request] Metric Logging frequency parameter Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

meta-pytorch/torchforge#395 · Opened Oct 13, 2025
[GRPO app] Logging hygiene request Open

better engineering discussion

meta-pytorch/torchforge#372 · 5 comments · 3 assignees · Opened Oct 10, 2025
No HF format checkpoint been saved in GRPO training, only saw pytorch checkpoint Open

enhancement

meta-pytorch/torchforge#367 · 9 comments · 3 assignees · Opened Oct 9, 2025

meta-pytorch/torchforge

Get new issues in your inbox