Support GMPO Chunked loss

Open
#1,315 1 comment 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 3 days

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
45/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Quiet
Tech stack
python

Research direction

Start by reading Liger’s existing chunked GRPO loss implementation, then compare its behavior with the official GMPO code linked in the issue. The work is complete when native GMPO support is integrated into that loss and its token-level clipping and sequence-level geometric-mean aggregation are covered by the project’s relevant validation.

Written by the indexing model from the issue text.

Description

Please add native support for Geometric-Mean Policy Optimization (GMPO) to Liger’s chunked GRPO loss.
GMPO is a policy optimization algorithm published at ICLR 2026 that improves training stability by applying token-level clipping and aggregating importance ratios with a sequence-level geometric mean. Using DeepSeek-R1-Distill-Qwen-7B, GMPO improves the average Pass@1 score across five mathematical reasoning benchmarks from GRPO’s 59.3 to 63.4.
official code:https://github.com/callsys/GMPO

Dominant language
Python
Stars
6.7k
Forks
656
Avg merge
4d 12h
Merged PRs (30d)
27

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from linkedin/Liger-Kernel

All issues in linkedin/Liger-Kernel

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.